Senior Data Engineer at Enigma

New York, New York, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Technology, Business IntelligenceIndustries

Requirements

5+ years of engineering or data science experience, including 3+ years working on distributed data systems
Practical experience extracting value from data in a creative way to deliver customer impact
Cares deeply about creating value and wants to learn, ship, and iterate quickly
Strong collaboration skills and a desire to work in a cross-functional environment
A principled, metrics-driven approach to solving complex data problems

Responsibilities

Understand the unmet needs of customers and create capabilities to address these, involving exploring data, prototyping, evaluation, and building robust, maintainable data pipelines
Engineer scalable and maintainable data systems that tell the story of millions of U.S. small businesses (using Databricks SQL, PySpark, and MLFlow)
Build on top of innovative data infrastructure designed for iteration and experimentation (using Dagster for orchestration and LakeFS for data versioning)
Apply a data-focused, first-principles approach to problem solving, biasing towards simple and elegant solutions but capable of implementing state-of-the-art models and techniques when required
Inspire teammates to perform at their best while fostering a collaborative, supportive team culture
Design, build, and maintain the core small business data product
Collaborate with cross-functional teams to build new product capabilities from raw source data through scalable data pipelines and models to the customer interface

Skills

Key technologies and capabilities for this role

PySparkDatabricks SQLMLflowDagsterLakeFS

Questions & Answers

Common questions about this position

What are the key responsibilities of the Senior Data Engineer role?

You will design, build, and maintain core small business data products, engineer scalable data pipelines using Databricks SQL, PySpark, and MLFlow, collaborate with cross-functional teams, and foster a collaborative team culture.

What experience is required for this position?

Candidates must have 5+ years of engineering or data science experience, including 3+ years working on distributed data systems, practical experience extracting value from data, and strong collaboration skills.

What technologies will I be working with?

The role involves Databricks SQL, PySpark, MLFlow, Dagster for orchestration, and LakeFS for data versioning, with bonus points for Python, Spark, and Databricks experience.

What is the company culture like at Enigma?

Enigma embraces customer focus, end-to-end ownership, high-trust and responsibility, collaboration with cross-functional teams, and a supportive team culture where impact is measured by value delivered and technical quality.

What makes a strong candidate for this role?

Ideal candidates have 5+ years experience including distributed systems, extract value from data creatively, care about creating value and iterating quickly, and possess strong collaboration skills with a metrics-driven approach.

Enigma

Provides financial data for SMBs

About Enigma

Enigma offers detailed insights into the financial health and identity of small and medium-sized businesses (SMBs) by collecting and analyzing data from millions of them. Their proprietary panel covers nearly half of all U.S. card transactions, providing real-time data that is updated monthly. Companies use this information to enhance their sales and marketing strategies, onboard clients, and monitor risks. Enigma differentiates itself by offering comprehensive data that helps businesses improve client targeting and acquisition, generating revenue through access to this valuable information.

New York City, New YorkHeadquarters

2011Year Founded

$158.8MTotal Funding

SERIES_CCompany Stage

Data & Analytics, Financial ServicesIndustries

51-200Employees

Benefits

Company Equity

Risks

Shadow banking surge complicates SMB financial health assessments, impacting accuracy.

Google's cookie policy reversal increases competition in digital marketing strategies.

Rapid AI evolution pressures Enigma to continuously innovate and integrate new solutions.

Differentiation

Enigma provides real-time, accurate data on SMB financial health and identity.

Their proprietary panel covers nearly half of all U.S. card transactions.

Enigma's data is easily integrated into workflows, enhancing client acquisition and retention.

Upsides

Partnership with Databricks enhances data delivery and customer engagement capabilities.

Growing demand for AI-driven insights boosts Enigma's market relevance and potential.

Open banking initiatives create new opportunities for Enigma's data services.

Land your dream remote job 3x faster with AI

Try Jobo Free