Staff Data Engineer

United States

Apply with AI Apply

Not SpecifiedCompensation

Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Software, Data Management, Cloud ComputingIndustries

Requirements

Candidates must possess a Bachelor's degree in Computer Science or Computer Engineering, or foreign equivalent, along with 60 months (5 years) of progressive experience as a software engineer. Specific requirements include 5 years of experience in developing and optimizing large-scale, distributed microservices and APIs using Scala, Java, or Python; 5 years of experience using Spark or similar tools for data pipelines with NoSQL and relational databases; 5 years of experience with CI/CD automation using Github, Gitlab, or Jenkins; 5 years of experience with Big Data/Cloud technologies; 5 years of experience in data modeling; 5 years of experience orchestrating data pipelines with tools like Astronomer or Airflow; and experience with Docker for containerization.

Responsibilities

The Staff Data Engineer will define and drive software architecture, re-designing data-pipeline software for over 200 million records daily to increase efficiency and responsiveness. Responsibilities include driving technical direction for data engineering, developing and maintaining the data engineering technical strategy and roadmap, leading the integration of data pipelines, advocating for best software engineering practices, mentoring engineering talent, and working with product managers to break down product initiatives. The role also involves leading the design and implementation of robust data solutions and microservices, developing and scaling data pipelines using Spark, aggregating and processing large volumes of data, consuming and producing data using event-driven systems, leading automation and streamlining of deployments using GitLab CI/CD on AWS Cloud, orchestrating data pipelines using Astronomer, and using Docker for containerization. Additionally, the engineer will lead the development and refinement of data models to maximize performance and meet business objectives.

Skills

Data Engineering

Software Architecture

Data Pipelines

Scala

Java

Python

Spark

NoSQL

Relational Databases

Microservices

APIs

Cloud Scalability

Software Design Principles

Code Quality

Security

Demandbase

Account-Based Marketing solutions for B2B enterprises

About Demandbase

Demandbase specializes in Account-Based Marketing (ABM) solutions for B2B enterprises. Their platform provides tools that help businesses identify, engage, and convert high-value accounts, focusing on specific clients rather than a broad audience. This is particularly useful for industries with long sales cycles, such as technology and finance. The ABM platform integrates data analytics, personalized advertising, and CRM systems, allowing businesses to tailor their marketing efforts effectively. Demandbase operates on a subscription model, offering customizable access to their platform along with training and consulting services. This approach not only generates revenue through subscriptions but also builds long-term client relationships, setting Demandbase apart from competitors in the marketing technology space.

San Francisco, CaliforniaHeadquarters

2005Year Founded

$153.7MTotal Funding

DEBTCompany Stage

Consulting, Enterprise SoftwareIndustries

501-1,000Employees