Senior Data Engineer
DemandbaseSalary not specified
- Full Time
- Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Advertising & Marketing, Data & AnalyticsIndustries
Requirements
Candidates must possess a Bachelor’s degree in Engineering, Computer Science, or a related discipline, along with a minimum of 5 years of strong hands-on development experience utilizing Python. They should have experience with big data and streaming technologies such as Apache Spark, Apache Kafka, and Data Warehouses, alongside familiarity with Cloud Analytics platforms like Databricks or Snowflake. Experience with relational SQL and NoSQL databases, public cloud platforms (AWS/GCP/Azure), Linux environments, and shell scripting is also required, as well as the ability to collaborate effectively with multiple teams and understand testing and deployment methodologies.
Responsibilities
The Senior Data Engineer will be responsible for developing and maintaining ad-tech related data systems and system components using Python, including data streaming, processing, and aggregation solutions, data-driven applications, and ETL/ELT pipelines. They will also work on 24/7 low latency large-scale distributed systems, cloud migration and containerization projects, and external integrations for data exchange. Furthermore, the role involves collaborating with the team on technical implementation of Data Engineering projects, building data pipelines on cloud-based platforms, working closely with QA, DevOps, and other engineering teams on integration, testing, and release of system components, and translating business requirements into technical solutions in conjunction with business stakeholders and other engineers.
Skills
Python
Big data
Streaming technologies
Apache Spark
Apache Kafka
Databricks
Snowflake
Data streaming
Processing pipelines
Aggregation pipelines
Distributed systems
Cloud migration
Containerization
External Data Integrations
adMarketplace
Optimizes search media for advertisers and publishers
About adMarketplace
adMarketplace specializes in search media solutions within the advertising technology sector. The company connects consumers directly with brands, bypassing traditional search engine results pages to create a more relevant search experience. It serves two main client types: advertisers, which include large brands and agencies seeking to maximize their media investments, and publishers, which are platforms that host advertisements. adMarketplace provides exclusive media placements that reach users at critical moments of intent, enhancing the effectiveness of advertising campaigns. The company operates on a performance-based model, earning revenue through cost-per-click (CPC) or cost-per-action (CPA) methods, where advertisers pay based on the effectiveness of their ads. The goal of adMarketplace is to optimize the consumer journey and improve the efficiency of advertising for both brands and publishers.
New York City, New YorkHeadquarters
2000Year Founded
LATE_VCCompany Stage
Data & Analytics, Consumer Goods, EntertainmentIndustries
51-200Employees