Sr. Data Engineer

United States

Apply with AI Apply

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Automotive, Biotechnology, E-commerceIndustries

Requirements

Candidates should have at least 5 years of experience in data engineering, designing and developing complex, real-time enterprise-scale applications using Python and/or Scala. A minimum of 5 years of hands-on experience with Big Data tools and platforms such as Spark Streaming, EMR, and Kafka is required, along with 5 years of professional experience with AWS Cloud. Proficiency in at least one programming language commonly used in data engineering (Python, Scala, or Java), experience with data modeling, warehousing, and building ETL pipelines, and familiarity with query languages like SQL or SparkSQL are essential. Solid understanding of Spark, various file formats, compression techniques, ETL schedulers (e.g., Airflow), source code management systems (e.g., Github), and CI/CD pipelines (e.g., Jenkins) are also necessary. Excellent communication and collaboration skills, with the ability to design, develop, and debug across projects, are required.

Responsibilities

The Sr. Data Engineer will design and build robust data pipelines, deriving insights from data using advanced analytic techniques, streaming, and machine learning at scale. They will work within a dynamic team to design, develop, and maintain mission-critical Big Data applications, build, deploy, and support data pipelines into production, and partner closely with other engineering teams, including Data Science, and cross-functional teams like Product Management and Product Design. The role involves partnering with stakeholders for requirements and prioritization, and offers opportunities to mentor others and share knowledge across the organization.

Skills

Data Engineering

Scalability

Collaboration

Analytical Skills

Innovation

Cars Commerce

Online marketplace for buying and selling cars

About Cars Commerce

Cars Commerce operates as a digital marketplace in the automotive industry, connecting consumers who want to buy or sell cars with automotive businesses like dealerships and manufacturers. The platform provides consumers with essential information about vehicles, including product details, pricing, and seller locations, helping them make informed purchasing decisions. For automotive businesses, Cars Commerce offers insights and data on market trends and consumer behavior, which can enhance their sales strategies. The company generates revenue through advertising and subscription fees from these businesses for services like listings and access to consumer analytics. By utilizing technology and data, Cars Commerce aims to improve the efficiency and effectiveness of the car buying and selling process for both consumers and businesses.

Chicago, IllinoisHeadquarters

1998Year Founded

IPOCompany Stage

Data & Analytics, Automotive & TransportationIndustries

1,001-5,000Employees