Sr. Data Engineer- Chicago, IL or Reston, VA- ONSITE 4 X Week at Comcast

Chicago, Illinois, United States

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Advertising, Media, TechnologyIndustries

Bachelor’s or Master’s degree in Computer Science & Engineering, or a related field
2+ years of experience in building and operating large-scale data processing systems
Strong programming skills in SQL and either Python or Scala
Extensive experience in Apache Spark and processing large-scale datasets
Hands-on experience with DBT, Databricks, Snowflake, ClickHouse, and other modern data platforms
Solid understanding of data lake architectures and open table formats (Delta Lake, Iceberg)
Experience in monitoring and observability for data pipelines, implementing data catalogs and lineage tracking solutions
Ability to quickly adapt and context switch among different priorities, working efficiently in a fast-paced environment
Strong generalist mindset with the ability to work across different technology stacks and polyglot programming skills, demonstrating fluency in multiple programming languages beyond primary expertise
Ability to understand, create or manage different data lake & data warehouse modeling paradigms

Architect, design, and develop high-performance, scalable data pipelines
Develop large scale and complex Big Data ETL using modern frameworks such as DBT and Databricks Delta Live Tables (DLT)
Define and implement data lake architectures and open table formats (e.g., Delta Lake, Iceberg)
Establish and enforce best practices for data engineering, ensuring data quality, integrity, and performance
Drive observability and monitoring for data pipelines, implementing data catalogs and lineage tracking
Ability to own critical modules for complex and large-scale Batch ETL models and ability to articulate models to Product, Engineering and Leadership
Effectively context switch between multiple priorities, balancing long-term architectural goals with immediate business needs
Develop complex Semantic layers and help create customer facing self-service analytics
Consistent exercise of independent judgment and discretion in matters of significance
Regular, consistent and punctual attendance. Must be able to work nights and weekends, variable schedule(s) as necessary
Other duties and responsibilities as assigned