Senior Data Engineer at The Walt Disney Company

Santa Monica, California, United States

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Entertainment, Media, Sports, TechnologyIndustries

5+ years of data engineering experience in software engineering in the data space
Strong algorithmic problem-solving expertise
Strong fundamental Scala and Python software programming skills
Good understanding of AWS or other cloud provider resources (S3)
Strong SQL skills and ability to creatively problem solve and dive deep into our data and software ecosystem
Hands-on production environment experience with distributed processing systems such as Apache Spark
Hands-on production experience with workflow orchestration systems such as Airflow for creating and maintaining data pipelines
Scripting language experience

Be a key player in a cross-functional team of engineers who build software for a large-scale data processing ecosystem, supporting real-time and batch data pipelines for analytics, data science, and operations
Maintain data engineering and architecture best practices and standards within the team and wider organization, along with a culture of quality, innovation, and experimentation
Evangelize and evolve the platform, best-practices, data driven decisions; identify new use cases and features and drive adoption
Build out a robust observability, alerting, logging, and system control plane that allows easy diagnosis of any issues across all our data pipelines
Contribute to maintaining, updating, and expanding existing software deployments while maintaining strict uptime SLAs
Maintain detailed documentation of your work and changes to support data quality and data governance requirements
Be an active participant and advocate of agile/scrum ceremonies to collaborate and improve processes for our team
Collaborate with product managers, architects, and other engineers to drive the success of the Foundational Platform