Data Engineer - Platform Central Data at Spotify

Toronto, Ontario, Canada

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years)Experience Level

Full TimeJob Type

UnknownVisa

Technology, Music StreamingIndustries

Requirements

3+ years building production quality data solutions with complex domain logic, using strong SQL to answer questions and debug problems
Experience with a cloud data warehouse (e.g., BigQuery, Snowflake, Redshift, or Databricks SQL)
Experience with distributed processing frameworks (e.g., Apache Spark, Scio, Apache Beam, or Flink)
Comfortable with Python or Scala and one or more transformation frameworks (e.g., dbt or equivalent SQL-based transformations)
Experience with a workflow orchestrator (e.g., Airflow, Dagster, Prefect, or Flyte), with a focus on reliability, monitoring, and testability
Ability to communicate clearly with both technical and non-technical partners, prioritize, and deliver in a changing environment
Experience in platform and developer productivity, experimentation, or ML and AI platform metrics is a plus
Based in Toronto (with flexibility for remote work and some in-person meetings)

Responsibilities

Build and operate reliable, well-modeled data pipelines and products using SQL and Python or Scala, with strong testing, observability, and CI/CD; use Apache Spark, Scio, or equivalents like Apache Beam or Flink for distributed processing
Partner in a mixed DE and AE squad to translate complex platform and developer experience use cases into trustworthy datasets, metrics, and ML and AI insights workflows
Improve data quality, performance, and cost efficiency across existing pipelines, including troubleshooting, backfills, and iterative hardening
Collaborate with Product, Engineering, and Data Science partners to deliver end-to-end outcomes, from scoping and modeling to rollout and documentation
Contribute to agile rituals and take part in a fair support rotation for key pipelines and datasets

Skills

SQL

Python

Scala

Apache Spark

Scio

Apache Beam

Flink

BigQuery

Snowflake

Redshift

Databricks

dbt

CI/CD

Spotify

Digital music streaming service with podcasts

About Spotify

Spotify provides a digital music streaming service that allows users to access millions of songs and podcasts from various artists and creators. Users can choose between a free plan, which includes advertisements, and a premium subscription that offers an ad-free experience along with features like offline listening and higher sound quality. This tiered model caters to different user preferences and budgets. Spotify generates revenue through subscription fees from premium users and advertising from the free tier. Unlike its competitors, Spotify stands out with its extensive music library, user-friendly interface, and personalized playlists. The company's goal is to connect listeners with a wide range of audio content while supporting artists and advertisers.

Stockholms kommun, SwedenHeadquarters

2006Year Founded

$2,004.2MTotal Funding

IPOCompany Stage

Consumer Software, EntertainmentIndustries

10,001+Employees

Benefits

Extensive learning opportunities, through our dedicated team, GreenHouse

Global parental leave, six months off - fully paid - for all new parents

Flexible public holidays, swap days off according to your values and beliefs

Flexible share incentives letting you choose how you share in our success

All The Feels, our employee assistance program and self-care hub

Spotify On Tour, join your colleagues on trips to industry festivals and events

Risks

Accidental display of adult content may harm Spotify's reputation.

Creating its own music to avoid royalties could lead to legal issues.

Layoffs may affect Spotify's operational efficiency and employee morale.

Differentiation

Spotify offers a vast library of music and podcasts globally.

The platform's user-friendly interface enhances user experience and engagement.

Spotify's personalized playlists cater to individual user preferences.

Upsides

Spotify's AI-powered Wrapped feature enhances user engagement and personalization.

Expansion into political podcasting taps into new audience segments.

Growing podcast popularity in Africa presents expansion opportunities for Spotify.

Land your dream remote job 3x faster with AI

Try Jobo Free