Senior Data Engineer at Spotify

New York, New York, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Technology, AdvertisingIndustries

Requirements

Proven experience working with distributed, high-volume production data pipelines and services, and heterogeneous data and tools such as BigQuery and BigTable
Strong programming skills in Java and/or Scala, with hands-on experience in frameworks like Scio
Commitment to agile software processes, data-driven development, reliability, and responsible experimentation
Hands-on experience with orchestration tools like Flyte and Styx
Excellent problem-solving and communication skills
Strong interest in, and ideally some experience with, either machine learning or backend development

Responsibilities

Design, develop and maintain robust, scalable batch and streaming pipelines using Scio, GCP (BigQuery, Dataflow, GCS), and our orchestration stack including Flyte and Styx
Build and optimize high-throughput, low-latency pipelines for projects such as Contextual Targeting, Custom Website (Pixel-based) Audiences, Artist Affinity audiences and more
Collaborate closely with Machine Learning and Staff engineers to design and build strategic products such as the ML-driven 1st party Audiences and the next generation of Lookalike Audiences
Take charge of the architecture and development of upcoming key projects such as Pre and Post Campaign Insights, and the creation of Audiences based on unique user data
Champion scalability, testability, maintainability, reliability and high-quality code, ensuring use of Spotify’s Golden Path technologies
Work in a T-shaped environment, collaborating with engineers, product managers, and other stakeholders, embracing learning and leadership opportunities daily
Lead on data architecture and design decisions when needed, while also being comfortable executing on plans, pair-programming and debugging with teammates

Skills

Scio

GCP

BigQuery

Dataflow

GCS

Flyte

Styx

Spotify

Digital music streaming service with podcasts

About Spotify

Spotify provides a digital music streaming service that allows users to access millions of songs and podcasts from various artists and creators. Users can choose between a free plan, which includes advertisements, and a premium subscription that offers an ad-free experience along with features like offline listening and higher sound quality. This tiered model caters to different user preferences and budgets. Spotify generates revenue through subscription fees from premium users and advertising from the free tier. Unlike its competitors, Spotify stands out with its extensive music library, user-friendly interface, and personalized playlists. The company's goal is to connect listeners with a wide range of audio content while supporting artists and advertisers.

Stockholms kommun, SwedenHeadquarters

2006Year Founded

$2,004.2MTotal Funding

IPOCompany Stage

Consumer Software, EntertainmentIndustries

10,001+Employees

Benefits

Extensive learning opportunities, through our dedicated team, GreenHouse

Global parental leave, six months off - fully paid - for all new parents

Flexible public holidays, swap days off according to your values and beliefs

Flexible share incentives letting you choose how you share in our success

All The Feels, our employee assistance program and self-care hub

Spotify On Tour, join your colleagues on trips to industry festivals and events

Risks

Accidental display of adult content may harm Spotify's reputation.

Creating its own music to avoid royalties could lead to legal issues.

Layoffs may affect Spotify's operational efficiency and employee morale.

Differentiation

Spotify offers a vast library of music and podcasts globally.

The platform's user-friendly interface enhances user experience and engagement.

Spotify's personalized playlists cater to individual user preferences.

Upsides

Spotify's AI-powered Wrapped feature enhances user engagement and personalization.

Expansion into political podcasting taps into new audience segments.

Growing podcast popularity in Africa presents expansion opportunities for Spotify.

Land your dream remote job 3x faster with AI

Try Jobo Free