Confluent

Senior Data Engineer - Team Lead

United Kingdom

Not SpecifiedCompensation
Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Data Streaming, BiotechnologyIndustries

Job Description

Employment Type: Full-Time Location Type: Remote

Company Overview

We’re not just building better tech. We’re rewriting how data moves and what the world can do with it. With Confluent, data doesn’t sit still. Our platform puts information in motion, streaming in near real-time so companies can react faster, build smarter, and deliver experiences as dynamic as the world around them.

It takes a certain kind of person to join this team. Those who ask hard questions, give honest feedback, and show up for each other. No egos, no solo acts. Just smart, curious humans pushing toward something bigger, together.

One Confluent. One Team. One Data Streaming Platform.

About the Role

The mission of the Data Science/Data Engineering team at Confluent is to serve as the central nervous system of all things data for the company: we build data and analytics infrastructure, insights, models and tools, to empower data-driven thinking, and optimize every part of the business. This position offers limitless opportunities for an ambitious data engineering leader to make an immediate and meaningful impact within a hyper-growth start-up, and contribute to a highly engaged open source community.

This is a partnership-heavy role. As a Team Lead within the Data organization, you will enable various functions of the company, i.e. Product, Engineering, Field Operations, Go-to-Market, etc., to be data-driven while providing leadership and direction to your team. As a Data Engineer, you will take on big data challenges in an agile way. You will participate and guide your team in building data pipelines that enable data scientists, analytics partners, operation teams, and executives to make data accessible to the entire company. You will also build data models to deliver insightful analytics while ensuring the highest standard in data integrity. You are encouraged to think out of the box and play with the latest technologies while exploring their limits. Successful candidates will have strong technical capabilities, leadership experience, a can-do attitude, and are highly collaborative.

What You Will Do

  • Lead a team of data engineers, providing technical guidance, mentorship, and career development.
  • Partner with stakeholders across the organization to understand business needs, prioritize features, and develop strategic data solutions.
  • Break down complex projects into manageable tasks and assign them to team members based on their strengths and development goals.
  • Design, build and launch extremely efficient and reliable data pipelines to move data across many platforms including Data Warehouse and real-time systems.
  • Develop strong subject matter expertise and manage the SLAs for those data pipelines.
  • Set up and improve BI tooling and platforms to help the team create dynamic tools and reporting.
  • Partner with Data Scientists and business partners to develop internal data products to improve operational efficiencies organizationally.
  • Foster a culture of innovation, collaboration, and technical excellence within your team.
  • Represent the data engineering team in cross-functional meetings and advocate for technical best practices.

Examples of Our Work:

  • Data Pipelines: Create new pipelines or rewrite existing pipelines using SQL, Python on Airflow & DBT.
  • Data Quality and Anomaly Detection: Improve existing tools to detect anomalies in real-time and through offline metrics.
  • Data Modeling: Partner with analytic consumers to improve existing datasets and build new ones.
  • Technical Leadership: Guide the team towards maintaining a high technical bar while collaborating with stakeholders to deliver overall impact.

What You Will Bring

  • 6+ years of experience in a Data Engineering role, with a focus on data warehouse technologies, data pipelines, and BI tooling.
  • 1-3 years of team leadership, management, or equivalent project leadership experience (formal management preferred, but will consider dotted line management or technical leadership roles).
  • Bachelor or advanced degree in Computer Science or a related field.

Skills

Data Engineering
Data Pipelines
Data Modeling
Big Data
Agile
Leadership
Analytics
Data Science

Confluent

Data streaming solutions for real-time processing

About Confluent

Confluent specializes in data streaming solutions, focusing on helping businesses manage and process real-time data streams. Its main product is built on Apache Kafka, an open-source platform that allows users to create real-time data pipelines and streaming applications. Clients, including large enterprises and financial institutions, utilize Confluent's tools to collect, process, and analyze data streams, which helps them make quicker and more informed decisions. Unlike many competitors, Confluent offers a subscription-based model for its cloud platform, Confluent Cloud, and its on-premises software, Confluent Platform, ensuring a steady revenue stream. The company also provides professional services like training and consulting to assist clients in optimizing their data streaming solutions. Confluent's goal is to be a leader in the data streaming market, enabling organizations to leverage real-time data for improved operational efficiency.

Mountain View, CaliforniaHeadquarters
2014Year Founded
$443.5MTotal Funding
IPOCompany Stage
Data & Analytics, Enterprise SoftwareIndustries
1,001-5,000Employees

Benefits

Best Teammates on Planet Earth - Loving your job has a lot to do with the people around you. Luckily at Confluent, you will find some of the most genuine people who make you excited to come to work each day.
Adjustable Working Arrangements - While most of our employees work typical business hours, we encourage everyone to partner with their manager to make a schedule that works best for them and Confluent.
Robust Benefits - Health and wellness is important and Confluent is proud to offer a total benefits program that ranks in the top percentile of companies similar in size to our industry in our established geographies.
Rest and Recharge Days - Personal time off is great but it is even better when your whole team has the day. Each quarter, teams have three recharge days where the entire team logs off and refreshes before coming back to work.
Weekly Lunch Spend - At Confluent, we have a weekly lunch program called “No Pay Thursday.” On Thursdays, lunch is provided by Confluent at local restaurants and grocery stores, taxes may apply for some countries.
Flexible Paid Time Off (PTO) - Confluent employees work really hard to meet the needs of our growing and scaling business. To make sure that we don’t burn out, we encourage everyone to balance their PTO in an adequate way.

Risks

CTO Chad Verbowski's retirement may lead to a temporary leadership vacuum.
WarpStream acquisition may present integration challenges, disrupting operations.
Participation in MongoDB AI Program exposes Confluent to competitive pressures.

Differentiation

Confluent's platform is based on Apache Kafka, a leading open-source data streaming technology.
The company offers a subscription-based model, ensuring steady recurring revenue streams.
Confluent's solutions cater to diverse industries, enhancing real-time data processing capabilities.

Upsides

Increased adoption of Apache Flink complements Confluent's existing Apache Kafka-based solutions.
Integration with MongoDB's AI Applications Program enhances AI-driven data processing capabilities.
The OEM Program launch can drive new partnerships and expand market presence.

Land your dream remote job 3x faster with AI