Clickhouse

Senior Cloud Data Infrastructure Engineer

Netherlands

Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Database, Cloud Infrastructure, Data TechnologiesIndustries

Position Overview

  • Location Type: Remote
  • Employment Type: Full-time
  • Salary: Ranges vary based on location and experience (see application instructions for details)

ClickHouse is seeking talented Software Engineers to join the Cloud AutoScaling team. This team is dedicated to implementing robust vertical and horizontal auto-scaling capabilities within the ClickHouse cloud environment, ultimately transforming ClickHouse into a fully functional serverless database solution. The team collaborates closely with the core database team and other data plane teams to drive continuous improvements in cloud infrastructure and scalability.

Requirements

  • Experience: 5+ years of relevant software development industry experience building and operating scalable, fault-tolerant, distributed systems.
  • Kubernetes & Operators: Experience building operators with Kubernetes and a controller runtime.
  • Programming Languages: Production experience with programming languages like Go, C++.
  • On-Call & Troubleshooting: Familiarity with PagerDuty on-call, debugging issues in production, and strong problem-solving skills.
  • Cloud Expertise: Expertise with a public cloud provider (AWS, GCP, Azure) and their infrastructure as a service offering (e.g., EC2).
  • Data Technologies: Experience with Data Storage, Ingestion, and Transformation (Spark, Kafka, or similar tools).
  • Passion for Scale: A passion for solving data problems at scale.
  • Bonus Skills: Experience with Python (uv, rye, FastAPI), Data Science (Pandas, NumPy, etc.).
  • Communication: Excellent communication skills and the ability to work effectively within and across engineering teams.

Responsibilities

  • Build a cutting-edge Cloud Native platform on top of the public cloud.
  • Improve the metrics pipeline and build algorithms to generate better autoscaling statistics and recommendations.
  • Work on the autoscale and Kubernetes operator to support seamless Vertical and Horizontal Auto-scaling.
  • Work closely with the ClickHouse core development team and other data plane teams, partnering with them to support auto-scaling use cases and other internal infrastructure improvements.
  • Architecting and building a robust, scalable, and highly available distributed infrastructure.

Application Instructions

  • Please refer to the company website for specific application instructions and to find details regarding compensation ranges.

Company Information

About ClickHouse:

Established in 2009, ClickHouse leads the industry with its open-source column-oriented database system, driven by the vision of becoming the fastest OLAP database globally. The company empowers users to generate real-time analytical reports through SQL queries, emphasizing speed in managing escalating data volumes. Enterprises globally, including Lyft, Sony, IBM, GitLab, Twilio, HubSpot, and many more, rely on ClickHouse Cloud. It is available through open-source or on AWS, GCP, Azure, and Alibaba.

The Cloud AutoScaling team is dedicated to implementing robust vertical and horizontal auto-scaling capabilities within the ClickHouse cloud environment. We seek exceptional software engineers to develop and maintain the auto-scaling infrastructure to transform ClickHouse into a fully functional serverless database solution. Collaborating closely with the core database team, we are actively working on evolving ClickHouse into a cloud-native database system. Additionally, we engage with other cloud teams to drive continuous improvements in cloud infrastructure for enhanced performance and scalability.

Skills

Kubernetes
Operators
Go
C++
AWS
GCP
Azure
EC2
Spark
Kafka
Python
FastAPI
Pandas
NumPy
Troubleshooting
On-Call
Distributed Systems
Fault Tolerance
Scalability
Data Storage
Data Ingestion
Data Transformation

Clickhouse

High-speed column-oriented database management system

About Clickhouse

ClickHouse provides a high-speed, column-oriented database management system designed for developers and businesses that manage large-scale data. Its primary product processes analytical queries quickly by storing data from the same columns together, making it significantly faster than traditional row-oriented databases, especially in Online Analytical Processing (OLAP) scenarios. ClickHouse stands out from competitors by offering a free, open-source database that can be deployed on local machines or in the cloud, along with a fully managed service on platforms like AWS, GCP, and Microsoft Azure. The company's goal is to deliver a cost-effective solution that simplifies data management for its clients, as evidenced by user feedback highlighting substantial cost savings.

San Francisco, CaliforniaHeadquarters
2021Year Founded
$291.8MTotal Funding
SERIES_BCompany Stage
Data & Analytics, Enterprise SoftwareIndustries
201-500Employees

Benefits

Health Insurance
Unlimited Paid Time Off
Flexible Work Hours
Remote Work Options
Stock Options
Home Office Stipend

Risks

Redpanda Serverless poses a competitive threat in real-time data processing.
Integration challenges with PeerDB may delay expected benefits.
Dependency on Supabase could pose operational risks.

Differentiation

ClickHouse's column-oriented design offers superior speed for analytical queries.
The open-source model allows flexible deployment across various environments.
Integration with Grafana enhances data visualization capabilities.

Upsides

Partnership with Alibaba Cloud boosts presence in the Chinese market.
Acquisition of PeerDB enhances real-time analytics capabilities.
Launch of ClickPipes improves data processing efficiency for real-time updates.

Land your dream remote job 3x faster with AI