Clickhouse

Senior Cloud Data Infrastructure Engineer

Canada

Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Database Systems, Cloud Computing, Big Data, Open Source SoftwareIndustries

Requirements

Candidates should have over 5 years of relevant software development industry experience building and operating scalable, fault-tolerant, distributed systems. They must have experience building operators with Kubernetes and controller runtime, production experience with programming languages like Go or C++, and expertise with a public cloud provider (AWS, GCP, Azure) and their infrastructure as a service offerings. Experience with Data Storage, Ingestion, and Transformation tools such as Spark or Kafka is also required, along with strong problem-solving skills and comfort with PagerDuty on-call and production debugging. Excellent communication skills and the ability to work well within and across engineering teams are essential.

Responsibilities

The Cloud AutoScaling Engineer will build a cutting-edge Cloud Native platform on top of the public cloud, improve the metrics pipeline, and develop algorithms for better autoscaling statistics and recommendations. They will work on the autoscale and Kubernetes operator to support seamless vertical and horizontal auto-scaling, collaborating closely with the ClickHouse core development team and other data plane teams. This role involves architecting and building a robust, scalable, and highly available distributed infrastructure, and engaging with other cloud teams to drive continuous improvements in cloud infrastructure for enhanced performance and scalability.

Skills

Cloud Native platform development
Metrics pipeline improvement
Autoscaling algorithms
Kubernetes operator
Distributed infrastructure architecture
Scalable system design
Fault-tolerant system design
Software development
Cloud infrastructure
Performance optimization
Scalability

Clickhouse

High-speed column-oriented database management system

About Clickhouse

ClickHouse provides a high-speed, column-oriented database management system designed for developers and businesses that manage large-scale data. Its primary product processes analytical queries quickly by storing data from the same columns together, making it significantly faster than traditional row-oriented databases, especially in Online Analytical Processing (OLAP) scenarios. ClickHouse stands out from competitors by offering a free, open-source database that can be deployed on local machines or in the cloud, along with a fully managed service on platforms like AWS, GCP, and Microsoft Azure. The company's goal is to deliver a cost-effective solution that simplifies data management for its clients, as evidenced by user feedback highlighting substantial cost savings.

San Francisco, CaliforniaHeadquarters
2021Year Founded
$291.8MTotal Funding
SERIES_BCompany Stage
Data & Analytics, Enterprise SoftwareIndustries
201-500Employees

Benefits

Health Insurance
Unlimited Paid Time Off
Flexible Work Hours
Remote Work Options
Stock Options
Home Office Stipend

Risks

Redpanda Serverless poses a competitive threat in real-time data processing.
Integration challenges with PeerDB may delay expected benefits.
Dependency on Supabase could pose operational risks.

Differentiation

ClickHouse's column-oriented design offers superior speed for analytical queries.
The open-source model allows flexible deployment across various environments.
Integration with Grafana enhances data visualization capabilities.

Upsides

Partnership with Alibaba Cloud boosts presence in the Chinese market.
Acquisition of PeerDB enhances real-time analytics capabilities.
Launch of ClickPipes improves data processing efficiency for real-time updates.

Land your dream remote job 3x faster with AI