Clickhouse

Senior Backend Engineer - Data Ingestion (ClickPipes)

United States

Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Database Systems, Cloud Computing, Big DataIndustries

About ClickHouse

Established in 2009, ClickHouse leads the industry with its open-source column-oriented database system, driven by the vision of becoming the fastest OLAP database globally. The company empowers users to generate real-time analytical reports through SQL queries, emphasizing speed in managing escalating data volumes. Enterprises globally, including Lyft, Sony, IBM, GitLab, Twilio, HubSpot, and many more, rely on ClickHouse Cloud. It is available through open-source or on AWS, GCP, Azure, and Alibaba.

About the Team

The ClickPipes Platform plays a critical role in driving the growth of our company and ensuring the success of our clients by seamlessly onboarding and integrating data from diverse data sources into ClickHouse. Working at a petabyte scale and in high-velocity environments, this role offers an exceptional opportunity to solve challenging technical problems, operate with significant autonomy, and make a measurable impact.

We are looking for exceptional backend engineers who can work across a variety of technologies, with expertise in real-time data ingestion, change data capture (CDC), distributed systems, and cloud services. As a member of this team, you'll collaborate cross-functionally to build and maintain. This role is ideal for individuals who are capable of working independently, taking initiative, and driving projects forward with a high level of autonomy.

What will you do?

  • Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores.
  • Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements.
  • Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience.
  • Participate in on-call rotations to ensure system reliability and respond to production incidents.

About you:

  • 5+ years of relevant software development industry experience building data-intensive software solutions.
  • Strong knowledge of Golang and experience with its ecosystem. Experience with Java is a plus.
  • Experience with distributed systems and microservices architecture.
  • The ability to design and build robust ETL data pipelines that can handle large volumes of data reliably and efficiently.
  • Understanding data replication methodologies like CDC.
  • Good knowledge of cloud-native architecture and practical experience with at least one major CSP.
  • You have excellent communication skills and the ability to work well within a team and across engineering teams.
  • You are a strong problem solver and have solid production debugging skills.

Compensation

  • New York Area / San Francisco Area Salary Range: $157,000 - $232,000 USD
  • General US Remote Salary Range: $133,450 - $197,200 USD
  • Los Angeles, CA / Washington, DC Salary Range: $141,300 - $208,800 USD

For roles based in the United States, you can find above our typical starting salary ranges for this role, depending on your specific location. The positioning of offers within a certain range depends on various factors, including: candidate experience, qualifications, skills, business requirements and geographical location. If you have any questions or comments about compensation as a candidate, please get in touch with us at paytransparency@clickhouse.com.

Perks

  • Flexible work environment: ClickHouse is a globally distributed company and remote-friendly. We currently operate in 20 countries.
  • Healthcare: Employer contributions towards your healthcare.
  • Equity in the company: Every new team member who joins our company receives stock options.
  • Time off: Flexible time off in the US, generous entitlement in other countries.
  • Home office setup: A $500 Home office setup if you’re a remote employee.
  • Global Gatherings: We believe in the power of in-person connection.

Skills

Backend Engineering
Data Ingestion
Change Data Capture (CDC)
Distributed Systems
Cloud Services
SQL
Real-time data processing
Scalability
Resilience

Clickhouse

High-speed column-oriented database management system

About Clickhouse

ClickHouse provides a high-speed, column-oriented database management system designed for developers and businesses that manage large-scale data. Its primary product processes analytical queries quickly by storing data from the same columns together, making it significantly faster than traditional row-oriented databases, especially in Online Analytical Processing (OLAP) scenarios. ClickHouse stands out from competitors by offering a free, open-source database that can be deployed on local machines or in the cloud, along with a fully managed service on platforms like AWS, GCP, and Microsoft Azure. The company's goal is to deliver a cost-effective solution that simplifies data management for its clients, as evidenced by user feedback highlighting substantial cost savings.

San Francisco, CaliforniaHeadquarters
2021Year Founded
$291.8MTotal Funding
SERIES_BCompany Stage
Data & Analytics, Enterprise SoftwareIndustries
201-500Employees

Benefits

Health Insurance
Unlimited Paid Time Off
Flexible Work Hours
Remote Work Options
Stock Options
Home Office Stipend

Risks

Redpanda Serverless poses a competitive threat in real-time data processing.
Integration challenges with PeerDB may delay expected benefits.
Dependency on Supabase could pose operational risks.

Differentiation

ClickHouse's column-oriented design offers superior speed for analytical queries.
The open-source model allows flexible deployment across various environments.
Integration with Grafana enhances data visualization capabilities.

Upsides

Partnership with Alibaba Cloud boosts presence in the Chinese market.
Acquisition of PeerDB enhances real-time analytics capabilities.
Launch of ClickPipes improves data processing efficiency for real-time updates.

Land your dream remote job 3x faster with AI