Senior Backend Engineer - Data Ingestion (ClickPipes)

Canada

Apply with AI Apply

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Database Systems, Cloud Computing, Big DataIndustries

Requirements

Candidates should have 5+ years of software development experience, specifically in building data-intensive solutions. Strong proficiency in Golang and experience with distributed systems and microservices architecture are required. Experience with Java, understanding of CDC methodologies, knowledge of cloud-native architecture, and experience with a major cloud provider are also necessary. Excellent problem-solving, debugging, and communication skills are essential.

Responsibilities

The Senior Backend Engineer will develop and enhance integrations with various data sources, including streaming platforms, databases, data lakes, and object stores. They will continuously improve systems based on operational metrics and customer feedback, drive technical discussions, and contribute to architectural decisions for scalability and resilience. Participation in on-call rotations to ensure system reliability is also expected.

Skills

Backend Engineering

Data Ingestion

Change Data Capture (CDC)

Distributed Systems

Cloud Services

SQL

Real-time data processing

Scalability

Resilience

Clickhouse

High-speed column-oriented database management system

About Clickhouse

ClickHouse provides a high-speed, column-oriented database management system designed for developers and businesses that manage large-scale data. Its primary product processes analytical queries quickly by storing data from the same columns together, making it significantly faster than traditional row-oriented databases, especially in Online Analytical Processing (OLAP) scenarios. ClickHouse stands out from competitors by offering a free, open-source database that can be deployed on local machines or in the cloud, along with a fully managed service on platforms like AWS, GCP, and Microsoft Azure. The company's goal is to deliver a cost-effective solution that simplifies data management for its clients, as evidenced by user feedback highlighting substantial cost savings.

San Francisco, CaliforniaHeadquarters

2021Year Founded

$291.8MTotal Funding

SERIES_BCompany Stage

Data & Analytics, Enterprise SoftwareIndustries

201-500Employees

Senior Backend Engineer - Data Ingestion (ClickPipes)

Requirements

Responsibilities

Skills

Clickhouse

About Clickhouse

Benefits

Health Insurance

Unlimited Paid Time Off

Flexible Work Hours

Remote Work Options

Stock Options

Home Office Stipend

Risks

Redpanda Serverless poses a competitive threat in real-time data processing.

Integration challenges with PeerDB may delay expected benefits.

Dependency on Supabase could pose operational risks.

Differentiation

ClickHouse's column-oriented design offers superior speed for analytical queries.

The open-source model allows flexible deployment across various environments.

Integration with Grafana enhances data visualization capabilities.

Upsides

Partnership with Alibaba Cloud boosts presence in the Chinese market.

Acquisition of PeerDB enhances real-time analytics capabilities.

Launch of ClickPipes improves data processing efficiency for real-time updates.

Senior Software Engineer, Backend (Platform)

Sr. Software Engineer, Backend - Ingestion (Remote)

Senior Software Engineer, Distributed Systems

Backend Software Engineer – Client Group

Data Engineer / Senior Data Engineer

Senior Software Engineer - Integrations

Principal Software Engineer, Data Platforms

Senior Software Engineer, Data Pipeline

Staff Software Engineer, Pay by Wallet

Senior Backend Engineer - Real-time data processing