Senior Data Engineer
BiorenderSalary not specified
Full Time
Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Technology, Cloud Computing, Data AnalyticsIndustries
Requirements
- 5+ years of relevant software development industry experience building data-intensive software solutions
- Strong knowledge of Golang and experience with its ecosystem. Experience with Java is a plus
- Experience with distributed systems and microservices architecture
- The ability to design and build robust ETL data pipelines that can handle large volumes of data reliably and efficiently
- Understanding data replication methodologies like CDC
- Good knowledge of cloud-native architecture and practical experience with at least one major CSP
- Excellent communication skills and the ability to work well within a team and across engineering teams
- Strong problem solver with solid production debugging skills
- Capability to work independently, take initiative, and drive projects forward with a high level of autonomy
- Expertise in real-time data ingestion, change data capture (CDC), distributed systems, and cloud services
Responsibilities
- Develop and enhance integrations with various data sources including streaming platforms, databases, data lakes, and object stores
- Continuously improve our systems based on operational metrics, customer feedback, and evolving business requirements
- Drive technical discussions and contribute to architectural decisions that impact our platform's scalability and resilience
- Participate in on-call rotations to ensure system reliability and respond to production incidents
- Collaborate cross-functionally to build and maintain the ClickPipes platform
Skills
Key technologies and capabilities for this role
Questions & Answers
Common questions about this position
What is the compensation for this role?
This information is not specified in the job description.
Is this a remote position or is there a location requirement?
This information is not specified in the job description.
What skills are required for the Senior Backend Engineer role?
Required skills include 5+ years of software development experience in data-intensive solutions, strong knowledge of Golang, experience with distributed systems and microservices, designing robust ETL data pipelines, understanding of CDC, and cloud-native architecture with a major CSP.
What is the team culture like at ClickHouse for this role?
The team works on the ClickPipes Platform at petabyte scale in high-velocity environments, offering autonomy to solve challenging problems, collaborate cross-functionally, drive technical decisions, and participate in on-call rotations.
What makes a strong candidate for this position?
Strong candidates have 5+ years building data-intensive solutions, Golang expertise, distributed systems experience, ETL pipeline design skills, CDC knowledge, cloud experience, excellent communication, and solid problem-solving with production debugging skills.
Clickhouse
High-speed column-oriented database management system
About Clickhouse
ClickHouse provides a high-speed, column-oriented database management system designed for developers and businesses that manage large-scale data. Its primary product processes analytical queries quickly by storing data from the same columns together, making it significantly faster than traditional row-oriented databases, especially in Online Analytical Processing (OLAP) scenarios. ClickHouse stands out from competitors by offering a free, open-source database that can be deployed on local machines or in the cloud, along with a fully managed service on platforms like AWS, GCP, and Microsoft Azure. The company's goal is to deliver a cost-effective solution that simplifies data management for its clients, as evidenced by user feedback highlighting substantial cost savings.
San Francisco, CaliforniaHeadquarters
2021Year Founded
$291.8MTotal Funding
SERIES_BCompany Stage
Data & Analytics, Enterprise SoftwareIndustries
201-500Employees
Benefits
Health Insurance
Unlimited Paid Time Off
Flexible Work Hours
Remote Work Options
Stock Options
Home Office Stipend
Risks
Redpanda Serverless poses a competitive threat in real-time data processing.
Integration challenges with PeerDB may delay expected benefits.
Dependency on Supabase could pose operational risks.
Differentiation
ClickHouse's column-oriented design offers superior speed for analytical queries.
The open-source model allows flexible deployment across various environments.
Integration with Grafana enhances data visualization capabilities.
Upsides
Partnership with Alibaba Cloud boosts presence in the Chinese market.
Acquisition of PeerDB enhances real-time analytics capabilities.
Launch of ClickPipes improves data processing efficiency for real-time updates.
Related Jobs
RemoteRemoteBackend Engineer, Data Platform
LaunchDarklySalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSr. Software Engineer, Backend - Ingestion (Remote)
CrowdstrikeSalary not specified
- Full Time
- Senior (5 to 8 years)
RemotePrincipal Backend Engineer
1047 GamesSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteSenior Data Platform Engineer
Apollo.ioSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSenior Software Engineer - Integrations
ChartHop$140,000 - $200,000/year
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
RemoteSenior Software Developer, Streaming Platform
WealthsimpleSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSenior Data Engineer, Intent (Pipeline)
Demandbase$190,000 - $284,000/year
- Full Time
- Senior (5 to 8 years)