Principal Engineer- Data Platform & AI (USA)
PointClickCareSalary not specified
Full Time
Expert & Leadership (9+ years)
Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Database Systems, Cloud Computing, Big DataIndustries
Requirements
Candidates should have over 5 years of software development experience building and operating scalable, fault-tolerant, distributed systems. They must have experience building operators with Kubernetes and controller runtime, and production experience with Go or C++. Expertise with a public cloud provider (AWS, GCP, Azure) and their IaaS offerings, as well as experience with Data Storage, Ingestion, and Transformation tools like Spark or Kafka, are required. Strong problem-solving skills, comfort with PagerDuty on-call, and excellent communication skills are also necessary. Python and Data Science experience are considered a plus.
Responsibilities
The engineer will build a cutting-edge cloud-native platform on public cloud infrastructure. They will improve the metrics pipeline and develop algorithms for better autoscaling statistics and recommendations. Responsibilities include working on the autoscale and Kubernetes operator for seamless vertical and horizontal autoscaling, and collaborating with core development and data plane teams to support autoscaling use cases and internal infrastructure improvements. Architecting and building robust, scalable, and highly available distributed infrastructure is also a key duty.
Skills
Cloud Native platform development
Metrics pipeline improvement
Autoscaling algorithms
Kubernetes operator
Distributed infrastructure architecture
Scalable system design
Fault-tolerant system design
Software development
Cloud infrastructure
Clickhouse
High-speed column-oriented database management system
About Clickhouse
ClickHouse provides a high-speed, column-oriented database management system designed for developers and businesses that manage large-scale data. Its primary product processes analytical queries quickly by storing data from the same columns together, making it significantly faster than traditional row-oriented databases, especially in Online Analytical Processing (OLAP) scenarios. ClickHouse stands out from competitors by offering a free, open-source database that can be deployed on local machines or in the cloud, along with a fully managed service on platforms like AWS, GCP, and Microsoft Azure. The company's goal is to deliver a cost-effective solution that simplifies data management for its clients, as evidenced by user feedback highlighting substantial cost savings.
San Francisco, CaliforniaHeadquarters
2021Year Founded
$291.8MTotal Funding
SERIES_BCompany Stage
Data & Analytics, Enterprise SoftwareIndustries
201-500Employees
Benefits
Health Insurance
Unlimited Paid Time Off
Flexible Work Hours
Remote Work Options
Stock Options
Home Office Stipend
Risks
Redpanda Serverless poses a competitive threat in real-time data processing.
Integration challenges with PeerDB may delay expected benefits.
Dependency on Supabase could pose operational risks.
Differentiation
ClickHouse's column-oriented design offers superior speed for analytical queries.
The open-source model allows flexible deployment across various environments.
Integration with Grafana enhances data visualization capabilities.
Upsides
Partnership with Alibaba Cloud boosts presence in the Chinese market.
Acquisition of PeerDB enhances real-time analytics capabilities.
Launch of ClickPipes improves data processing efficiency for real-time updates.
Related Jobs
RemoteRemoteSr. Cloud Infrastructure Engineer
Serve Robotics$150,000 - $200,000/year
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
RemoteSr. Software Engineer, Backend - Ingestion (Remote)
CrowdstrikeSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSenior Software Engineer, Distributed Systems
Mysten Labs$150,000 - $225,000/year
- Full Time
- Senior (5 to 8 years)
RemotePlatform Engineer: Kubernetes
SupabaseSalary not specified
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
RemoteData Center Infrastructure Architect
VultrSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteSenior Data Engineer, Data Lakehouse Infrastructure
TRM LabsSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSr. Engineer, Cloud - Ontology and Events (Remote)
CrowdstrikeSalary not specified
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteSenior Software Engineer
Aim4HireSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSr. Data/Cloud Engineer
AbbottSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteSenior Software Engineer, Data Pipeline
Flock Safety$171,000 - $190,000/year
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteCloud Storage Engineer
EffectualSalary not specified
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteSr. Data Engineer II
TrueMLSalary not specified
- Full Time
- Senior (5 to 8 years)