Senior Data Engineer - (Remote)
KUBRASalary not specified
Full Time
Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Database, Analytics, SoftwareIndustries
Requirements
Candidates must possess strong proficiency in Python and familiarity with data science libraries and data processing frameworks such as Pandas, Polars, Scikit-learn, and PyTorch. Experience working with databases, query engines, or analytical tools like Snowflake, BigQuery, ClickHouse, or DuckDB is required. A solid understanding of distributed systems and OLAP databases, along with hands-on experience in data engineering workflows and integrating databases with machine learning or analytics pipelines, is essential. Contributions to open-source projects or experience in an open-source development environment, strong problem-solving skills, the ability to work in a cross-functional team, and excellent communication skills are also necessary.
Responsibilities
The Senior Python Engineer will improve ClickHouse's Python ecosystem and the experience for data scientists and machine learning teams. Responsibilities include designing and implementing features to simplify data ingestion, transformation, and analysis for Python users, enhancing existing Python integrations for a seamless data science experience, and contributing to ClickHouse's open-source repositories. The role also involves ensuring efficient query execution and data handling when interfacing with Python, collaborating with internal and external teams to gather feedback and refine features, and educating users on best practices for leveraging ClickHouse in data science applications.
Skills
Python
Data Science
Machine Learning
SQL
Data Ingestion
Data Transformation
Data Analysis
Performance Optimization
Open-Source
Clickhouse
High-speed column-oriented database management system
About Clickhouse
ClickHouse provides a high-speed, column-oriented database management system designed for developers and businesses that manage large-scale data. Its primary product processes analytical queries quickly by storing data from the same columns together, making it significantly faster than traditional row-oriented databases, especially in Online Analytical Processing (OLAP) scenarios. ClickHouse stands out from competitors by offering a free, open-source database that can be deployed on local machines or in the cloud, along with a fully managed service on platforms like AWS, GCP, and Microsoft Azure. The company's goal is to deliver a cost-effective solution that simplifies data management for its clients, as evidenced by user feedback highlighting substantial cost savings.
San Francisco, CaliforniaHeadquarters
2021Year Founded
$291.8MTotal Funding
SERIES_BCompany Stage
Data & Analytics, Enterprise SoftwareIndustries
201-500Employees
Benefits
Health Insurance
Unlimited Paid Time Off
Flexible Work Hours
Remote Work Options
Stock Options
Home Office Stipend
Risks
Redpanda Serverless poses a competitive threat in real-time data processing.
Integration challenges with PeerDB may delay expected benefits.
Dependency on Supabase could pose operational risks.
Differentiation
ClickHouse's column-oriented design offers superior speed for analytical queries.
The open-source model allows flexible deployment across various environments.
Integration with Grafana enhances data visualization capabilities.
Upsides
Partnership with Alibaba Cloud boosts presence in the Chinese market.
Acquisition of PeerDB enhances real-time analytics capabilities.
Launch of ClickPipes improves data processing efficiency for real-time updates.
Related Jobs
RemoteRemoteMachine Learning Engineer
SweedSalary not specified
- Full Time
- Mid-level (3 to 4 years)
RemoteSenior Software Engineer, Forecast Engineering
The Voleon Group$225,000 - $255,000/year
- Full Time
- Senior (5 to 8 years)
RemotePlatform Analytics Engineer
Twin HealthSalary not specified
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
RemoteSenior Python Software Engineer
MoovSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteDon't see what you're looking for? Join our Talent Network!…
Recorded FutureSalary not specified
- Full Time
- Junior (1 to 2 years)
RemoteSenior Python Developer (Backend)
ArineSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteDeveloper Success Engineer - West
Dagster Labs$60,000 - $80,000/year
- Full Time
- Junior (1 to 2 years), Mid-level (3 to 4 years)
RemoteSenior Backend Engineer
JerrySalary not specified
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)
RemoteSenior Machine Learning Engineer - Machine Learning Infrastructure
FlipSalary not specified
- Full Time
- Senior (5 to 8 years)
RemoteData Science Lead
AtomicSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteSoftware Engineer, Data Infrastructure & Acquisition
SpeechifySalary not specified
- Full Time
- Mid-level (3 to 4 years), Senior (5 to 8 years)
RemoteDirector of Developer Community, PyTorch
AI FoundationSalary not specified
- Full Time
- Expert & Leadership (9+ years)