Staff Software Engineer, Data
FlexSalary not specified
- Full Time
- Senior (5 to 8 years)
Not SpecifiedCompensation
Junior (1 to 2 years), Mid-level (3 to 4 years)Experience Level
Full TimeJob Type
UnknownVisa
Commodities, Energy, Maritime, Data ScienceIndustries
Requirements
Candidates should possess a Bachelor’s degree in Computer Science, Engineering, or a related field, and have at least three years of experience in data engineering, with a focus on building and maintaining data pipelines. Proficiency in Python, including experience with data manipulation libraries like Pandas, is required, along with knowledge of data integration, ETL processes, and batch/streaming data processing. Familiarity with SQL, RDBMS, or Big Data technologies is also necessary. Experience with containerization and orchestration tools such as Docker and Kubernetes is preferred, as is experience with Git, code reviews, and Agile methodologies.
Responsibilities
The Data Engineer will be responsible for the development and implementation of core data ingestion and distribution pipelines, alongside associated back-end systems, aligning with project requirements and design specifications. They will also contribute to troubleshooting and optimizing existing workflows to enhance performance and efficiency, ensuring data integrity and accuracy across various pipelines, and proactively learning new analytical and debugging skills.
Skills
Python
Pandas
Docker
Kubernetes
Airflow
SQL
ETL
Data Integration
Kpler
Provides data and analytics for commodity markets
About Kpler
Kpler provides intelligence solutions for commodity markets, focusing on over 25 different commodities including oil, gas, LNG, and maritime freight. The company offers real-time data and analytics through various platforms such as a web-based terminal, API, SDK, and Excel add-in, allowing clients to easily integrate this information into their workflows. Kpler's clients, which include portfolio managers, investment firms, and brokers, use its data to make informed decisions regarding commodity flows, storage levels, and market trends. Unlike its competitors, Kpler emphasizes transparency and accuracy, providing detailed insights into complex markets, such as U.S. crude oil export flows and global storage inventories. The company's goal is to empower clients with expert insights and reliable data solutions to navigate volatile markets.
Key Metrics
Paris, FranceHeadquarters
2014Year Founded
$214MTotal Funding
GROWTH_EQUITY_VCCompany Stage
Data & Analytics, Financial ServicesIndustries
501-1,000Employees