Senior Data Engineer
Built TechnologiesSalary not specified
- Full Time
- Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Supply Chain & Logistics, SaaSIndustries
Position Overview
- Location Type: Remote
- Employment Type: Full-time
- Salary: Not specified
Shippeo is a European-based SaaS company specializing in supply chain visibility. Founded in 2014 and recently fueled by $110 million in funding, Shippeo provides global, multimodal real-time transportation visibility to customers in various industries. With offices across Europe, North America, and Asia, Shippeo's vision is to become the leading data platform for the freight industry.
Job Description - Data Engineer
The Data Intelligence Tribe is responsible for leveraging Shippeo’s data from our large shipper and carrier base to build data products that help our users (shippers and carriers alike) and ML models to provide predictive insights. This tribe’s typical responsibilities are to:
- Get accurately alerted in advance of any potential delays on their multimodal flows or anomalies so that they can proactively anticipate any resulting disruption.
- Extract the data they need, get direct access to it or analyze it directly on the platform to gain actionable insights that can help them increase their operational performance and the quality and compliance of their tracking.
- Provide best-in-class data quality by implementing advanced cleansing & enhancement rules.
As a Data Engineer at Shippeo, your objective is to ensure that data is available and exploitable by our Data Scientists and Analysts on our different data platforms. You will contribute to the construction and maintenance of Shippeo’s modern data stack that’s composed of different technology blocks:
- Data Acquisition: (Kafka, KafkaConnect, RabbitMQ)
- Batch data transformation: (Airflow, DBT)
- Cloud Data Warehousing: (Snowflake, BigQuery)
- Stream/event data processing: (Python, Docker, Kubernetes)
- And all the underlying infrastructure that support these use cases.
Qualifications
Required:
- Degree (MSc or equivalent) in Computer Science
- 3+ years of experience as a Data Engineer
- Experience building, maintaining, testing, and optimizing data pipelines and architectures
- Programming skills in Python
- Advanced working knowledge of SQL, experience working with relational databases and familiarity with a variety of databases
- Working knowledge of message queuing and stream processing
- Advanced knowledge of Docker and Kubernetes
- Advanced knowledge of a cloud platform (preferably GCP)
- Advanced knowledge of a cloud based data warehouse solution (preferably Snowflake)
- Experience with Infrastructure as code (Terraform/Terragrunt)
- Experience building and evolving CI/CD pipelines (Github Actions)
Desired:
- Experience with Kafka and KafkaConnect (Debeziu)
Skills
Kafka
KafkaConnect
RabbitMQ
Airflow
DBT
Snowflake
BigQuery
Python
Docker
Kubernetes
Shippo
Shipping solution for ecommerce businesses
About Shippo
Shippo provides a shipping solution for ecommerce businesses, marketplaces, and platforms by connecting them to multiple shipping carriers through a single API and dashboard. Users can compare shipping rates, print labels, automate international documents, track shipments, and manage returns all in one place. This integration allows clients to streamline their shipping processes efficiently. Unlike many competitors, Shippo focuses on offering a comprehensive service that works seamlessly with existing ecommerce platforms, making it easier for businesses to handle their logistics. The goal of Shippo is to enhance the shipping experience for its customers, ensuring their success by solving key operational challenges in the ecommerce logistics market.
San Francisco, CaliforniaHeadquarters
2013Year Founded
$150.1MTotal Funding
LATE_VCCompany Stage
Automotive & Transportation, Consumer SoftwareIndustries
201-500Employees