Senior Data Engineer
Rad AI$145,000 - $190,000/year
- Full Time
- Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Data & Analytics, Logistics, AI & Machine LearningIndustries
Requirements
Candidates must have solid computer science fundamentals and excellent problem-solving skills, with a strong understanding of distributed computing principles. A minimum of 5 years of experience in a similar role is required, demonstrating a proven track record of building scalable and high-performance data infrastructure using Python, PySpark, Spark, and Airflow. Expert-level SQL knowledge and extensive experience with both relational and NoSQL databases are essential. Advanced knowledge of Apache Kafka and proficiency in Hadoop v2, HDFS, and MapReduce are necessary. Hands-on experience with stream-processing systems such as Storm or Spark Streaming is also required.
Responsibilities
The Senior Data Engineer will design, develop, and maintain Ninja Van's infrastructure for data streaming, processing, and storage. They will build tools to ensure effective maintenance and monitoring of the data infrastructure and contribute to key architectural decisions for data pipelines, leading the implementation of major initiatives. Collaboration with stakeholders to deliver scalable and high-performance solutions for data requirements, including ETL from diverse data sources, is crucial. The engineer will enhance the team's data capabilities by sharing knowledge, enforcing best practices, and promoting data-driven decision-making. Additionally, they will develop and enforce data retention policies and backup strategies to ensure data is stored redundantly and securely.
Skills
Data Streaming
Data Processing
Data Storage
ETL
Distributed Computing
Data Pipelines
Data Retention
Backup Strategies
Problem-Solving
Ninja Van
Technology-enabled logistics and delivery services
About Ninja Van
Ninja Van provides delivery services in Southeast Asia, catering to both businesses and individuals. The company focuses on creating a simple and efficient delivery experience through its technology platform, which enables real-time tracking of parcels and allows customers to schedule deliveries at their convenience. Ninja Van operates a wide network of drop-off and pick-up points to enhance accessibility. The company generates revenue by charging delivery fees based on parcel size, weight, and distance, and also offers additional services like cash on delivery. Unlike many competitors, Ninja Van emphasizes customer service and a user-friendly experience, making it a significant player in the region's logistics market.
Singapore, SingaporeHeadquarters
2014Year Founded
$947.9MTotal Funding
DEBTCompany Stage
Automotive & Transportation, Consumer GoodsIndustries
1,001-5,000Employees