Senior Data Engineer
Rad AI145,000 - 190,000 USD/year
- Full Time
- Senior (5 to 8 years)
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Data & Analytics, LogisticsIndustries
Requirements
Candidates must have over 5 years of experience in a similar role, demonstrating a proven track record of building scalable and high-performance data infrastructure using Python, PySpark, Spark, and Airflow. A solid understanding of computer science fundamentals, excellent problem-solving skills, and a strong grasp of distributed computing principles are required. Expert-level SQL knowledge and extensive experience with both relational and NoSQL databases are essential. Advanced knowledge of Apache Kafka and proficiency in Hadoop v2, HDFS, and MapReduce are also necessary. Hands-on experience with stream-processing systems such as Storm and Spark Streaming is required.
Responsibilities
The Senior Data Engineer will design, develop, and maintain Ninja Van's infrastructure for data streaming, processing, and storage. They will build tools to ensure effective maintenance and monitoring of the data infrastructure. Key architectural decisions for data pipelines will be contributed to, leading the implementation of major initiatives. Collaboration with stakeholders to deliver scalable and high-performance solutions for data requirements, including ETL from diverse data sources, is expected. The engineer will enhance the team's data capabilities by sharing knowledge, enforcing best practices, and promoting data-driven decision-making. Additionally, they will develop and enforce Ninja Van's data retention policies and backup strategies, ensuring data is stored redundantly and securely.
Skills
Data Streaming
Data Processing
Data Storage
ETL
Data Pipelines
Data Infrastructure
Monitoring
Scalability
Architecture
Ninja Van
Technology-enabled logistics and delivery services
About Ninja Van
Ninja Van provides delivery services in Southeast Asia, catering to both businesses and individuals. The company focuses on creating a simple and efficient delivery experience through its technology platform, which enables real-time tracking of parcels and allows customers to schedule deliveries at their convenience. Ninja Van operates a wide network of drop-off and pick-up points to enhance accessibility. The company generates revenue by charging delivery fees based on parcel size, weight, and distance, and also offers additional services like cash on delivery. Unlike many competitors, Ninja Van emphasizes customer service and a user-friendly experience, making it a significant player in the region's logistics market.
Key Metrics
Singapore, SingaporeHeadquarters
2014Year Founded
$947.9MTotal Funding
DEBTCompany Stage
Automotive & Transportation, Consumer GoodsIndustries
1,001-5,000Employees