Mineral

Senior Data Engineer

Bengaluru, Karnataka, India

Auto‑apply with AI Apply

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Data & AnalyticsIndustries

Requirements

The ideal candidate should possess 5 to 7+ years of pertinent experience in data engineering, with a robust background in big data technologies, ETL/ELT processes, and data modeling. They must be proficient in PySpark, have experience with Azure Databricks, and possess strong knowledge of data streaming solutions using frameworks like Spark Streaming. Advanced skills in SQL, along with experience in Spark optimization, are also required, as well as familiarity with optional tools such as Snowflake, cloud platforms, and CI/CD practices.

Responsibilities

This Senior Data Engineer will concentrate on designing and enhancing data pipelines, ensuring data fidelity, and facilitating analytics efforts. They will design, develop, and maintain scalable ETL/ELT pipelines using PySpark and Databricks, implement and enhance data streaming solutions, improve Spark job performance, collaborate with data scientists and analysts, create and refine SQL queries, maintain data quality, document data workflows, and research and adopt new data engineering technologies.

Skills

PySpark

Azure Databricks

Data Streaming

Python

SQL

Spark Optimization

Mineral

Develops AI tools for sustainable agriculture

About Mineral

Mineral.ai develops technology solutions aimed at improving the agriculture industry. The company utilizes perception technology, artificial intelligence (AI), and machine learning (ML) to create tools that help farmers, researchers, and agricultural advisors increase crop yields, manage pests, and adapt to climate change. Their products include precision agriculture tools that optimize resource use and advanced data analytics platforms that provide insights from agricultural data. Unlike many competitors, Mineral.ai focuses on creating partnerships within the agriculture sector to co-develop solutions, enhancing their product offerings. The goal of Mineral.ai is to support sustainable food production and help feed the world more efficiently.

Key Metrics

Mountain View, CaliforniaHeadquarters

N/AYear Founded

VENTURE_UNKNOWNCompany Stage

Food & Agriculture, AI & Machine LearningIndustries

51-200Employees

Risks

Transition from Alphabet may lead to financial instability and resource loss.

Licensing model could reduce control over technology application and revenue stability.

Difficulty in monetizing technology indicates challenges in creating durable revenue streams.

Differentiation

Mineral.ai uses AI and ML to revolutionize agriculture with precision tools.

The company partners with industry leaders like Driscoll's for real-world technology applications.

Mineral.ai's licensing model allows broad integration into existing agribusiness systems.

Upsides

Licensing model increases market reach and technology integration in agribusiness.

Partnerships with companies like Driscoll's enhance technology application and sustainability goals.

Growing interest in agrivoltaic systems offers new partnership opportunities for Mineral.ai.

Land your dream remote job 3x faster with AI

Try Jobo Free