Big Data Engineer
ZoomFull Time
Junior (1 to 2 years), Mid-level (3 to 4 years)
Candidates should have 4+ years of experience building and optimizing data sets, 'big data' data pipelines, and architectures, with a strong preference for experience with IoT data. Proficiency in distributed systems like Spark and Kafka, cloud platforms such as AWS or Azure, data modeling principles, object-oriented programming languages like Python or Kotlin, and SQL is required. Proven ability in root cause analysis, data transformation, workload management, and metadata management is also necessary. Experience with Databricks and the medallion architecture is a plus.
The Senior Data Engineer will design, build, document, and maintain data pipelines for Data Warehouse and Data Acquisition (IoT data) systems, including Databricks medallion structures. Responsibilities include coding and updating data systems, writing technical specification documents, creating and maintaining data documentation according to Data Governance standards, acting as an ambassador for data governance, and participating in code reviews and change management processes. The role also involves identifying and implementing improvements to processes, code, and architecture.
Maintains and monitors solar energy systems
Omnidian focuses on the maintenance and performance assurance of solar energy systems for homeowners and businesses, including large-scale residential portfolio owners. Their primary service is a 24/7 remote monitoring system that tracks solar system performance and coordinates repairs when necessary, ensuring minimal downtime. Clients pay for subscription-based protection plans, and a standout feature is their 95% Energy Guarantee, which compensates clients if their solar system underperforms. This approach shifts the risk of maintenance issues from clients to Omnidian, providing financial security and peace of mind.