Senior Data Engineer

Position Overview

Energy Solutions is seeking a passionate and highly skilled Senior Data Engineer to join our Information Systems team. This role is crucial for designing, developing, and maintaining data platforms that support the data needs across Energy Solutions. The ideal candidate will have expertise in analytics tools and cloud technologies (AWS, Azure, or similar), proficiency in SQL, NoSQL, and Python, and the ability to process large datasets to deliver high-quality, customer-facing data solutions and insights. This position offers a unique opportunity for individuals with technical prowess in the data field to impact energy efficiency markets and greenhouse gas reductions through our work with major North American utilities and other clients.

Employment Type

Full-time

Location Type

Remote-friendly within the United States. Office locations available in Oakland and Orange, California, as well as Portland, Boston, New York, and Chicago.

Responsibilities

• Build, automate, and manage near-real-time scalable data ingestion pipelines for master data management, deep-learning, and predictive analytics.
• Build and maintain cloud-native big data environments on AWS, ensuring they are highly secure, scalable, flexible, and performant using appropriate SQL, NoSQL, and NewSQL technologies.
• Lead data governance and data profiling efforts to ensure data quality and proper metadata documentation for data lineage.
• Provide technical input into build/buy/partner decisions for all components of the data infrastructure.
• Partner closely with Data Scientists, BI developers, and Product Managers to design and implement data models, database schemas, data structures, and processing logic to support various data science, analytics, machine learning, and BI initiatives.
• Design and develop ETL (extract-transform-load) processes to validate and transform data, calculate metrics, model features, and populate data models using Spark, Python, SQL, and other technologies in AWS.
• Lead by example, demonstrating best practices for code development and optimization, unit testing, CI/CD, performance testing, capacity planning, documentation, monitoring, alerting, and incident response to ensure data availability, quality, and usability.
• Define SLAs for data availability and correctness. Automate data availability and quality monitoring and respond to alerts when data delivery SLAs are not being met.
• Communicate progress across organizations and levels, from individual contributor to executive. Identify and clarify critical issues, drive appropriate decisions and actions, and communicate results clearly.

Minimum Qualifications

• Education: Bachelor's degree in Computer Science or Information Technology.
• Experience: A minimum of 8 years of job-related experience.
• Programming Proficiency: High proficiency in programming languages commonly used in ETL development, such as PLSQL, SQL, and Python. Ability to write efficient SQL queries, SQL stored procedures, develop scripts for data transformations, and utilize programming frameworks.

About Energy Solutions

Energy Solutions is a growing company focused on making significant impacts in the climate solution space. We believe market-based programs are a powerful force for delivering large-scale energy, carbon, and water-use savings. Since 1995, we have harnessed this power to offer proven, performance-based solutions for our utility, government, and institutional customers. We foster a supportive and energetic culture where talented colleagues work together to enhance our impact.