Sr. Data Engineer II

Position Overview

• Location Type: Remote
• Job Type: Full-time
• Salary: Not specified

TrueML is a mission-driven financial software company focused on creating better customer experiences for distressed borrowers. They utilize machine learning to engage customers digitally and adjust strategies in real time.

About the Role:

As a Senior Data Engineer II, you will play a pivotal role in designing, building, and maintaining the company's cutting-edge data LakeHouse platform. You will leverage open table formats like Apache Iceberg to create scalable, reliable data solutions that enable optimized query performance across a broad spectrum of analytical workloads and emerging data applications. You'll develop and operate robust data pipelines, integrating diverse source systems and implementing efficient data transformations for both batch and streaming data.

Responsibilities

• Design, build, and operate robust data lakehouse solutions utilizing open table formats like Apache Iceberg.
• Integrate with diverse source systems and construct scalable data pipelines.
• Implement efficient data transformation logic for both batch and streaming data.
• Analyze business requirements and profile source data to design, develop, and implement robust data models and curated data products.
• Develop and manage a scalable AWS cloud infrastructure for the data platform, employing Infrastructure as Code (IaC).
• Implement CI/CD pipelines for automated, consistent, and scalable infrastructure deployments.
• Monitor data workloads for performance and errors, troubleshoot issues, and maintain high data quality.
• Collaborate with Data Services and Data Science colleagues to drive the evolution of the data platform.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related technical field (Master's degree is a plus).
• 5+ years of hands-on engineering experience (software or data), with 3+ years in data-focused roles.
• Experience implementing data lake and data warehousing platforms.
• Strong Python and SQL skills applied to data engineering tasks.
• Proficiency with the AWS data ecosystem (S3, Glue Catalog, IAM, Secrets Manager).
• Experience with Terraform and Kubernetes.
• Track record of successfully building and operationalizing data pipelines.
• Experience working with diverse data stores, particularly relational databases.

Work-Life Benefits

• Unlimited PTO
• Medical benefit contributions (in congruence with local laws and type of employment agreement)

You Might Also Have

• Experience with Airflow, DBT, and Snowflake.
• Certification in relevant technologies or methodologies.
• Experience with streaming processing technology (e.g., Flink, Spark Streaming).
• Familiarity with Dom