Senior Data Engineer, Data Lakehouse Infrastructure

United States

Apply with AI Apply

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Blockchain, Data Intelligence, Financial TechnologyIndustries

Requirements

Candidates should have 5+ years of experience in data or software engineering, with a focus on distributed data systems and cloud-native architectures. Proven experience building and scaling data platforms on GCP, including storage, compute, orchestration, and monitoring, is required. Strong command of query engines such as Trino, Presto, Spark, or Snowflake, and experience with modern table formats like Apache Hudi, Iceberg, or Delta Lake are necessary. Exceptional programming skills in Python, adeptness in SQL or SparkSQL, and hands-on experience orchestrating workflows with Airflow and building streaming/batch pipelines using GCP-native services are also essential.

Responsibilities

The Senior Data Engineer will architect and scale a high-performance data lakehouse on GCP, leveraging technologies like StarRocks, Apache Iceberg, GCS, BigQuery, Dataproc, and Kafka. They will design, build, and optimize distributed query engines such as Trino, Spark, or Snowflake to support complex analytical workloads. Responsibilities include implementing metadata management in open table formats like Iceberg and data discovery frameworks for governance and observability using Iceberg compatible catalogs. Additionally, the engineer will develop and orchestrate robust ETL/ELT pipelines using Apache Airflow, Spark, and GCP-native tools, and collaborate across departments with data scientists, backend engineers, and product managers.

Skills

Data Lakehouse

Data Modeling

Data Ingestion

Query Performance Optimization

Metadata Management

Apache Spark

Trino

Hudi

Iceberg

Snowflake

StarRocks

GCP

GCS

BigQuery

Dataproc

Kafka

ETL

ELT

Apache Airflow

TRM Labs

Blockchain intelligence for financial crime detection

About TRM Labs

TRM Labs focuses on blockchain intelligence to assist financial institutions, cryptocurrency businesses, and government agencies in identifying and investigating financial crimes and fraud related to cryptocurrencies. The company utilizes advanced data engineering, data science, and threat intelligence to provide tools and insights that help clients combat illicit activities in the crypto sector. TRM Labs serves a wide range of clients, including banks and regulatory bodies, and generates revenue through subscription-based services and customized solutions. Its goal is to enhance the security and integrity of the global financial system by offering comprehensive blockchain analytics and investigative capabilities.

San Francisco, CaliforniaHeadquarters

2018Year Founded

$146MTotal Funding

SERIES_BCompany Stage

Data & Analytics, FintechIndustries

201-500Employees

Benefits

Remote Work Options

Annual Company Offsite

Professional Development Budget

Risks

Increased scrutiny in the UK could affect operations and partnerships in the region.

Collaboration with Tether and TRON may expose TRM Labs to reputational risks.

Cyberattack vulnerabilities in crypto exchanges could impact TRM Labs' clients.

Differentiation

TRM Labs specializes in blockchain intelligence for financial crime detection and investigation.

The company collaborates with major firms like PayPal, Visa, and government agencies.

TRM Labs offers subscription-based services and customized solutions for diverse client needs.

Upsides

Partnership with Four Inc. could increase government contracts in U.S. public sector.

Success in freezing $100 million in assets highlights effectiveness in public-private partnerships.

Collaboration with DeFi platforms like 1inch enhances influence in decentralized finance.

Land your dream remote job 3x faster with AI

Try Jobo Free