Senior Data Engineer at Checkr

San Francisco, California, United States

Checkr Logo
Not SpecifiedCompensation
Senior (5 to 8 years)Experience Level
Full TimeJob Type
UnknownVisa
Data Engineering, SoftwareIndustries

Requirements

Candidates must have 7+ years of development experience in data engineering, with at least 5 years specifically writing PySpark. Experience building large-scale data processing pipelines (batch and stream), ETL/ELT processes, and handling massive datasets (100s of Terabytes and Petabytes) is essential. Strong proficiency in PySpark and Python is required, along with expertise in database systems, data modeling, relational databases, and NoSQL databases like MongoDB. Familiarity with big data technologies such as Kafka, Spark, Iceberg, Datalake, and the AWS stack (EKS, EMR, Serverless, Glue, Athena, S3, etc.) is necessary. Knowledge of security best practices and data privacy concerns, along with strong problem-solving skills and attention to detail, are also key requirements. Experience with data processing platforms like Databricks or Snowflake, and an understanding of Graph and Vector data stores are considered advantageous.

Responsibilities

The Senior Data Engineer will create and maintain data pipelines and foundational datasets to support product and business needs. They will design and build database architectures for massive and complex data, balancing computational load and cost. Responsibilities include developing audits for data quality at scale with necessary alerting, and creating scalable dashboards and reports to support business objectives and enable data-driven decision-making. The role also involves troubleshooting and resolving complex issues in production environments, and working closely with product managers and other stakeholders to define and implement new features.

Skills

PySpark
Data Pipelines
ETL
ELT
Data Quality
Database Architecture
Data Ingestion
Data Processing
SQL
Data Visualization

Checkr

Provides background check services for employers

About Checkr

Checkr provides background check services primarily for businesses, staffing agencies, and recruiters. Their platform allows clients to conduct thorough background screenings to verify potential employees' histories, which is especially important in high-risk industries. The service operates on a software-as-a-service (SaaS) model, where clients subscribe to access a user-friendly dashboard and various features that help manage the background check process efficiently. Checkr also offers educational resources to promote fair hiring practices. Unlike many competitors, Checkr's platform includes innovative solutions like Checkr Assess, which can significantly reduce talent acquisition costs. The company's goal is to help businesses hire trustworthy employees while ensuring compliance and promoting fair hiring practices.

San Francisco, CaliforniaHeadquarters
2014Year Founded
$535.1MTotal Funding
SERIES_ECompany Stage
Data & Analytics, ConsultingIndustries
1,001-5,000Employees

Benefits

A fast-paced and collaborative environment
Learning and development allowance
Competitive compensation and opportunity for advancement
100% medical, dental, and vision coverage
Up to 25K reimbursement for fertility, adoption, and parental planning services
Flexible PTO policy
Monthly wellness stipend, home office stipend

Risks

Recent layoffs suggest potential financial instability or restructuring challenges for Checkr.
Departure of key personnel may lead to internal restructuring and operational disruptions.
Acquisition of Inflection and workforce reduction could lead to integration challenges.

Differentiation

Checkr offers rapid background checks using advanced technology, surpassing traditional providers.
The company promotes fair hiring practices, aligning with modern corporate social responsibility goals.
Checkr's SaaS model provides a user-friendly platform with compliance resources and partner integrations.

Upsides

Increased demand for digital background checks boosts Checkr's remote verification capabilities.
The gig economy's growth enhances demand for Checkr's quick and reliable background checks.
AI integration in HR tech allows Checkr to improve accuracy and speed of checks.

Land your dream remote job 3x faster with AI