[Remote] Senior Data Engineer at Drata

United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Technology, Data AnalyticsIndustries

Requirements

8+ years of advanced SQL development experience coupled with robust Python or Java programming capabilities
4+ years of hands-on experience with data warehousing technologies (Snowflake, BigQuery, Redshift)
3+ years of experience working with streaming using Spark or Flink or Kafka or NoSQL or relevant technologies
Extensive experience building and optimizing large-scale ETL pipelines, data modeling and schema design, including CDC, structured and unstructured data
Fearless attitude towards technological change and a drive to thrive in fast-paced, dynamic settings
Strong dedication to code quality, automation and operational excellence: CI/CD pipelines, unit/integration tests
Demonstrated experience in building working in AWS, web services and/or working with ML pipelines and LLM models
Bachelor's degree in Computer Science, Engineering, Mathematics, Statistics, Operations Research, Data Science or related field
Solid understanding of data security and compliance requirements
Effective communication skills, conveying complex technical concepts to non-technical stakeholders
Ability to thrive in a fast-paced, high-growth startup environment with a balance of autonomy and collaboration

Responsibilities

Develop and maintain robust data models and schema designs
Design and develop complex data pipelines for efficient and scalable data processing
Optimize data infrastructure and enhance overall system performance
Implement and optimize algorithms for data transformation, cleansing, and enrichment
Drive the adoption of best practices in data governance, security, and management
Collaborate with Software Engineers to integrate data analytics solutions into production systems
Apply machine learning techniques to extract insights and patterns from large datasets
Collaborate with cross-functional teams to understand business requirements and provide data-driven solutions
Formulate the right metrics and definitions of success to drive quality, efficiency, cost, timeliness and understanding the source data
Develop and maintain documentation for data processes, pipelines, and models
Engage with LLM models, showcasing your capacity to work with cutting-edge AI technologies
Continuously stay up-to-date on industry trends and advancements in data engineering and analytics

Skills

Key technologies and capabilities for this role

PythonJavaMySQLData PipelinesData WarehousingData ModelingSchema DesignETLMachine LearningLLMData GovernanceData Security

Questions & Answers

Common questions about this position

Is this position remote?

Yes, this is a fully remote position.

What are the key skills and experience required for this Senior Data Engineer role?

Candidates need 8+ years of advanced SQL development with robust Python or Java skills, 4+ years with data warehousing like Snowflake, BigQuery or Redshift, 3+ years with streaming technologies such as Spark, Flink, Kafka or NoSQL, and extensive experience in ETL pipelines, data modeling, AWS, CI/CD, and ML/LLM models.

What does the data team at Drata look like?

The dynamic data department consists of Data Engineers, Analytics Engineers, Data Analysts, and Data Scientists.

What is the company culture like for this role?

The team is fast-moving, uses cutting-edge technologies, and thrives in fast-paced, dynamic settings with a fearless attitude towards technological change, strong dedication to code quality, automation, and operational excellence.

What makes a strong candidate for this Senior Data Engineer position?

A strong candidate has 8+ years in advanced SQL and Python/Java, experience with data warehousing, streaming tech, large-scale ETL, AWS, ML/LLMs, plus a Bachelor's degree, and thrives in fast-paced environments with a focus on code quality and automation.

Drata

Automates security and compliance processes

About Drata

Drata provides a platform that automates security and compliance processes for companies, helping them achieve and maintain continuous compliance with standards like SOC 2, ISO 27001, and HIPAA. The platform works by integrating with over 75 different technologies to continuously monitor a company's security posture and collect evidence needed for compliance audits. This automation reduces the need for manual tasks, such as taking screenshots and managing spreadsheets, making the compliance process more efficient. Drata primarily serves fast-growing technology and SaaS companies that face challenges in managing compliance due to rapid growth and complex regulations. Unlike its competitors, Drata focuses on providing a comprehensive, integrated solution that ensures clients are always audit-ready. The goal of Drata is to simplify compliance management, allowing businesses to save time and resources while building trust with their customers.

San Diego, CaliforniaHeadquarters

2020Year Founded

$319.2MTotal Funding

SERIES_CCompany Stage

Enterprise Software, CybersecurityIndustries

501-1,000Employees

Benefits

Health benefits

Learning enrichment stipends

Flexible PTO

Work from home stipend

401k

Parental leave

Risks

Integration challenges from acquisitions like oak9 may disrupt service delivery.

AI-generated responses in compliance may face client resistance over accuracy concerns.

Rapid platform expansion could strain infrastructure, risking service outages.

Differentiation

Drata automates compliance with over 75 technology integrations, streamlining audit readiness.

Founded in 2020, Drata focuses on continuous compliance for fast-growing tech companies.

Drata's AI-driven solutions reduce manual compliance tasks, enhancing efficiency and accuracy.

Upsides

Drata's acquisition of oak9 integrates compliance into the software development lifecycle.

AI Questionnaire Automation accelerates sales cycles by minimizing security review delays.

Strategic alliances, like with 360 Advanced, expand Drata's market reach and service offerings.

Land your dream remote job 3x faster with AI

Try Jobo Free