Lead Databricks Architect at RingCentral

Belmont, California, United States

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Technology, Communications, AIIndustries

Requirements

10+ years in data engineering / big data roles, with at least 3+ years of Databricks experience
Proven success in migrating large Hadoop ecosystems (multi-petabyte scale preferred) to Databricks or equivalent cloud-based data platforms
Deep expertise in Spark, Delta Lake, SQL, and Databricks runtime
Strong understanding of cloud data architectures (AWS, Azure, or GCP) including storage (S3, ADLS, GCS), compute, networking, and security
Experience with data governance, cataloging, lineage, and compliance (e.g., Alation, Collibra, Purview)
Proficiency in Python, SQL, and Scala for building and optimizing ETL/ELT pipelines
Strong knowledge of modern data platform patterns (Lakehouse, ML/AI integration, streaming)
Excellent communication and leadership skills—comfortable leading cross-functional teams through complex transformations

Responsibilities

Define and drive the Databricks strategy, roadmap, and architecture, including data ingestion, storage, compute, governance, and security
Evaluate and implement best practices for large-scale distributed data processing in Databricks
Optimize performance, cost, and scalability of data pipelines during and after migration
Partner with data engineers, data scientists, and platform teams to ensure business continuity and minimal disruption during cutover
Establish monitoring, reliability, and operational standards in the new environment
Provide technical leadership, mentorship, and hands-on guidance to the engineering team
Collaborate with cloud vendors (AWS, Azure, or GCP, depending on deployment) to ensure alignment with platform best practices

Skills

Key technologies and capabilities for this role

DatabricksData EngineeringBig DataData PipelinesData IngestionData GovernanceData SecurityAWSAzureGCP

Questions & Answers

Common questions about this position

What experience level is required for the Lead Databricks Architect role?

The role requires 10+ years in data engineering or big data roles, with at least 3+ years of Databricks experience, plus proven success in migrating large Hadoop ecosystems to Databricks or equivalent platforms.

What key technical skills are needed for this position?

Candidates need deep expertise in Spark, Delta Lake, SQL, and Databricks runtime, proficiency in Python, SQL, and Scala for ETL/ELT pipelines, and strong knowledge of cloud data architectures including AWS, Azure, or GCP.

Is the salary or compensation specified for this role?

This information is not specified in the job description.

What is the work arrangement or location policy for this position?

This information is not specified in the job description.

What makes a strong candidate for the Lead Databricks Architect role?

A strong candidate has 10+ years of data engineering experience including 3+ years with Databricks, proven large-scale Hadoop migrations, expertise in Spark/Delta Lake/SQL, cloud architectures, and excellent leadership skills for cross-functional teams.