Principal Engineer - Databricks at Flexera

Bengaluru, Karnataka, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

FinOps, ITAM, SaaS, TechnologyIndustries

Requirements

Bachelor’s or higher degree in Computer Science, Software Engineering, or a related field
12+ years of software engineering experience, with 6+ years specifically in building large-scale data platforms
Expert-level proficiency in Databricks, including Delta Lake internals (ACID transactions, time travel, Z-ordering, data compaction strategies)
Expert-level proficiency in Unity Catalog for data governance, security, and lineage
Expert-level proficiency in advanced Spark tuning (shuffle management, partitioning strategies, caching, cluster configuration)
Expert-level proficiency in Databricks SQL Warehousing, Workflows

Responsibilities

Architect, design, and implement scalable and performant Databricks-based data pipelines, including batch and streaming workloads
Optimize Databricks Lakehouse architecture — including Delta Lake, Unity Catalog, and Photon — for cost efficiency, data reliability, and query performance at scale
Define and implement advanced data models and ontologies to support complex analytics and AI/ML workflows
Design and tune complex Spark applications (PySpark and/or Scala) for high-volume data processing, including structured streaming and incremental processing
Implement orchestration workflows (e.g., Databricks Workflows, Azure Data Factory, or similar) to automate data pipelines with robust monitoring and alerting
Drive best practices for data governance, security, and lineage, leveraging Unity Catalog, table ACLs, and audit capabilities
Optimize cluster configurations, autoscaling strategies, and cost management within Databricks environments
Collaborate with data scientists and analytics engineers to enable self-service access to high-quality, well-documented datasets and features
Lead complex troubleshooting efforts, deep performance tuning, and root-cause analysis across distributed systems
Author and maintain technical artifacts, including architecture diagrams, design docs, reference implementations, and best practice guides
Mentor and coach engineers across teams on Databricks internals, Spark performance tuning, and modern data engineering architectures
Stay on top of emerging Databricks features (e.g., Mosaic AI, serverless compute, Delta Live Tables), advocating for their adoption when they bring tangible value

Skills

Key technologies and capabilities for this role

DatabricksDelta LakeUnity CatalogLakehouseData PipelinesBatch WorkloadsStreaming WorkloadsDistributed SystemsCloud NativeAI/ML

Questions & Answers

Common questions about this position

What is the employment type for this Principal Engineer role?

The position is full-time employment.

Is this Principal Engineer position remote or does it require office work?

This information is not specified in the job description.

What key skills are required for the Principal Engineer - Databricks role?

The role requires deep expertise in Databricks, including Delta Lake, Unity Catalog, and Photon; proficiency in Spark applications with PySpark and/or Scala; and experience with data pipelines, orchestration workflows, and distributed systems.

What is the company culture like at Flexera?

Flexera emphasizes teamwork, innovation, and growth, collaborating across architects, data scientists, and engineers to deliver scalable solutions while being recognized as a category leader by Gartner, Forrester, and IDC.

What makes a strong candidate for this Principal Engineer position?

A strong candidate is a Databricks expert with experience in modern data engineering, distributed systems, cloud-native architectures, optimizing lakehouse setups, and leading complex troubleshooting and performance tuning.

Flexera

IT management and software optimization solutions

About Flexera

Flexera provides IT management software and optimization solutions that help businesses control their software and IT costs. Its products enable organizations to manage their technology investments more efficiently, particularly during digital transformation efforts. Flexera's main offerings include IT asset management (ITAM) and software asset management (SAM) tools, which allow clients to track and optimize software usage. Additionally, the company offers cloud management solutions to help businesses manage their cloud resources effectively. Flexera differentiates itself from competitors through its Technology Value Optimization (TVO) approach, which focuses on maximizing the business value from technology expenditures. The company's goal is to help clients achieve a return on investment (ROI) from their technology spending, ensuring that every dollar spent contributes to growth and efficiency.

Itasca, IllinoisHeadquarters

2008Year Founded

$81.4MTotal Funding

BUYOUTCompany Stage

Enterprise SoftwareIndustries

1,001-5,000Employees

Risks

Integration of Snow Software may disrupt services if not managed well.

Rising SBOM demand may strain Flexera's resources and compliance efforts.

Rapid cloud tech evolution could lead to outdated Flexera offerings.

Differentiation

Flexera's Technology Value Optimization maximizes business value from technology investments.

Acquisition of Snow Software enhances Flexera's hybrid IT management capabilities.

Flexera's SBOM management addresses rising cybersecurity threats and regulatory requirements.

Upsides

Recognition as a leader in Cloud Cost Management boosts Flexera's market credibility.

Flexera One FinOps tool optimizes costs and improves IT-finance collaboration.

Technology Intelligence Platform bridges ITAM and FinOps for hybrid IT challenges.

Land your dream remote job 3x faster with AI

Try Jobo Free