Technical Data Governance Specialist

The Technical Data Governance Specialist will be responsible for designing and implementing the core components of the data governance framework from the ground up within a Databricks environment. This includes conducting a comprehensive inventory of data assets, collaborating with engineering teams to map data flows and document data lineage, and developing an initial plan for organizing and pre-processing raw data according to Medallion architecture principles. The role involves leading the hands-on implementation and operationalization of Databricks Unity Catalog, enriching it with accurate annotations, and ensuring its meticulous maintenance. Additionally, the specialist will design and implement a practical data quality framework with automated tests in Azure and Databricks, establish an initial data observability platform, and work with data consumers to identify critical data elements. The position also requires implementing and managing a robust access control framework within Databricks, developing and executing protocols for identifying, classifying, and protecting Personally Identifiable Information (PII), and collaborating with Legal, Compliance, and Security teams to ensure technical implementations align with regulatory requirements.