Senior Staff Software Engineer, Data Governance and Metadata Systems

Candidates should have experience designing, implementing, and evolving central data catalogs, including metadata ingestion, lineage, classification, access control, and policy enforcement. Experience with architecting privacy-aware infrastructure to meet regulatory requirements like EU/US residency, PII detection, audit logging, and policy-as-code is necessary. Proficiency in applying ML/AI techniques such as RAG-based natural language search, vector similarity search, and AI-generated documentation, along with experience in vector databases, embedding models, and LLM integration, is required. Experience scaling and hardening distributed data infrastructure including Kafka, Airflow, EMR on EKS, and Clickhouse is also necessary. Candidates should demonstrate experience driving architectural improvements across networking, compute, observability, and CI/CD, optimizing for security, cost-efficiency, and high availability. Experience building infrastructure APIs and automation frameworks for self-service onboarding of pipelines, datasets, and streaming resources is needed. The role requires mentoring and upleveling engineers, shaping engineering standards, reviewing designs, and guiding delivery on high-impact, cross-functional initiatives.