Responsibilities

The Principal Data Engineer will own the architecture and strategic direction of scalable, distributed data infrastructure across cloud platforms, design and build a data compilation system to normalize, match, and merge products, reviews, and editorial data from thousands of data sources, use the latest NLP, LLMs, and embedding models to generate high-quality datasets with automated data auditing and reporting, implement real-time and batch data processing systems to power AI/ML use cases, collaborate with engineering, AI, and product teams to ensure data availability and reliability, develop backend data solutions that support microservices architecture and a rapidly scaling product environment, manage and extend integrations with third-party e-commerce platforms to expand Wizard’s data ecosystem, and mentor and support data engineers, establishing best practices.