[Remote] Lead Software Engineer at Upwork

The Lead Software Engineer will design and implement systems to collect and curate high-quality training datasets for various learning use cases. They will build scalable featurization and preprocessing pipelines to transform raw data into structured inputs for AI/ML model development. This role involves partnering with ML engineers and researchers to define data requirements and production workflows that support LLM-based agents and autonomous AI systems. The engineer will lead the development of infrastructure that enables experimentation, evaluation, and deployment of machine learning models in production environments. Responsibilities also include supporting orchestration and real-time inference pipelines using Python and modern cloud-native tools, ensuring low-latency and high availability. Additionally, the role requires mentoring engineers, fostering a high-performance, collaborative engineering culture, and driving cross-functional alignment with product, infrastructure, and research stakeholders.