Data Engineering Lead
ArineFull Time
Expert & Leadership (9+ years)
Candidates should possess a strong software engineering background with deep experience in building data collection, transformation, and featurization pipelines at scale. Proficiency in Python, including async programming and concurrency tools, as well as data-centric frameworks like Pandas, Spark, or Apache Beam is required. Familiarity with ML model development workflows and infrastructure, including dataset versioning, experiment tracking, and model evaluation is necessary. Experience deploying and scaling AI systems in cloud environments such as AWS, GCP, or Azure is essential. Proven success operating in highly ambiguous environments such as research labs, startups, or fast-paced product teams is a must, along with a track record of working with or alongside high-caliber peers in top engineering teams, research groups, or startup ecosystems. A growth mindset, strong communication skills, and a commitment to inclusive collaboration and continuous learning are also required.
The Lead Software Engineer will design and implement systems to collect and curate high-quality training datasets for various learning use cases. They will build scalable featurization and preprocessing pipelines to transform raw data into structured inputs for AI/ML model development. This role involves partnering with ML engineers and researchers to define data requirements and production workflows that support LLM-based agents and autonomous AI systems. The engineer will lead the development of infrastructure that enables experimentation, evaluation, and deployment of machine learning models in production environments. Responsibilities also include supporting orchestration and real-time inference pipelines using Python and modern cloud-native tools, ensuring low-latency and high availability. Additionally, the role requires mentoring engineers, fostering a high-performance, collaborative engineering culture, and driving cross-functional alignment with product, infrastructure, and research stakeholders.
Online platform connecting freelancers and clients
Upwork connects freelancers with clients looking for various services in the gig economy, which focuses on short-term contracts instead of permanent jobs. The platform allows freelancers to create profiles that showcase their skills, while clients can post job listings for specific projects. Freelancers bid on these projects, and clients choose the best candidates based on proposals and reviews. Upwork earns revenue through service fees charged to freelancers based on their earnings, with a tiered structure that rewards long-term client relationships. The platform also offers premium memberships and additional services for enhanced visibility and access to job listings. Upwork provides tools for time tracking, invoicing, and project management, making it easier for both freelancers and clients to manage their work and payments. The goal of Upwork is to facilitate successful project completion by bridging the gap between freelancers and clients.