Lead Data Engineer

Remote

Apply with AI Apply

Not SpecifiedCompensation

Expert & Leadership (9+ years)Experience Level

Full TimeJob Type

UnknownVisa

Work Marketplace, Biotechnology, AIIndustries

Requirements

Candidates should have proven success delivering AI-powered data systems in production, with hands-on experience in LLMs and prompt engineering. A strong foundation in modern data engineering, including expertise in Python, SQL, and platforms like Snowflake, is essential. The ability to design scalable agentic orchestration frameworks and excellent communication skills for stakeholder alignment are also required. A growth mindset focused on learning, iterating, and delivering measurable outcomes through applied AI is preferred.

Responsibilities

The Lead AI Data Engineer will design and implement scalable agentic frameworks, build and optimize natural language query systems, and develop frameworks for evaluating prompts and LLMs. They will partner with data engineering peers to integrate AI orchestration with existing pipelines and contribute to AI-powered summarization and explanation tools. Collaboration with product, analytics, and business teams to ensure AI solutions align with business goals is also a key responsibility.

Skills

Data Engineering

Agentic Frameworks

Natural Language Querying (NLQ)

LLM Evaluation

Python

SQL

Snowflake

Data Pipelines

Scalability

Resilience

Upwork

Online platform connecting freelancers and clients

About Upwork

Upwork connects freelancers with clients looking for various services in the gig economy, which focuses on short-term contracts instead of permanent jobs. The platform allows freelancers to create profiles that showcase their skills, while clients can post job listings for specific projects. Freelancers bid on these projects, and clients choose the best candidates based on proposals and reviews. Upwork earns revenue through service fees charged to freelancers based on their earnings, with a tiered structure that rewards long-term client relationships. The platform also offers premium memberships and additional services for enhanced visibility and access to job listings. Upwork provides tools for time tracking, invoicing, and project management, making it easier for both freelancers and clients to manage their work and payments. The goal of Upwork is to facilitate successful project completion by bridging the gap between freelancers and clients.

San Francisco, CaliforniaHeadquarters

2015Year Founded

$143.8MTotal Funding

IPOCompany Stage

Consulting, Enterprise SoftwareIndustries

10,001+Employees

Benefits

Health Insurance

Unlimited Paid Time Off

401(k) Retirement Plan

401(k) Company Match

Parental Leave

Employee Stock Purchase Plan

Risks

Increased competition from Fiverr and Toptal threatens Upwork's market share.

The new Fiverr-style Project Catalog may commoditize services, reducing freelancers' perceived value.

Strategic shifts under new management may not align with current client expectations.

Differentiation

Upwork connects freelancers with clients across diverse industries, enhancing global work opportunities.

The platform offers tools like time tracking and invoicing for efficient project management.

Upwork's tiered fee structure incentivizes long-term client relationships, differentiating it from competitors.

Upsides

Upwork's acquisition of Objective AI enhances its AI capabilities for better talent matching.

The introduction of Featured Jobs increases visibility for job posts, attracting more candidates.

Upwork's recognition as the top job posting site boosts its credibility among employers.

Land your dream remote job 3x faster with AI

Try Jobo Free