Prompt Engineer & Data Analyst at Welocalize

San Francisco, California, United States

Apply Now

Not SpecifiedCompensation

Mid-level (3 to 4 years)Experience Level

Full TimeJob Type

UnknownVisa

AI, Machine Learning, Data Analysis, LocalizationIndustries

Requirements

Bachelor's degree or equivalent experience in Linguistics, Computational Linguistics, Communications, Technical Writing, or a related analytical field
Native or near-native fluency in English with exceptional writing and editorial skills
Proven experience in a role involving AI data annotation, content quality review, search quality rating, or prompt engineering
Highly detail-oriented and analytical mindset, with the ability to deconstruct complex instructions and evaluate outputs with precision
Ability to interpret code, datasets, and system workflows at a conceptual level (no coding required)
Ability to work independently and manage workflows effectively in a remote environment
Nice to Have
Multilingual proficiency in one or more languages in addition to English
Direct experience with generative AI tools for text, voice, or video
Background in QA testing, rubric design, or AI safety and ethics evaluation
Familiarity with data annotation platforms and model evaluation tools

Responsibilities

Design, test, and iteratively refine complex and creative prompts to enhance AI model capabilities in reasoning, instruction following, and contextual understanding
Conduct rigorous side-by-side (SxS) comparisons of AI-generated outputs, providing detailed rationales and quality ratings to identify the superior response
Develop "golden" datasets, ideal responses, and granular evaluation rubrics to serve as benchmarks for model training and performance analysis
Engineer adversarial prompts and red-team scenarios to systematically identify model vulnerabilities, biases, and safety gaps across various policies (e.g., Harassment, Hate Speech, Dangerous Content)
Create, annotate, and review diverse datasets across text, audio, and video formats to support model training and localization
Perform in-depth fact-checking and analysis to ensure model responses are accurate, relevant, and grounded in reliable sources
Establish and document style guides, content standards, and evaluation procedures to ensure consistency and quality across all projects
Analyze model outputs to identify trends, document error patterns, and categorize failures, providing actionable feedback to engineering teams
Train, mentor, and guide other team members on prompt engineering best practices, evaluation methodologies, and quality standards
Collaborate with engineering and product teams to translate evaluation insights into actionable model improvements
For voice projects, script and perform dialogues portraying various personas (e.g., customer, agent) and accents to generate realistic conversational data for AI voice agents
For video projects, author precise text prompts using professional video production terminology (e.g., shot angles, camera movements, lighting) to guide generative video models

Skills

Prompt Engineering

Large Language Models

LLMs

Model Evaluation

Side-by-Side Comparisons

Dataset Creation

Data Annotation

Adversarial Prompts

Red-Teaming

Fact-Checking

Text Processing

Audio Processing

Video Processing

Welocalize

Provides AI-driven content localization services

About Welocalize

Welocalize assists businesses in enhancing customer engagement by providing localized content that meets the cultural and linguistic needs of different regions. Their AI-enabled Service Delivery Platform, OPAL, streamlines the translation and approval processes, allowing companies to reduce costs and improve efficiency. Unlike competitors, Welocalize leverages AI and automation to deliver services more effectively, resulting in better business outcomes for clients. The company's goal is to empower businesses to connect with international customers through advanced localization solutions.

New York City, New YorkHeadquarters

1997Year Founded

$33.1MTotal Funding

GROWTH_EQUITY_VCCompany Stage

Enterprise Software, AI & Machine LearningIndustries

1,001-5,000Employees

Benefits

Accident Insurance

Critical Illness Insurance

Hospital Indemnity Insurance

Telemedicine Benefit

Paid Sick Time

Paid Holidays

Employee Assistance Program

Mileage Reimbursement

Medical Insurance

Dental Insurance

Vision Insurance

Health Savings Account/Flexible Spending Account

Voluntary Life Insurance

401(k) Retirement Plan

Risks

Competition from AI-driven tools like DeepL and Google Translate threatens market share.

Rapid AI advancements may commoditize basic translation services, pressuring differentiation.

Economic uncertainties in key industries could reduce spending on localization services.

Differentiation

Welocalize's OPAL platform uses AI to streamline translation and content adaptation processes.

The company offers specialized linguistic validation services for clinical trials and healthcare.

Welocalize's TranslationRater™ plugin for ChatGPT enhances translation quality assessment capabilities.

Upsides

Growing demand for AI-driven localization boosts Welocalize's market opportunities.

Rising interest in multilingual e-learning aligns with Welocalize's expertise.

Healthcare sector's AI integration offers new service expansion opportunities for Welocalize.

Land your dream remote job 3x faster with AI

Try Jobo Free