Head of Generative AI
TuringSalary not specified
Full Time
Expert & Leadership (9+ years)
Senior Manager, Generative AI Test Engineering at Samsung Research America
Mountain View, California, United States
Not SpecifiedCompensation
Senior (5 to 8 years), Expert & Leadership (9+ years)Experience Level
Full TimeJob Type
UnknownVisa
Artificial Intelligence, TechnologyIndustries
Requirements
- Bachelor’s degree in Computer Science, Computer Engineering, or equivalent combination of education, training, and experience
- 12+ years of professional software development testing experience, including test automation frameworks and tools building
- 2+ years of people management experience
- Experience with LLMOps, model monitoring, or ML observability platforms
- Proficiency in Python, SQL, and data visualization tools for model analytics
- Strong knowledge of QA methodologies, test automation, and CI/CD integration
- Experience as a mentor, tech lead or leading an engineering team
- Hands-on experience with LangChain, OpenAI API, Hugging Face models, or RAG pipelines (special attribute)
- Knowledge of cloud platforms (AWS/GCP/Azure) for data workflows and ML deployment (special attribute)
- Familiarity with human-in-the-loop QA or AI-assisted testing workflows (special attribute)
Responsibilities
- Lead a small team of Data Scientists and QA Engineers
- Act as a player/coach and utilize test results data to guide product development, identify opportunities, predict challenges, and inform strategic decisions
- Measure product success through metrics, identifying areas for improvement, and effectively communicating insights to stakeholders
- Work closely with other functions, such as engineering, product, design, and others
- Design and implement testing strategies and frameworks to evaluate the performance, accuracy, robustness, and safety of AI models and systems
- Collaborate closely with research teams to understand new model capabilities and translate them into robust testing plans and scenarios
- Drive development and maintenance of automated testing frameworks and tools for efficient AI validation and system-level testing
Skills
Python
SQL
LLMOps
model monitoring
ML observability
test automation
CI/CD
QA methodologies
data visualization
Samsung Research America
Develops advanced technology in multiple domains
About Samsung Research America
Samsung Research America specializes in advanced technologies such as next-generation communications, artificial intelligence, digital media, mobile platforms, and digital health. Their innovations include FadeNet, a convolutional neural-network based technology, and the ECG Monitor App, which enables ECG recording using Galaxy Watch for atrial fibrillation screening.
665 Clyde Ave, Mountain View, CA 94043, USAHeadquarters
1988Year Founded
VENTURE_UNKNOWNCompany Stage
HardwareIndustries
501-1,000Employees
Benefits
Onsite Fitness Facility
Subsidized Meals
Coffee Barista Bar
Samsung University
Product Discounts
Dog Friendly Campus
Wellness Programs
Activity Clubs
Related Jobs
RemoteRemoteAI Engineering Manager
doolaSalary not specified
- Full Time
- Junior (1 to 2 years)
RemoteQuality Assurance Analyst, AI Delivery
CrestaSalary not specified
- Full Time
- Junior (1 to 2 years)
RemoteApplied Research Lead, Model Scaling
RunwaySalary not specified
- Full Time
- Junior (1 to 2 years)
RemoteStaff Software Developer in Test (SDET)
SpyCloudSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteStaff Software Systems Engineer, Behavior Validation
General MotorsSalary not specified
- Full Time
- Expert & Leadership (9+ years)
RemoteSenior AI Engineer
Fieldguide$160,000 - $210,000/year
- Full Time
- Senior (5 to 8 years), Expert & Leadership (9+ years)