Sr Machine Learning Quality Engineer at ServiceNow

Hyderabad, Telangana, India

Apply Now

Not SpecifiedCompensation

Senior (5 to 8 years)Experience Level

Full TimeJob Type

UnknownVisa

Technology, AIIndustries

Requirements

5+ years professional experience in software quality engineering with a focus on AI/Machine learning
Hands-on experience with testing machine learning, Generative AI systems and Conversational interfaces, including validation of model predictions and integration testing of end-to-end AI workflows
Working knowledge of synthetic data generation techniques and prompt engineering
Understanding of core AI principles, including Gen AI, agentic AI, algorithms, models, and ethical considerations
Experience working within different automated testing frameworks, including Java, JUnit, Selenium, TestNG and other open-source projects
Ability to build testing strategies for AI powered applications such as conversational interfaces like AI Search, Virtual Agent along with Agentic Workflows and etc
Ability to diagnose issues, come up with a strategy for relief, permanent fix and RCA and implement it
Ability to implement best practices and coding standards on role specific requirements (e.g. programming languages and tools, network design, functional design, algorithms, patterns, design and development, etc.)
Fluency in programming language / scripting in Java and Python
Experience with different testing techniques (e.g. performance, unit, integration, automated), their strengths and weakness, and ability to use them to best effect
Expert working knowledge and ability to use tools (such as IDE, debugger, build tools, source control, ServiceNow instances, profilers, system administration/Unix tools) to assist with daily tasks
Experience with the agile methodology for software development teams
Experience driving cross-team technical discussions with an understanding of SDLC concepts

Responsibilities

Take ownership of end-to-end quality deliverables for ML/AI products
Act as the voice of quality, collaborating with Product and Development teams to define comprehensive test strategy while establishing and adhering to quality milestones, and execute according to plan
Build test strategies for AI powered applications like conversational interfaces, Agentic workflows and etc
Evaluate the quality, accuracy, performance, and safety of AI-generated content produced by LLMs and identify weaknesses
Create and maintain test automation frameworks
Lead development of test datasets (synthetic, autogenerated, edge cases)
Collect, analyze, and report quality metrics from test execution and create defects based on results patterns
Contribute to refining evaluation criteria and methodologies for model assessment to improve AI evaluation frameworks
Support engineering organizations in troubleshooting or addressing issues with applications and dev/test environments
Stay up to date with latest developments in LLMs and AI ethics to improve evaluation techniques

Skills

Machine Learning

Generative AI

LLMs

Test Automation

Conversational Interfaces

AI Evaluation

Quality Metrics

Test Datasets

AI Ethics

ServiceNow

Cloud-based platform for digital workflows

About ServiceNow

ServiceNow offers a cloud-based platform that helps businesses automate and manage their operations, improving efficiency and enhancing customer and employee experiences. The Now Platform includes applications for IT operations, customer service, human resources, and security operations, all accessible over the internet. Targeting large enterprises across various industries, ServiceNow operates on a software-as-a-service (SaaS) model, generating revenue through subscription fees and professional services. The company's goal is to streamline business processes and drive digital transformation for its clients.

Santa Clara, CaliforniaHeadquarters

2004Year Founded

$81.5MTotal Funding

IPOCompany Stage

Consulting, Consumer Software, Enterprise SoftwareIndustries

10,001+Employees

Benefits

Generous family leave

Flexible PTO

Matched Donations

Retirement benefits

Annual learning stipends

Paid volunteer time

Risks

Competitors like Nvidia and Google Cloud may outpace ServiceNow in AI advancements.

Over-reliance on AWS infrastructure could pose risks if AWS changes its strategy.

The departure of Era Software's co-founder may lead to strategic shifts within ServiceNow.

Differentiation

ServiceNow's Now Platform offers comprehensive digital workflow solutions across multiple business functions.

The company focuses on large enterprises, providing tailored solutions for diverse industries.

ServiceNow's SaaS model ensures steady recurring revenue through subscription fees.

Upsides

ServiceNow's partnership with AWS enhances AI-powered workflows, driving enterprise innovation.

The integration with Crowe Cyber Economic Risk Analyzer boosts ServiceNow's cybersecurity capabilities.

ServiceNow's AI-driven campaign with Idris Elba increases brand visibility and engagement.

Land your dream remote job 3x faster with AI

Try Jobo Free