[Remote] Senior QA Analyst, AI & Threat Analytics at Keeper Security

United States

Apply Now

Not SpecifiedCompensation

N/AExperience Level

N/AJob Type

Not SpecifiedVisa

N/AIndustries

Requirements

3+ years of experience in QA, test automation or evaluation of complex systems
Hands-on experience writing Python automation or evaluation scripts for testing APIs, model outputs or data pipelines
Understanding of machine learning concepts such as classification, summarization, embeddings, anomaly detection or behavior analysis
Experience testing LLM-integrated features or AI-driven workflows
Familiarity with ML tooling such as Pytest, Hugging Face libraries, Jupyter Notebooks or similar
Experience with API testing, JSON validation and test data generation
Ability to test nondeterministic systems and evaluate model quality with structured methodologies
Strong analytical, troubleshooting and communication skills
Experience testing cloud-integrated applications or systems deployed on AWS
Bachelor’s degree

Responsibilities

Design and execute test plans for AI and ML-driven features, including classification, summarization, anomaly detection and autofill systems
Develop Python-based automation and evaluation scripts to validate model performance, reliability and output quality
Test LLM-based features for accuracy, guardrail effectiveness, hallucination risk and behavior under edge cases
Validate data pipelines, input/output transformations and model integration points across Keeper’s platform
Conduct regression testing on ML models and AI workflows to ensure reliability across releases
Test enterprise-scale behavior analysis features driven by data from ARAM, PAM and session recordings
Validate security, privacy and zero-trust requirements for AI model interactions and data handling
Collaborate with ML engineers and cross-functional teams to refine model behavior, identify defects and improve output quality
Analyze logs, metrics and model outputs to detect anomalies, performance issues or silent failures

Keeper Security

Cybersecurity solutions for data protection

About Keeper Security

Keeper Security provides cybersecurity solutions aimed at protecting sensitive data for individuals and businesses. Its main product is a zero-knowledge security platform, which means that the company cannot access the data stored by its users, ensuring high levels of privacy and security. This platform is scalable, allowing it to adapt to the needs of various organizations, from small businesses to large enterprises. Unlike many competitors, Keeper Security is recognized for its extensive audits and certifications, which enhance user trust. The company operates on a subscription-based model, offering tailored plans for personal, family, student, business, and enterprise use, with options for multi-year commitments that provide savings. The goal of Keeper Security is to deliver reliable data protection while ensuring continuous updates and support for its users.

Chicago, IllinoisHeadquarters

2011Year Founded

$58.6MTotal Funding

GROWTH_EQUITY_VCCompany Stage

CybersecurityIndustries

201-500Employees

Benefits

Health Insurance

Dental Insurance

Vision Insurance

Life Insurance

Disability Insurance

401(k) Retirement Plan

401(k) Company Match

Unlimited Paid Time Off

Risks

Emerging cybersecurity startups could erode Keeper's market share.

AI-driven cyber threats require Keeper to continuously adapt its security protocols.

Regulatory scrutiny on data privacy may increase Keeper's compliance costs.

Differentiation

Keeper Security offers a zero-knowledge security platform ensuring maximum data privacy.

The company is SOC-2 and ISO 27001 certified, enhancing trust and reliability.

Keeper's subscription model provides continuous updates and tailored plans for diverse customer needs.

Upsides

Growing demand for zero-trust architecture boosts Keeper's market potential.

Strategic partnerships, like with Sherweb, expand Keeper's market reach.

Increased cybersecurity needs in sectors like legal and sports enhance Keeper's relevance.

Land your dream remote job 3x faster with AI

Try Jobo Free