This is a specialized role for a Senior QA Engineer who wants to bridge the gap between traditional testing and AI/Machine Learning. You’ll need at least 3 year
Work type: remote
Location: Remote, US
Type: Full-time
This is a specialized role for a Senior QA Engineer who wants to bridge the gap between traditional testing and AI/Machine Learning. You’ll need at least 3 years of experience and a strong grasp of Python to validate nondeterministic systems, LLM outputs, and anomaly detection pipelines. This isn't a role for training models, but rather for ensuring their reliability, safety, and performance in a high-stakes cybersecurity environment. The position offers excellent flexibility with a fully remote US-based option or hybrid schedules in Chicago and El Dorado Hills. Because cybersecurity is a high-growth sector, the role includes "above-market" annual bonuses and a comprehensive benefits package. You’ll be working within a Zero-Trust framework, gaining experience with FedRAMP-authorized systems and cutting-edge AI guardrails. **You might be a good fit if you...** * Are proficient in Python for writing automation scripts and evaluating data pipelines. * Have experience testing LLM-integrated features (e.g., checking for hallucinations or guardrail effectiveness). * Can comfortably analyze logs and metrics within AWS environments to detect "silent" model failures. * Understand ML concepts like embeddings, classification, and vector databases.
Description
Keeper is hiring a talented Senior QA Analyst to join our AI & Threat Analytics team. This is a 100% remote position from select locations, with an opportunity to work a hybrid schedule for candidates based in the El Dorado Hills, CA or Chicago, IL metro areas.
Keeper’s cybersecurity software is trusted by millions of people and thousands of organizations globally. Keeper is published in 23 languages and sold in over 150 countries. Join one of the fastest-growing cybersecurity companies and help ensure the quality, safety, and reliability of Keeper’s next-generation AI features and threat analytics capabilities.
About Keeper
Keeper Security is transforming cybersecurity for organizations globally with zero-trust privileged access management built with end-to-end encryption. Keeper’s cybersecurity solutions are FedRAMP and StateRAMP Authorized, SOC 2 compliant, FIPS 140-2 validated, as well as ISO 27001, 27017 and 27018 certified. Keeper deploys in minutes, not months, and seamlessly integrates with any tech stack to prevent breaches, reduce help desk costs and ensure compliance. Trusted by millions of individuals and thousands of organizations, Keeper is the leader for password, passkey and secrets management, privileged access, secure remote access and encrypted messaging. Learn how our zero-trust and zero-knowledge solutions defend against cyber threats at [KeeperSecurity.com](http://keepersecurity.com).
About the Role
The Senior QA Analyst, AI & Threat Analytics will provide technical leadership for testing A.I and Machine Learning driven features across Keeper’s platform. This role focuses on validating the behavior, reliability, and quality of AI systems, including LLM-based summarization, classification, autofill, and behavior analysis pipelines. You will design and execute test strategies for nondeterministic systems, develop Python-based automation and evaluation tools, and validate model outputs, guardrails, and data flows. This role does not involve training models, but works closely with ML engineers, security teams, and product engineering to ensure AI features meet Keeper’s quality, safety, and performance standards in production environments.
Responsibilities