Overview
We are seeking an experienced Quality Assurance (QA) Engineering Sr Manager to lead our QA organization with a focus on both traditional software platforms and emerging AI-powered systems, including agentic AI. This person will play a key leadership role in ensuring the quality, reliability, and performance of our diverse technology portfolio. You will collaborate with a dynamic team of developers, engineers, product managers, and AI specialists to design, implement, and maintain comprehensive QA strategies across our product ecosystem. The ideal candidate should demonstrate a proven track record of building high-performance QA teams and frameworks, with expertise in both traditional software testing and emerging AI validation approaches, including the testing of autonomous AI agents.
Primary Responsibilities
- Lead and develop a team of QA engineers, providing mentorship, technical guidance, and career development opportunities
- Establish and maintain QA best practices, testing standards, and quality metrics across the organization
- Design and implement comprehensive test strategies spanning manual testing, automated testing, performance testing, and specialized AI system validation
- Develop validation approaches for AI agents, including testing decision-making capabilities, workflow orchestration, and interaction with other systems
- Collaborate with cross-functional teams to integrate quality assurance into all stages of the software development lifecycle
- Define and track quality metrics and KPIs to continuously improve product quality and team performance
- Implement automated regression testing frameworks that can effectively validate both deterministic software behavior and probabilistic AI outputs
- Evaluate, select, and implement testing tools and frameworks that enhance testing efficiency and effectiveness
- Develop and maintain test infrastructure and environments to support testing activities across all systems
- Design evaluation protocols that address unique testing requirements for AI components and agent behaviors, such as detecting capability degradation over time
- Develop strategies to identify and mitigate quality risks, working proactively to prevent defects rather than just finding them
- Participate in release planning and management, ensuring that quality gates are defined and met
Minimum Qualifications
10+ years of professional QA engineering experience, with at least 3 years in a leadership roleStrong knowledge of QA methodologies, testing techniques, and industry best practicesExperience with test automation frameworks and tools for web, mobile, and API testingExperience with continuous integration / continuous deployment (CI / CD) processes and toolsUnderstanding of AI system evaluation approaches and metricsSome exposure to testing AI agents and autonomous systemsProficiency in at least one programming / scripting language such as Python, Java, or JavaScriptStrong understanding of software development lifecycle methodologies (Agile, DevOps, etc.)Bachelor's degree in Computer Science, Engineering, or a related fieldPreferred Qualifications :
Experience with cloud testing strategies and tools (AWS, Azure, etc.)Knowledge of performance testing, security testing, and accessibility testing methodologiesExperience with QA in AI / ML environments, including testing of models and algorithmsFamiliarity with validation methods for AI agents, including testing of decision-making processes and autonomous actionsExperience with observability tools and techniques for monitoring system behavior and agent activitiesKnowledge of synthetic data generation for testing purposesUnderstanding of testing approaches for conversational AI and agentic workflowsCertifications in quality assurance or project management (ISTQB, PMP, etc.)Strong analytical and problem-solving skills with attention to detailExcellent communication and interpersonal skills, with the ability to communicate effectively with technical and non-technical stakeholdersThis role offers an opportunity to shape quality practices in a forward-thinking organization and make a significant impact on product excellence and customer satisfaction across our entire technology portfolio, including our cutting-edge AI agent systems.Physical Demands
Physical demands include a considerable amount of time sitting and typing / keyboarding, using a computer (e.g., keyboard, mouse, and monitor), or mobile devicePhysical demands with activity or condition may occasionally include walking, bending, reaching, standing, squatting, and stoopingMay require occasional lifting / lowering, pushing, carrying, or pulling up to 20lbs