Talent.com
Sr. QA Manager Enterprise Data Services

Sr. QA Manager Enterprise Data Services

Southern Glazer’s Wine & SpiritsMiramar, FL, US
job_description.job_card.30_days_ago
serp_jobs.job_preview.job_type
  • serp_jobs.job_card.full_time
job_description.job_card.job_description

Overview

We are seeking an experienced Quality Assurance (QA) Engineering Sr Manager to lead our QA organization with a focus on both traditional software platforms and emerging AI-powered systems, including agentic AI. This person will play a key leadership role in ensuring the quality, reliability, and performance of our diverse technology portfolio. You will collaborate with a dynamic team of developers, engineers, product managers, and AI specialists to design, implement, and maintain comprehensive QA strategies across our product ecosystem. The ideal candidate should demonstrate a proven track record of building high-performance QA teams and frameworks, with expertise in both traditional software testing and emerging AI validation approaches, including the testing of autonomous AI agents.

Primary Responsibilities

  • Lead and develop a team of QA engineers, providing mentorship, technical guidance, and career development opportunities
  • Establish and maintain QA best practices, testing standards, and quality metrics across the organization
  • Design and implement comprehensive test strategies spanning manual testing, automated testing, performance testing, and specialized AI system validation
  • Develop validation approaches for AI agents, including testing decision-making capabilities, workflow orchestration, and interaction with other systems
  • Collaborate with cross-functional teams to integrate quality assurance into all stages of the software development lifecycle
  • Define and track quality metrics and KPIs to continuously improve product quality and team performance
  • Implement automated regression testing frameworks that can effectively validate both deterministic software behavior and probabilistic AI outputs
  • Evaluate, select, and implement testing tools and frameworks that enhance testing efficiency and effectiveness
  • Develop and maintain test infrastructure and environments to support testing activities across all systems
  • Design evaluation protocols that address unique testing requirements for AI components and agent behaviors, such as detecting capability degradation over time
  • Develop strategies to identify and mitigate quality risks, working proactively to prevent defects rather than just finding them
  • Participate in release planning and management, ensuring that quality gates are defined and met

Minimum Qualifications

  • 10+ years of professional QA engineering experience, with at least 3 years in a leadership role
  • Strong knowledge of QA methodologies, testing techniques, and industry best practices
  • Experience with test automation frameworks and tools for web, mobile, and API testing
  • Experience with continuous integration / continuous deployment (CI / CD) processes and tools
  • Understanding of AI system evaluation approaches and metrics
  • Some exposure to testing AI agents and autonomous systems
  • Proficiency in at least one programming / scripting language such as Python, Java, or JavaScript
  • Strong understanding of software development lifecycle methodologies (Agile, DevOps, etc.)
  • Bachelor's degree in Computer Science, Engineering, or a related field
  • Preferred Qualifications :

  • Experience with cloud testing strategies and tools (AWS, Azure, etc.)
  • Knowledge of performance testing, security testing, and accessibility testing methodologies
  • Experience with QA in AI / ML environments, including testing of models and algorithms
  • Familiarity with validation methods for AI agents, including testing of decision-making processes and autonomous actions
  • Experience with observability tools and techniques for monitoring system behavior and agent activities
  • Knowledge of synthetic data generation for testing purposes
  • Understanding of testing approaches for conversational AI and agentic workflows
  • Certifications in quality assurance or project management (ISTQB, PMP, etc.)
  • Strong analytical and problem-solving skills with attention to detail
  • Excellent communication and interpersonal skills, with the ability to communicate effectively with technical and non-technical stakeholders
  • This role offers an opportunity to shape quality practices in a forward-thinking organization and make a significant impact on product excellence and customer satisfaction across our entire technology portfolio, including our cutting-edge AI agent systems.
  • Physical Demands

  • Physical demands include a considerable amount of time sitting and typing / keyboarding, using a computer (e.g., keyboard, mouse, and monitor), or mobile device
  • Physical demands with activity or condition may occasionally include walking, bending, reaching, standing, squatting, and stooping
  • May require occasional lifting / lowering, pushing, carrying, or pulling up to 20lbs
  • serp_jobs.job_alerts.create_a_job

    Sr. QA Manager Enterprise Data Services • Miramar, FL, US