Miratech-posted 6 days ago
Full-time • Mid Level
Remote • Yakima, WA
501-1,000 employees

We are seeking a highly experienced Senior Quality Assurance Lead to drive the quality strategy, validation framework, and end-to-end testing of conversational AI solutions built on AWS Lex and Google Dialogflow (CX/ES). The ideal candidate will oversee the testing lifecycle for steering bots, skill bots, and multi-bot orchestration while ensuring accuracy, reliability, and high-quality conversational experiences across voice and chat channels. This role requires strong technical depth in bot testing, the ability to define QA best practices, and proven experience collaborating with cross-functional teams including solution architects, developers, and business stakeholders.

  • Lead the planning, design, and execution of test strategies, test plans, and test cases for AWS Lex and Google Dialogflow bots.
  • Oversee functional, regression, integration, and end-to-end testing across voice, chat, and web channels.
  • Validate conversation flows, NLU accuracy, intent mapping, slot filling, journey logic, and middleware/API integrations.
  • Review requirements, conversation designs, and user stories to ensure clarity, completeness, and testability.
  • Manage testing for multi-bot orchestration setups between steering and skill bots to ensure seamless user experiences.
  • Supervise and validate testing of voice interactions via platforms such as Amazon Connect, Google CCAI, or Genesys Cloud.
  • Drive defect identification, root cause analysis, reporting, and quality metrics using industry-standard QA tools.
  • Guide automation strategy and contribute to building automation scripts/frameworks where applicable.
  • Lead UAT cycles, prepare quality summary reports, and ensure delivery of bots that meet accuracy, latency, and experience benchmarks.
  • Mentor junior QA engineers and promote QA best practices, reusable patterns, and testing standards.
  • 8+ years of hands-on QA experience, including 3+ years leading QA efforts for conversational AI, IVR, or bot-based solutions.
  • Strong expertise in IVR testing platforms such as CYARA Velocity, CYARA Virtual Agent, and CYARA Cruncher.
  • 2+ years of hands-on testing experience with AWS Lex (V1/V2) and Google Dialogflow CX/ES.
  • Good understanding of conversation design, NLU/NLP concepts, intent handling, and model testing.
  • Experience validating integrations with AWS Lambda, API Gateway, Google Cloud Functions, or similar middleware components.
  • Strong skills in API testing (Postman, REST Assured) and automation frameworks (Selenium, PyTest, or equivalent).
  • Solid understanding of bot architecture, routing logic, and orchestration between multiple bots.
  • Excellent knowledge of QA methodologies, defect management practices, and detailed test documentation.
  • Experience working in Agile teams with tools like Jira and Confluence.
  • Strong communication, analytical thinking, leadership, and problem-solving abilities.
  • Exposure to conversational AI automation frameworks such as Botium, TestMyBot, or Voiceflow QA tools.
  • Familiarity with Google CCAI, Amazon Connect, or Genesys Cloud integrations.
  • Experience performing load, performance, or stress testing for voice/chat bots.
  • Understanding of CI/CD pipelines, CloudWatch, Dialogflow Analytics, or bot monitoring tools.
  • Basic scripting knowledge in Python or JavaScript for automation support.
  • Culture of Relentless Performance: join an unstoppable technology development team with a 99% project success rate and more than 30% year-over-year revenue growth.
  • Competitive Pay and Benefits: enjoy a comprehensive compensation and benefits package, including health insurance, and a relocation program.
  • Work From Anywhere Culture: make the most of the flexibility that comes with remote work.
  • Growth Mindset: reap the benefits of a range of professional development opportunities, including certification programs, mentorship and talent investment programs, internal mobility and internship opportunities.
  • Global Impact: collaborate on impactful projects for top global clients and shape the future of industries.
  • Welcoming Multicultural Environment: be a part of a dynamic, global team and thrive in an inclusive and supportive work environment with open communication and regular team-building company social events.
  • Social Sustainability Values: join our sustainable business practices focused on five pillars, including IT education, community empowerment, fair operating practices, environmental sustainability, and gender equality.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service