AI Chatbot Tester

MCI Careers • ,

3d • Onsite

About The Position

MCI is seeking an AI Chatbot Tester to evaluate, validate, and improve AI-powered chatbot and conversational AI solutions. This role focuses on ensuring chatbot responses are accurate, reliable, compliant, and aligned with business requirements and user expectations. The successful candidate will play a key role in maintaining quality standards and enhancing customer experiences across AI-driven interactions. To be considered for this role, you must complete a full application on our company careers page, including all screening questions and a brief pre-employment test.

Requirements

• Diploma or Bachelor's Degree in Information Technology, Quality Assurance, Communications, Business, or related field.
• Experience in software testing, QA, customer experience, or chatbot evaluation.
• Strong attention to detail.
• Excellent written communication skills.
• Analytical and problem-solving abilities.
• Experience documenting defects and test outcomes.
• Ability to follow testing methodologies and processes.
• Strong organizational skills.
• Ability to work independently and collaboratively.
• Basic understanding of AI and chatbot technologies.
• Experience using productivity and reporting tools.
• Customer-focused mindset.
• Must be authorized to work in the country where the job is based.
• Subject to the program and location of the position
• Must be willing to submit up to a LEVEL II background and/or security investigation with a fingerprint. Job offers are contingent on background/security investigation results.
• Must be willing to submit to drug screening. Job offers are contingent on drug screening results. (Does not apply in Canada)

Nice To Haves

• Experience testing AI chatbots or virtual assistants.
• Knowledge of prompt engineering principles.
• Familiarity with Generative AI technologies.
• Experience with QA management tools.
• Exposure to conversational design principles.
• Knowledge of user experience testing methodologies.
• Experience within technology or BPO environments.
• Understanding of AI evaluation metrics.

Responsibilities

• Execute test plans and chatbot evaluation scenarios.
• Assess response quality and conversational effectiveness.
• Validate chatbot functionality across use cases.
• Identify defects, inconsistencies, and performance issues.
• Conduct regression and user acceptance testing.
• Verify compliance with business requirements.
• Document test results and findings.
• Support issue resolution activities.
• Review chatbot interactions and user journeys.
• Identify gaps in conversational flows.
• Recommend improvements to responses and workflows.
• Analyze trends and recurring issues.
• Work closely with AI trainers and prompt engineers.
• Provide testing feedback to development teams.
• Participate in quality review sessions.
• Prepare reports and performance insights.
• Support chatbot optimization initiatives.
• Contribute to testing standards and best practices.
• Stay informed about conversational AI developments.
• Assist with evaluation framework improvements.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level