AI Tester / AI QA Analyst

MCI Careers • ,

3d • Onsite

About The Position

MCI is seeking an AI Tester / AI QA Analyst to ensure the quality, reliability, and effectiveness of AI-powered products, machine learning models, and Generative AI applications. This role is responsible for validating AI functionality, identifying defects, and ensuring AI systems meet business, user, and compliance requirements. The successful candidate will play a critical role in delivering trustworthy AI solutions that provide exceptional user experiences. To be considered for this role, you must complete a full application on our company careers page, including all screening questions and a brief pre-employment test.

Requirements

• Bachelor's Degree in Information Technology, Computer Science, Quality Assurance, Engineering, or a related field.
• Minimum 3 years of software testing, QA, or technology-related experience.
• Experience creating and executing test plans and test cases.
• Strong analytical and troubleshooting skills.
• Experience documenting defects and test outcomes.
• Understanding of software development lifecycle methodologies.
• Familiarity with AI, machine learning, or Generative AI concepts.
• Strong attention to detail.
• Ability to analyze large volumes of information and identify patterns.
• Strong written and verbal communication skills.
• Experience working within Agile environments.
• Ability to collaborate effectively with technical teams.

Nice To Haves

• Experience testing AI or machine learning solutions.
• Knowledge of chatbot testing and conversational AI evaluation.
• Experience with QA automation tools.
• Familiarity with prompt engineering concepts.
• Understanding of AI governance and compliance requirements.
• Experience within SaaS, technology, or BPO environments.
• Certifications in software testing or quality assurance.
• Exposure to AI evaluation frameworks.

Responsibilities

• Ensure AI systems perform as expected across multiple use cases.
• Design and execute AI testing strategies and test cases.
• Validate model outputs against expected outcomes.
• Assess system reliability, consistency, and performance.
• Identify defects, anomalies, and areas for improvement.
• Support the delivery of high-quality AI solutions.
• Conduct functional, regression, and user acceptance testing.
• Verify compliance with business and regulatory requirements.
• Maintain testing documentation and evidence.
• Support release readiness assessments.
• Provide insights into AI system effectiveness.
• Analyze testing results and identify trends.
• Develop reports and recommendations.
• Track quality metrics and performance indicators.
• Support root cause analysis activities.
• Work closely with technical and business teams.
• Collaborate with AI engineers and product managers.
• Participate in requirements and solution reviews.
• Provide feedback throughout the development lifecycle.
• Support continuous quality improvement initiatives.
• Help advance AI testing practices across the organization.
• Evaluate new AI testing methodologies and tools.
• Recommend enhancements to quality frameworks.
• Stay informed about AI and Generative AI developments.
• Contribute to best practices and standards.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level