Intermediate QA Analyst - Contract (6 months)

Environics Analytics•Toronto, ON

3d•CA$76,000 - CA$93,000

About The Position

The QA Analyst will be an integral part of the product development team, ensuring high-quality delivery across modern, AI-driven applications. This role focuses on validating core application features, agent-based workflows, and automation frameworks, alongside traditional manual testing in a fast-paced Agile environment. The ideal candidate is detail-oriented, proactive, and comfortable working with emerging technologies such as AI/ML systems, prompts, and agent-based workflows, while maintaining strong fundamentals in QA practices.

Requirements

Bachelor’s degree in Computer Science, Engineering, or related field (or equivalent experience)
3+ years of experience in software QA (manual + automation)
Strong experience in manual testing (functional, regression, exploratory)
Hands-on experience with Playwright (preferred) or similar automation frameworks
Experience testing modern web applications (UI + backend integration)
Basic understanding of AI/ML concepts, LLMs, or prompt-based systems
Experience testing AI features, recommendations, or conversational systems is a strong asset
Familiarity with agent-based workflows or automation tools involving AI is highly desirable
Experience with API testing (preferred) (Postman or Swagger)
Working knowledge of SQL and data validation
Familiarity with CI/CD pipelines and automated test execution
Experience with Agile methodologies and tools such as Azure DevOps
Strong problem-solving and debugging skills, especially for non-deterministic AI outputs
Ability to think critically about edge cases, data variations, and unexpected system behavior
Excellent communication skills (verbal and written)
Strong attention to detail and organizational skills
Ability to work collaboratively across teams in a fast-paced environment
Curiosity and willingness to learn emerging AI testing practices and tools

Nice To Haves

Playwright (preferred)
API testing (Postman or Swagger)
Experience testing AI features, recommendations, or conversational systems
Familiarity with agent-based workflows or automation tools involving AI

Responsibilities

Perform manual testing of web applications, including UI, functional, exploratory, and regression testing
Validate AI-driven features, including prompt-based outputs, recommendations, and decision workflows
Test and verify agent-based systems and integrations, ensuring accuracy, reliability, and edge-case handling
Create and execute test plans, test cases, and test scenarios with clear coverage of AI behaviors and expected outcomes
Design, develop, and maintain automated test scripts using Playwright
Identify and document defects with detailed steps, logs, and supporting evidence
Collaborate with developers, product managers, and stakeholders to understand requirements and clarify expected AI behavior
Participate in Agile ceremonies (daily stand-ups, sprint planning, retrospectives, defect triage)
Validate backend data flows and integrations where applicable
Continuously improve QA processes, especially around AI testing strategies and automation coverage
Perform risk analysis for AI-related features (e.g., unexpected outputs, inconsistencies, performance concerns)