Senior Test Automation Developer

MNP•Calgary, AB

7d•Hybrid

About The Position

Inspirational, innovative and entrepreneurial - this is how we describe our empowered teams. Combine your passion with purpose and join a culture that is thriving in the face of change. Make an impact with our Technology - Development team as a Senior Test Automation Developer. This diverse team of tech-savvy builders and problem solvers embraces digital transformation, and the possibilities technology brings to the future of our industry. We’re looking for team members who have a strong sense of ownership and drive, and who thrive on delivering high-quality solutions that are redefining the way MNP does business. MNP is proudly Canadian. Providing business strategies and solutions, we are a leading national accounting, tax and business advisory firm in Canada. Entrepreneurial to our core, our talented team members transcend obstacles into opportunities and are successfully transforming mid-market business practices.

Requirements

10+ years of experience in software testing, with 8+ years of strong expertise in automation
Bachelor’s degree in computer science, engineering or other equivalent combination of education and work experience
Exposure to AI-assisted development and testing tools such as Claude, GitHub Copilot, or Codex, with familiarity in automated scripts
Hands-on experience with LLM evaluation frameworks and tools, including assessing model performance, accuracy, relevance, and reliability
Strong understanding of AI safety and security concepts, including guardrail evaluation, prompt injection testing, jailbreak detection, data leakage prevention, and responsible AI validation
Strong hands-on experience with automation tools such as Playwright or Selenium
Proficiency in programming languages such as Java or Python
Proven experience designing and maintaining automation frameworks from scratch
Strong understanding of test architecture, design patterns (POM, BDD), and scalable automation design principles
Strong experience working in Agile and DevOps environments
Experience integrating automation with CI/CD pipelines (Azure DevOps, GitHub Actions, etc.)
Strong experience debugging and optimizing automation execution in CI/CD pipelines
Ability to identify, document, and track defects using Azure DevOps or Jira
Strong expertise in API testing (REST/SOAP) using Postman, RestAssured, Swagger, etc.
Working knowledge of relational databases (SQL Server, MySQL, etc.)
Experience ensuring traceability between requirements, test cases, and defects
Strong analytical, debugging, and problem-solving skills
Proven ability to mentor team members and drive technical improvements
Excellent communication and collaboration skills across cross-functional teams

Responsibilities

Design, develop, and maintain scalable, reusable automation frameworks for UI, API, and integration testing
Contribute to automation strategy and drive implementation across assigned projects
Build and execute end-to-end automation suites covering critical business workflows
Integrate automation frameworks into CI/CD pipelines for continuous testing and delivery
Analyze failures, debug issues, and ensure high stability and reliability of automation suites
Identify gaps in automation coverage and drive improvements in test strategy and execution
Collaborate with developers, product teams, and DevOps to ensure testability and quality from early stages (shift-left)
Review requirements and design documents, providing technical feedback and risk assessment
Conduct code reviews for automation scripts ensuring adherence to standards and best practices
Mentor and support team members on automation best practices, frameworks, and tools
Track and report automation metrics including coverage, stability, and execution results
Ensure efficient test data management and environment configuration
Work with Docker containers for test execution, environment setup, and CI/CD integration
Contribute to QA standards, governance, and process improvements across teams
Support non-functional testing (performance, scalability) where applicable
Work in a fast-paced environment, balancing automation and hands-on QA responsibilities
Lead the testing and evaluation of AI-powered applications by validating model performance, security controls, AI guardrails, prompt robustness, and adherence to responsible AI practices
Collaborate with development and business teams to define test scenarios, execute test plans, and support successful deployment of UiPath and Microsoft Power Platform solutions