Test Automation Engineer - Testing AI Agents

Codetech • Hartford, CT

7h

About The Position

The Test Automation Engineer will lead and represent QA across multiple Scrum teams, developing, executing, and analyzing automation tests, including tests for AI agents. The role involves Salesforce software quality assurance from planning through execution, as well as testing APIs and data integrations. The engineer will validate topic and action accuracy, refine tests based on results, ensure test data represents realistic user interactions, and generate prompts for execution using Test Center.

The position requires collaboration in an onshore/offshore support model and strong communication, leadership, and teamwork. The engineer will work in an Agile environment; SAFe experience is preferred. The role also requires understanding AI concepts and the non-deterministic nature of testing.

Requirements

• Five or more years of experience leading and representing QA for multiple Scrum teams.
• Strong experience testing AI agents and understanding AI concepts and the non-deterministic nature of testing.
• Experience in Salesforce software quality assurance from planning through execution.
• Hands-on experience with Selenium, Java, and JavaScript.
• Experience testing APIs and data integrations.
• Experience in test automation and test execution.
• Strong understanding of software testing methodologies and Agile principles.
• Experience working in an onshore/offshore support model and collaborating with offshore teams.
• Experience with test management tools, including the Rational tool suite and JIRA.
• Excellent communication and collaborative skills.
• Strong leadership skills, including motivating and inspiring team members, effective delegation, and conflict resolution.

Nice To Haves

• Experience with the SAFe methodology and working in a SAFe Agile environment.
• Experience testing customer support and contact center systems.
• Healthcare experience.

Responsibilities

• Lead and represent QA for multiple Scrum teams.
• Develop, execute, and analyze automation tests, including tests for AI agents.
• Perform Salesforce software quality assurance from planning through execution.
• Test APIs and data integrations.
• Validate topic and action accuracy, refine tests based on results, and ensure test data represents realistic user interactions.
• Generate prompts and use Test Center to execute them.
• Collaborate with offshore teams in an onshore/offshore support model.
• Motivate and inspire team members, delegate tasks effectively, and resolve conflicts.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed