Agentforce Salesforce Quality Assurance Tester

Cherokee Federal•United States,

6d•$100,000 - $120,000•Remote

About The Position

Cherokee Federal is seeking a Salesforce QA Tester to support a federal Agentforce initiative, delivering AI agent capabilities on the Salesforce Public Sector Solutions platform. This role is responsible for developing and executing test plans; testing Agentforce agents, including topic and action routing and grounded prompt output; validating supporting Salesforce configuration and custom development (Flow, Apex, LWC, SOQL); testing integrations; managing defects; and ensuring quality across Agile releases. Ideal candidates have hands-on Salesforce QA experience, exposure to testing AI or agent-based systems, knowledge of Salesforce automation and integrations, experience with Jira or Azure DevOps, and the ability to support testing in a regulated federal environment. This position requires U.S. Citizenship AND Secret Clearance and is pending a contract award.

Requirements

Bachelor's degree with preferred study in Computer Science, Information Science, Information Systems Management, Math, Statistics, Operations Research, or Engineering and a minimum of four (4) years of experience. Six (6) years of work experience in a related field may be substituted for education.
Demonstrated experience performing QA and testing in an Agile delivery environment, including test planning, test case development, and defect management.
Proven ability to design and execute test cases from user stories and acceptance criteria, including exception paths.
Hands-on experience testing Salesforce applications, including declarative configuration and automation such as Salesforce Flow.
Experience validating custom development (Apex, Lightning Web Components, triggers) and performing backend validation using SOQL.
Experience testing Salesforce integrations with external systems (e.g., MuleSoft, REST/SOAP APIs).
Experience with defect-tracking and test-management tools (e.g., Jira, Azure DevOps, TestRail).
U.S. Citizenship is required.
Must pass pre-employment qualifications of Cherokee Federal.
Secret Clearance required.

Nice To Haves

Hands-on experience testing Agentforce agents or other conversational AI / LLM-based systems.
Familiarity with Agentforce Testing Center, Prompt Builder, and Data Cloud grounding.
Working understanding on how to test non-deterministic AI output (grounding, hallucination, evaluation methodology).

Responsibilities

Develop, maintain, and execute comprehensive test plans, test cases, and test scripts across Salesforce configuration, customization, and integration work throughout the release lifecycle.
Work with government leads and Product Owners to understand acceptance criteria, clarify testing scope, and confirm release timing for new enhancement requests.
Perform functional, regression, integration, end-to-end, and user acceptance testing (UAT) support across sprints and Salesforce releases.
Validate declarative configuration and automation, including Flow (record-triggered, screen flows, scheduled flows), approvals, validation rules, page layouts, and Lightning App Builder, ensuring intended behavior and operational accuracy.
Test custom development, including Apex, Lightning Web Components, and triggers, and perform backend validation using SOQL as needed.
Validate integrations between Salesforce and external systems (e.g., MuleSoft, REST/SOAP APIs, middleware), confirming data integrity across systems.
Test Agentforce agents, validating that natural-language utterances select the correct topic and invoke the correct action (Apex action, Flow, or prompt template), including near-miss utterances that should not trigger an action.
Validate prompt templates built in Prompt Builder for accuracy and proper grounding in source data (e.g., Data Cloud); test for hallucinated, incomplete, or off-topic responses.
Test agent guardrails and scope adherence, confirming agents decline out-of-scope requests and do not surface data outside authorized boundaries.
Design and execute agent test cases using Agentforce Testing Center, including batch evaluation against expected outcomes and multi-turn conversation flows.
Establish evaluation criteria for non-deterministic outputs (grounding, accuracy, completeness) rather than relying solely on exact-match assertions.
Log, track, and manage defects through resolution using tools such as Jira or Azure DevOps; clearly document reproduction steps, severity, and expected versus actual results.
Verify data integrity and reporting/dashboard accuracy, including exception paths and operational reporting needs.
Support Salesforce Public Sector Solutions activities, including release readiness, deployment validation across sandboxes and production, and post-release stabilization.
Ensure test coverage and QA practices are scalable, maintainable, and aligned with governance, auditability, and compliance expectations in a regulated environment.
Present formal and informal oral and written briefings to government managers; produce executive-ready test summaries, defect reports, and quality status updates.
Perform other job-related duties as assigned.