AI QA Engineer

Litify

1d•$100,000 - $110,000•Remote

About The Position

Litify is seeking an AI QA Engineer to join their Product & Engineering team. This is a significant role focused on AI-first quality assurance within an agile squad, responsible for the quality of their legal software built on the Salesforce platform. The position involves a shift from traditional manual testing to an AI-augmented model, where AI agents conduct initial test passes and human QA engineers focus on reviewing AI outputs, exploratory testing, and making critical quality judgments. The role requires a hands-on approach in a team-oriented, fast-paced agile environment, with the opportunity to lead teammates through this transformation. The candidate will be responsible for reviewing and validating AI test outputs, identifying gaps, performing targeted exploratory testing, and building scalable Playwright automation. Familiarity with Salesforce is important, and the ideal candidate is excited about redefining QA for the future.

Requirements

3+ years of experience in a QA role with a strong foundation in manual and automated testing.
2+ years of hands-on experience with Playwright (preferred) or strong experience with a modern automation framework (Cypress, Selenium, WebdriverIO, etc.) and willingness to ramp quickly on Playwright.
Proven ability to create and own test plans, define test strategies, and make risk-based decisions about release readiness.
Familiarity with Xray or a comparable test management tool integrated with Jira.
Strong Jira proficiency, including ticket workflows, bug reporting, sprint board management, and defect classification.
Comfortable working in a fast-paced, highly collaborative, and dynamic Agile/Scrum environment.
A clear understanding of what it means to own "code quality" for a development team.
Strong verbal and written communication skills.
Ability to interact and coordinate test activities among multiple teams.

Nice To Haves

4+ years of experience with Playwright.
Experience with Salesforce or testing Salesforce-based applications.
Familiarity with Salesforce debugging logs or similar platform-level diagnostic tools.
Prior experience working within legal technology or document management products.
Experience with CI/CD pipelines and integrating automated tests into deployment workflows.
Familiarity with AI testing concepts such as output validation, hallucination detection, or confidence scoring.

Responsibilities

Review and validate AI-generated test results, assessing accuracy, completeness, and false positives/negatives.
Perform manual test case execution, targeted exploratory testing, and edge-case testing.
Own QA strategy and execution for the squad, including test planning, risk assessment, and release readiness decisions.
Write and maintain automated tests in Playwright, following Page Object Model (POM) design patterns.
Leverage AI development tools (Claude, GitHub Copilot) for test case generation, script writing, debugging, and coverage growth.
Report defects, track bugs, and provide suggestions for product enhancements.
Collaborate with development, product management, and delivery teams throughout the SDLC.
Communicate clearly and effectively, managing multiple projects and priorities independently.
Collaborate with the Customer Support team to triage complex application issues.