Software Quality Engineer

ZipLiens•Franklin, TN

2d•$77,000 - $104,000

About The Position

Zipliens is seeking a Quality Engineer to own quality for a feature or product area within its legal-industry applications. The role combines exploratory testing and automation, with responsibility for the risk-based test strategy, regression scope, automated test suites, and release sign-off. The engineer will work as an embedded member of an engineering team, build on established testing patterns and suites, and help improve them as the team scales. The product uses large language models to extract structured information from medical records and lien correspondence. The role therefore includes evaluating non-deterministic LLM output and developing evaluation suites, acceptance thresholds, human-label comparisons, and adversarial test cases. The engineer will also use agentic coding tools to build and maintain automation, review AI-generated tests, and help improve the tools and internal testing harnesses. The position involves close day-to-day collaboration with engineers and product, early participation in refinement, defect management, and communicating risks to technical and non-technical stakeholders.

Requirements

At least 3 years on a QA or software development team, including experience owning test coverage for a feature or product area.
Strong skills in at least one of exploratory testing and test design, test automation and infrastructure, or AI/LLM evaluation, and working proficiency in a second.
Hands-on experience building and maintaining automated test suites using a modern framework such as Playwright, Cypress, pytest, or similar, including diagnosing flaky tests and fixing root causes.
Comfort reading and writing code, and reading changes in Python/Django or React to understand their impact and risks.
Experience integrating tests into CI pipelines and deciding which checks should gate a merge or deployment.
Strong SQL skills and ability to verify data in PostgreSQL as well as application UI behavior.
Hands-on experience testing LLM or ML features, including building golden datasets, measuring output quality, and understanding failure modes.
Experience using or experimenting with agentic coding tools and sound judgment about reviewing their output.
Clear written communication for defect reports, test plans, release sign-offs, and explaining risk to non-technical stakeholders.
Authorization to work in the United States without employer-sponsored visa support now or in the future.

Nice To Haves

Experience testing document processing or extracting information from unstructured data.
Experience testing third-party integrations, including use of contract tests, sandboxes, or recorded fixtures when documentation is limited.
Familiarity with AWS and Kubernetes, including reading logs and investigating where failures occurred.
Experience handling sensitive data such as PHI or working under HIPAA-style requirements.

Responsibilities

Own quality for a feature or product area, including its risk-based test strategy, regression scope, and release sign-off.
Build and maintain automated test suites for the assigned area and integrate them with CI.
Troubleshoot failing or flaky tests and fix their underlying causes.
Perform exploratory testing of lien workflows and develop a detailed understanding of the applications, risk areas, and failure modes.
Test LLM-based features by building evaluation suites, setting acceptance thresholds with product, checking LLM-judge agreement against human labels, and adding adversarial and prompt-injection cases.
Use agentic coding tools to build and maintain automation, review AI-generated tests before they merge, and help improve the tools and harnesses.
Participate in refinement with the Product Owner to shape acceptance criteria, identify testability gaps, and recommend test coverage and risk priorities.
Manage defects for the assigned area from triage through resolution and write clear, reproducible reports.
Work directly with engineers as an embedded member of the engineering team.