Software QA Analyst

Group 1001•Zionsville, IN

About The Position

Group 1001 is a consumer-centric, technology-driven family of insurance companies on a mission to deliver outstanding value and operational performance by combining financial strength and stability with deep insurance expertise and a can-do culture. Group1001’s culture emphasizes the importance of collaboration, communication, core business focus, risk management, and striving for outcomes. This goal extends to how we hire and onboard our most valuable assets – our employees. Why This Role Matters: We're building an agentic platform — an LLM agent runtime that reviews code, writes tests, and builds from tickets on real development repos — alongside the services that power it: a control plane that orchestrates agent runs, an intake registry that routes work requests through to automated fulfilment, and the integrations that tie them together. Someone has to make sure all of it actually works. This role owns that question across the stack — from "did the agent's code review make sense?" to "did the API return the right thing?" to "did the end-to-end flow complete without dropping state." You're the signal between what we ship and what's actually good.

Requirements

1-3 years of professional experience with software testing, QA tooling, or API test automation (Postman, pytest, httpx, or similar).
Attention to detail and the ability to read code across at least one language (Python or TypeScript preferred).
Comfortable with Git, HTTP/REST APIs, basic SQL, and Linux shell.
Writes things down clearly — test cases, failure patterns, improvement proposals.
Asks questions and communicates what's wrong without waiting to be asked.

Nice To Haves

Familiarity with LLMs or AI agents
Python or TypeScript
any CI/CD exposure
AWS basics (ECS, CloudWatch, Secrets Manager)

Responsibilities

Test the services we build — control plane APIs, intake registry, agent dispatch flows, webhook integrations — at the API and integration level.
Review agent output — code review comments, generated tests, draft MRs — and assess accuracy, relevance, and quality against the codebase and context.
Write and maintain test cases and evaluation criteria: API contracts, end-to-end flows, agent output quality for each agent type (reviewer, tester, builder).
Identify failure patterns across the stack: broken API responses, dropped state, hallucinations, missed issues, bad diffs. Log them clearly.
Work with the platform team to translate findings into fixes, guideline improvements, and guardrail changes.
Own tickets end-to-end: test plan → findings → documented change → verified improvement.
Sit in on design reviews; help define what "done well" looks like before work ships.