QA Engineer, AI & Platform Infrastructure
About The Position
The QA Engineer is a hands-on, engineering role integrating test automation, software quality assurance, and platform reliability engineering. The role involves close interaction with backend, frontend, AI/ML, and DevOps engineering functions. The QA Engineer will serve as the subject matter expert (SME) for quality assurance activities across the organization's AI platform and web applications and will work with cross-functional teams to ensure successful delivery of reliable, performant software. The QA Engineer will support engineering leadership in driving appropriate quality standards, preparing and adhering to test plans and schedules, building automated test infrastructure, and providing technical support for daily development and release operations across a modern stack spanning Docker, Kubernetes, Next.js, Svelte, Bun, Python, TypeScript, React, and AI frameworks including LangChain, CrewAI, and LlamaIndex.
Requirements
- Bachelor’s degree in computer science, Software Engineering, or a related field is required.
- 3+ years of experience in software QA or test automation is required.
- Experience with containerized environments (Docker, Docker Compose, Kubernetes) is required.
- Experience with Python and TypeScript for writing tests and automation scripts is required.
- Experience with modern web frameworks (React, Next.js, Svelte) and E2E/UI testing tools such as Playwright or Cypress is required.
- Experience with CI/CD workflows (GitHub Actions, Jenkins, or similar) is required.
- Excellent interpersonal skills and ability to work effectively in a collaborative team environment.
- Excellent technical writing, communication, and organizational skills.
- Demonstrated deep technical knowledge of test automation principles, frameworks, and tooling.
- Strong knowledge of API testing frameworks (e.g., Pytest, Postman, REST Assured).
- Familiarity with observability and monitoring tools (Prometheus, Grafana, OpenTelemetry).
- Strong analytical and problem-solving skills, with experience validating asynchronous or distributed systems.
- Strong leadership skills and the ability to influence quality standards across engineering teams.
Nice To Haves
- Experience with AI systems testing, particularly LangChain, CrewAI, or LlamaIndex, is preferred.
- Experience with performance testing or benchmarking AI-driven applications is preferred.
Responsibilities
- Subject Matter Expert for the design, maintenance, and implementation of automated and manual test frameworks covering backend APIs, frontend components, containerized services, and AI/LLM-powered workflows.
- Design, implement, and maintain CI/CD-integrated QA pipelines using Docker Compose and Kubernetes environments.
- Conduct performance and load testing for containerized and GPU-enabled applications, identifying bottlenecks and reliability risks.
- Validate AI workflow correctness, including LangChain pipelines, CrewAI task orchestration, and LlamaIndex document processing flows.
- Develop internal testing tools and frameworks in TypeScript, Python, or Bun to improve platform reliability and developer velocity.
- Reproduce, isolate, and report defects with high-quality context; work closely with developers to drive rapid resolution.
- Consult and collaborate with SMEs across Engineering, Product, DevOps, and AI/ML teams to define quality standards and establish test plans for new services and UI components.
- Lead the creation, modification, and maintenance of QA documentation, including test plans, test case libraries, defect reports, and quality metrics dashboards.
- Influence cross-functional groups regarding testability, technical feasibility, and quality requirements during design and development phases.
- Assist with the planning and implementation of QA-driven process improvements and tooling upgrades in collaboration with cross-functional teams.
- Lead integration, regression, and acceptance testing activities for new features and infrastructure changes.
- Provide technical mentoring and oversight to less experienced engineers on testing best practices, tooling, and defect management.
- Create, edit and adhere to Standard Operating Procedures (SOPs), process improvements, and standardization of templates.
- Performs ad-hoc and cross-functional duties and/or projects assigned to support business needs and provide developmental opportunities.
Benefits
- Medical, Dental and Vision Plan Options
- Health and Financial Wellness Programs
- Employer Assistance Program (EAP)
- Company Paid and Voluntary Life/AD&D, Short-Term and Long-Term Disability
- Healthcare and Dependent Care Flexible Spending Accounts
- 401(k) Retirement Plan with Company Match
- 529 Education Savings Program
- Voluntary Legal Services, Identity Theft Protection, Pet Insurance and Employee Discounts, Rewards and Perks
- Paid Time Off (PTO) includes: 11 Holidays
- Exempt Employees are eligible for Unlimited PTO
- Non-Exempt Employees are eligible for 10 Vacation Days, 56 Hours of Health Pay, 2 Personal Days and 1 Cultural Day
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Entry Level
