QA Engineer

Intercontinental Exchange Holdings, Inc. • Atlanta, KS

6d

About The Position

We are seeking a QA Engineer with experience testing LLM-based software. As a member of the QA team, you will participate in projects that use LLMs to solve complex engineering problems. You will create and execute automated tests for these applications and contribute to creating and improving the prompts that drive them.

Requirements

• Bachelor’s degree in a STEM field.
• 3+ years of experience in QA and QA automation.
• Experience using Agentic AI tools to build test automation tools.
• Proficiency in Python.
• Ability to learn quickly and adapt to new technologies and processes, while keeping up to date with the latest developments in LLM-related technologies.
• Ability to independently learn new complex business domains.
• Strong problem-solving skills and attention to detail.
• Excellent communication and teamwork skills.
• Ability to communicate fluently and professionally in complex technical and business contexts.

Nice To Haves

• Knowledge of fixed income markets and financial instruments.

Responsibilities

• Implement automated test frameworks and take ownership of existing frameworks for LLM-based applications.
• Implement automated tests that use AI to reason about the correctness of LLM-generated information.
• Improve testing methodologies for LLM-based applications.
• Participate in designing and improving prompts used in LLM-based applications.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level