Business Analyst – Verification Engineer

BLN24•Mclean, VA

12d•Remote

About The Position

BLN24 is seeking a Business Analyst – Verification Engineer (Quality Assurance) to support human-level validation activities associated with Gen-AI led test-driven design processes. In this role, you will ensure AI-generated outputs are thoroughly evaluated, validated, and consistently aligned with established system expectations, business requirements, and operational workflows. The ideal candidate will collaborate closely with cross-functional teams, including developers, business analysts, product owners, and AI engineering teams to identify discrepancies, analyze AI-generated results, and refine verification processes that uphold system integrity and quality. This position requires strong analytical skills, attention to detail, and the ability to design and execute validation scenarios that challenge both AI-driven outputs and underlying system logic.

Requirements

Bachelor’s degree in information systems, Computer Science, Business, Engineering, or related field.
1+ year of experience in Quality Assurance, Verification & Validation (V&V), Business Analysis, or software testing.
Experience supporting human-level validation or QA processes for AI-driven or automated systems.
Familiarity with test-driven development methodologies and QA best practices.
Knowledge of automated testing tools, validation frameworks, or AI model evaluation concepts.
Experience with defect tracking and collaboration tools such as Jira, Azure DevOps, or similar platforms.
Strong analytical, troubleshooting, and communication skills.
Ability to work collaboratively within cross-functional Agile teams.

Nice To Haves

Experience with AI/ML-enabled systems or Gen-AI validation processes.
Experience supporting Federal or enterprise environments preferred.

Responsibilities

Support human-level validations for Gen-AI led test-driven design processes.
Ensure AI-generated output consistently aligns with business and system expectations.
Collaborate with cross-functional teams to refine and validate AI-driven solutions.
Identify, analyze, document, and report discrepancies between AI outputs and expected system behaviors.
Develop and execute test cases, validation scenarios, and quality assurance procedures.
Support continuous improvement of verification methodologies, validation frameworks, and QA processes.
Participate in requirements analysis, workflow validation, and user acceptance testing activities.
Assist with tracking validation results, defects, and remediation activities using issue management tools.
Analyze system behaviors, AI responses, and operational outcomes to improve solution accuracy and reliability.
Support Agile development and iterative testing processes within AI-enabled environments.