Test Automation Engineer

ICF•Reston, VA

8h•Remote

About The Position

The Digital Modernization Division at ICF is seeking a Test Automation Engineer to join their team. This role is contingent upon a contract award and involves accelerating the modernization of a large federal agency's enterprise data and analytics ecosystem. The cloud-based platform provides data storage, analytics, governance, and AI/ML capabilities. The team is focused on migrating legacy workloads, streamlining onboarding and support, expanding platform capabilities, and helping organizations adopt modern data and AI solutions at scale. The test automation engineer will implement automated testing, release validation, quality gates, rollback readiness checks, and release evidence capture for platform, application, data, and AI/ML work. They will also convert acceptance criteria into automated or repeatable tests and validate releases against functional, integration, security, accessibility, and load/performance expectations. Coordination with Agile Delivery Managers, Functional Leads, and SRE is also a key part of the role.

Requirements

U.S. Citizenship is required due to federal contract requirements.
Candidate must reside in the U.S., be authorized to work in the U.S., and all work must be performed in the U.S.
Candidate must have lived in the U.S. for three (3) full years out of the last five (5) years.
Bachelor's degree in Computer Science, Software Engineering, Information Systems, Quality Engineering, Computer Engineering, or related field; or a high school diploma with four (4) additional years of relevant experience in lieu of a bachelor's degree.
Minimum 6 years of relevant experience aligned to the responsibilities of this role.
Master's degree may substitute for two (2) years of relevant experience.

Nice To Haves

Experience designing, implementing, and maintaining automated testing frameworks and quality engineering practices for enterprise applications, data platforms, APIs, and cloud-native solutions.
Experience developing automated functional, regression, integration, end-to-end, smoke, and user acceptance testing solutions.
Experience translating business requirements, user stories, and acceptance criteria into automated and repeatable test cases and validation processes.
Experience implementing quality gates and automated validation controls within CI/CD pipelines using Azure DevOps, GitHub Actions, Jenkins, or similar DevSecOps platforms.
Experience performing release validation, deployment verification, rollback readiness testing, release certification, and release evidence collection.
Experience testing APIs, integrations, workflow automation solutions, data pipelines, and cloud-based services.
Experience supporting platform modernization, analytics, data engineering, and AI/ML initiatives through test automation and quality assurance practices.
Experience validating data quality, data transformations, reporting outputs, dashboards, and analytical workloads within enterprise data environments.
Experience performing non-functional testing including load testing, performance testing, scalability testing, resiliency testing, and accessibility validation.
Experience utilizing automated testing tools such as Selenium, Playwright, Cypress, Postman, REST Assured, JMeter, LoadRunner, or equivalent technologies.
Experience supporting cloud-based platforms and services including Azure, Databricks, APIs, workflow orchestration platforms, business intelligence tools, and enterprise applications.
Familiarity with AI/ML testing concepts including model validation, data validation, output verification, prompt evaluation, and responsible AI testing approaches.
Experience collaborating with Agile Delivery Managers, Product Managers, Functional Leads, Engineers, SRE teams, Security teams, and stakeholders to assess release readiness and quality risks.
Experience establishing quality metrics, release readiness criteria, testing dashboards, defect tracking processes, and quality reporting.
Experience documenting test results, quality findings, release evidence, defects, risks, and compliance artifacts to support auditability and continuous improvement.
Understanding of security testing, vulnerability validation, accessibility standards (Section 508), and compliance requirements within regulated environments.
Experience supporting Federal government, healthcare, or other highly regulated environments preferred.
Experience working in Agile, Scrum, SAFe, or cross-functional delivery teams.
Highly effective analytical, problem-solving, and decision-making capabilities.
Excellent written and verbal communication skills, with the ability to work effectively across technical and non-technical audiences.
Strong organization, attention to detail, and the ability to prioritize and manage multiple responsibilities.
Collaborative approach with a commitment to quality, accountability, and continuous improvement.

Responsibilities

Implements automated testing, release validation, quality gates, rollback readiness checks, and release evidence capture for platform, application, data, and AI/ML work.
Helps teams convert acceptance criteria into automated or repeatable tests and validates that releases meet functional, integration, security, accessibility, and load/performance expectations where applicable.
Coordinates release readiness with Agile Delivery Managers, Functional Leads, and SRE.
Applies Test automation, CI/CD quality gates, release validation, regression testing, integration testing, load testing, release evidence, and agile QA to support role delivery.
Collaborates with relevant product, engineering, security, governance, quality, and customer-facing stakeholders as required by the role.
Documents work products, decisions, risks, and delivery evidence to support traceability and continuous improvement.