Automated Test Engineer 3

Leidos•Egg Harbor Township, NJ

About The Position

Looking for an opportunity to make an impact? At Leidos, we’re redefining what’s possible through innovation, collaboration, and a steadfast commitment to our customers’ success. Our people are our greatest asset — diverse, talented professionals empowered to drive change, strengthen communities, and operate with integrity and purpose. Guided by our Mission, Vision, and Values, we deliver solutions that make a measurable difference every day. If you’re looking for a dynamic environment where you can excel and grow, we invite you to learn more. Leidos is seeking an Automated Test Engineer (Level 3) to join our team in Egg Harbor Township, NJ, or Gaithersburg, MD supporting the verification, validation, and qualification of advanced systems within the National Airspace System (NAS). In this role, you’ll apply automated testing methodologies and AI/ML techniques to assess and enhance Air Traffic Control (ATC) modernization initiatives. The selected candidate will design, develop, and sustain automated test frameworks supporting AI- and ML-enabled capabilities that drive operational efficiency and decision-making—such as trajectory prediction, conflict detection, traffic flow management, and workload optimization. This position plays a critical role in ensuring compliance with FAA systems assurance, safety, and performance standards. If you’re ready for a challenging and rewarding opportunity that pushes the boundaries of innovation in aviation technology, we’d love to connect with you. Your most meaningful work is ahead! The Mission For more than five decades, Leidos has been a trusted partner in delivering advanced Air Traffic Management (ATM) systems for Air Navigation Service Providers (ANSPs) across the globe. Our solutions keep customers ahead of accelerating aviation demands by integrating proven, globally deployed technologies with next-generation capabilities co-developed alongside our ANSP and technology partners. From tower and terminal systems to en route, oceanic, and comprehensive flow control solutions, we’re helping define the future of safe and efficient airspace management. Explore more about our aviation innovations here! Join a team driven by mission and impact — share your resume today and take the next step in your career with Leidos.

Requirements

Due to US Government contract, must be a U.S. Citizen with the ability to obtain and maintain a Public Trust security clearance.
Bachelor’s degree in Computer Science, Systems Engineering, or related discipline, and at least 5 years of relevant experience (mid-to-senior level).
Demonstrated experience in automated testing, test framework development, and system-level verification of complex or safety-critical systems.
Strong understanding of AI/ML test methodologies, data preprocessing, and performance evaluation metrics.
Proficiency with scripting languages (Python, Bash) and automation tools (e.g., PyTest, Robot Framework, Jenkins, or similar).
Experience with Linux or Unix-based environments, containerization (Docker, Podman), and CI/CD pipelines.
Knowledge of simulation frameworks, test harness development, and data-driven test execution.
Excellent analytical, communication, and technical documentation skills.
Experience with Chaos Testing principles
Proficient in automated test engineering principles, system verification, and AI system validation.
Working knowledge of AI/ML model evaluation, data-driven testing, and automated test architectures is essential.

Nice To Haves

Experience with ATC, ATM, or aerospace system testing preferred.
Experience validating AI/ML algorithms or models in mission- or safety-critical contexts.
Familiarity with Model-Based Systems Engineering (MBSE) and system integration V&V processes.
Experience applying MLOps practices for continuous testing and deployment of AI models.
Knowledge of microservices architectures, message brokers, and RESTful API testing.
Prior exposure to FAA, NASA, or DoD test and evaluation (T&E) standards.
Experience preparing and executing Verification Cross Reference Matrices (VCRM) and Test Readiness Review (TRR) documentation.

Responsibilities

Responsible for DevOps-related activities both individually and as a member of an Agile team.
Design, develop, and maintain automated test suites and frameworks using Squish, Selenium, and CI (e.g. Jenkins, Gitlab) to ensure the quality and reliability of software applications
Develop System of Systems (SoS) Test Architecture to ensure Large Scale Effectivity
Implement AI tools to enhance test automation
Troubleshoot and debug automated tests to identify root causes of failures and ensure test reliability
Work closely and collaborate with development teams to identify and verify testable requirements
Implement automated testing solutions and ensure that the software is testable and meets the requirement verification needs of the product
Write and execute automated test scripts using various testing tools and frameworks
Maintain clear and concise documentation
Track issues
Manage VMs & dev containers
Use CI/CD tools
Maintain test artifacts such as Verification Requirements Test Matrix
Participate in daily stand-ups, Sprint Planning, Release Planning, and other related team activities
Develop, implement, and maintain automated test frameworks to support verification and validation (V&V) of complex AI/ML systems within ATC environments.
Design system-level and component-level test procedures, test cases, and data sets based on formal requirements and system specifications.
Lead efforts to evaluate AI/ML model behavior, accuracy, and performance under operationally representative scenarios and datasets.
Integrate automated test tools and continuous testing pipelines (e.g., CI/CD) to enhance system reliability and regression coverage.
Conduct root cause analysis and defect resolution in coordination with software, systems, and AI engineering teams.
Execute integration testing of distributed, safety-critical systems using containerized or virtualized environments.
Develop performance metrics, traceability matrices, and test reports in accordance with FAA, NASA, or DoD documentation standards.
Support test readiness reviews, system qualification events, and formal certification processes as required.
Assure the functional integrity, reliability, and safety of mission-critical ATC expansion systems.
Test results directly support system accreditation, operational readiness, and compliance with NAS modernization objectives.
Perform highly complex test engineering functions requiring in-depth knowledge of AI/ML-based systems and automation frameworks.
Develop innovative approaches to test design and data analysis to assess intelligent, adaptive system performance under dynamic conditions.
Interface with multidisciplinary engineering teams, program management, subcontractors, and government representatives.
Produce formal test documentation, analysis reports, and presentations in support of technical reviews and audits.