Instructional Testing Expert

Amentum•Baltimore, MD

23h•$185,000 - $220,000

About The Position

Are you interested in using your skills to help shape the Cyber, Security, & Intel space? If you want to be part of a dynamic Team supporting engaging and cutting-edge training solutions, this is the place for you! We are currently seeking a Senior Instructional Testing Expert in Hanover, MD, to provide front-line, non-technical support for web-based and instructor-led training courses. The Senior Instructional Testing Expert will be part of a collaborative multidisciplinary Team delivering highly sophisticated, technical, hands-on training solutions to meet the mission and time-critical needs of our customers. Work Schedule: Attendance is critical at all times. Must be able to work a 40-hour workweek, normally Monday through Friday. However, times and days may vary depending on business requirements. Needs to be available to work overtime during critical peaks and be available to meet last minute requests for overtime should the situation occur. Essential Responsibilities: The Senior Instructional Testing Expert designs, develops, and revises tests and/or assessments for highly-technical evaluation programs. A qualified candidate must be fully cleared and possess a range of experience related to test design and exam item analysis methodologies to effectively support customers with rapidly evolving requirements. The Testing Expert will work closely with content developers and subject matter experts (SMEs) to design and develop formative and summative assessments. The Testing Expert conducts data gathering and needs analyses to ensure learning objectives; Knowledge, Skills, and Abilities (KSA); and/or Job Qualification Standards (JQS) are mapped to test questions and case studies. The Testing Expert develops test blueprints and oversees the creation of job-knowledge tests and performance-oriented assessments. The Testing Expert conducts standard setting activities, develops survey forms to collect student feedback, and performs data and exam analysis and customer reporting. The Testing Expert develops reports to satisfy contractual reporting requirements. The Testing Expert should be familiar with tools such as Excel, SPSS Statistics software, and applications used to deliver testing solutions. Minimum Requirements: The Senior Instructional Testing Expert must be able to successfully demonstrate the following capabilities: Identifies and develops the assessment and/or testing methods for learning solutions Develops the testing strategies for the program Applies validity and reliability standards to ensure tests are psychometrically sound Revises tests and/or assessments based on beta and pilot offerings of learning programs Writes contract documentation to support all aspects of testing on the program Conducts research and provides recommendations on processes and procedures for test creation and administration Collaborates with subject matter experts and multi-disciplinary team members to develop measurable learning objectives and integrate tests into the course content of learning program Develops and utilizes paper or electronic assessment instruments, such as multiple-choice selected responses, open ended, essay, case studies, performance-based tasks, role-play, pre-and post-tests, and simulations Conducts standard setting activities Applies psychometric formulas and theory to construct valid and reliable tests and measures of knowledge and/or performance-based assessments Conduct exam and item analysis Maintains detailed records of the exams for the program Possess drive, enthusiasm, and attention to detail. Ability to solve problems quickly and completely; analytical problem-solving skills; adept at root-cause analysis and mitigation. Effective communication, writing, and requirements gatherings skills are needed to be effective in this role for working with other members of the Team and with the Customer to meet the requirements of the program. Clearance Required: Must be Clearable (TS/SCI preferred) Minimum Education: Ph.D. in Industrial/Organizational Psychology or Instructional Design and Human Performance Improvement (or similar degree) -or- MS Degree in Industrial/Organizational Psychology or Instructional Design and Human Performance Improvement (or similar degree) Minimum Years of Experience: Minimum Eight (8) years of experience in workplace job performance assessments and/or evaluations. (with Ph.D.) Minimum Ten (10) years of experience in workplace job performance assessments and/or evaluations. (with MS) Compensation Details: $185,000 - $220,000 The compensation range or hourly rate listed for this position is provided as a good-faith estimate of what the company intends to offer for this role at the time this posting was issued. Actual compensation may vary based on factors such as job responsibilities, education, experience, skills, internal equity, market data, applicable collective bargaining agreements, and relevant laws. #javelin Compensation Details: $185,000 - $220,000 The compensation range or hourly rate listed for this position is provided as a good-faith estimate of what the company intends to offer for this role at the time this posting was issued. Actual compensation may vary based on factors such as job responsibilities, education, experience, skills, internal equity, market data, applicable collective bargaining agreements, and relevant laws. Benefits Overview: Our health and welfare benefits are designed to support you and your priorities. Offerings include: Health, dental, and vision insurance Paid time off and holidays Retirement benefits (including 401(k) matching) Educational reimbursement Parental leave Employee stock purchase plan Tax-saving options Disability and life insurance Pet insurance Note: Benefits may vary based on employment type, location, and applicable agreements. Positions governed by a Collective Bargaining Agreement (CBA), the McNamara-O'Hara Service Contract Act (SCA), or other employment contracts may include different provisions/benefits. Original Posting: 03/04/2026 - Until Filled Amentum anticipates this job requisition will remain open for at least three days, with a closing date no earlier than three days after the original posting. This timeline may change based on business needs. Amentum is proud to be an Equal Opportunity Employer. Our hiring practices provide equal opportunity for employment without regard to race, sex, sexual orientation, pregnancy (including pregnancy, childbirth, breastfeeding, or medical conditions related to pregnancy, childbirth, or breastfeeding), age, ancestry, United States military or veteran status, color, religion, creed, marital or domestic partner status, medical condition, genetic information, national origin, citizenship status, low-income status, or mental or physical disability so long as the essential functions of the job can be performed with or without reasonable accommodation, or any other protected category under federal, state, or local law. Learn more about your rights under Federal laws and supplemental language at Labor Laws Posters. Welcome back! We encourage you to check on the status of your current job applications with us. You can also search for a list of our current job openings and see if there are any new positions that might be a good fit for you. Thank you for continued interest in employment with Amentum. For more than 100 years, Amentum has tackled the world’s toughest challenges to deliver agile and steadfast solutions to the U.S. government and its allies. With more than 50,000 employees on all seven continents and in more than 60 countries, Amentum delivers a broad range of operational support services to meet the critical needs of our clients. Our headquarters are in Chantilly, VA. Find us online at https://www.amentum.com/ If you need a reasonable accommodation for any part of the employment process, please contact us by email at [email protected] and let us know the nature of your request and your contact information. Requests for accommodation will be considered on a case-by-case basis. EEO including Disability/Protected Veterans Labor Laws Posters Amentum has become aware of unauthorized individuals who are falsely using the Amentum name and /or logo in an attempt to solicit fees from potential job seekers. These deceptive and unauthorized individuals are soliciting money, promising placement in a position with Amentum. Please note any communication requesting any amount of money in exchange for employment with Amentum is fraudulent. These communications do not originate from Amentum and are not associated with the recruitment process. Amentum and its affiliates never charge candidates fees or payments of any kind in order to secure employment. As a precaution, we recommend you do not disclose personal or financial details to anyone as a response to an unsolicited email, social media, or dating website request. Amentum will never as ask for a placement fee or any other fee to expedite the hiring process. If you are contacted by anyone offering employment with Amentum, you should never be asked to pay a fee for recruiting. Amentum personnel will always send email from an identifiable corporate account (ending in @amentum.com) and never from a public email account like Yahoo!, Google, Gmail, or Hotmail. If you are contacted regarding a fraudulent employment proposal, we encourage you to alert your local law enforcement agency/police authority. To read more about Amentum’s commitment to ethics, please click here.

Requirements

Identifies and develops the assessment and/or testing methods for learning solutions
Develops the testing strategies for the program
Applies validity and reliability standards to ensure tests are psychometrically sound
Revises tests and/or assessments based on beta and pilot offerings of learning programs
Writes contract documentation to support all aspects of testing on the program
Conducts research and provides recommendations on processes and procedures for test creation and administration
Collaborates with subject matter experts and multi-disciplinary team members to develop measurable learning objectives and integrate tests into the course content of learning program
Develops and utilizes paper or electronic assessment instruments, such as multiple-choice selected responses, open ended, essay, case studies, performance-based tasks, role-play, pre-and post-tests, and simulations
Conducts standard setting activities
Applies psychometric formulas and theory to construct valid and reliable tests and measures of knowledge and/or performance-based assessments
Conduct exam and item analysis
Maintains detailed records of the exams for the program
Possess drive, enthusiasm, and attention to detail.
Ability to solve problems quickly and completely; analytical problem-solving skills; adept at root-cause analysis and mitigation.
Effective communication, writing, and requirements gatherings skills are needed to be effective in this role for working with other members of the Team and with the Customer to meet the requirements of the program.
Must be Clearable (TS/SCI preferred)
Ph.D. in Industrial/Organizational Psychology or Instructional Design and Human Performance Improvement (or similar degree) -or- MS Degree in Industrial/Organizational Psychology or Instructional Design and Human Performance Improvement (or similar degree)
Minimum Eight (8) years of experience in workplace job performance assessments and/or evaluations. (with Ph.D.)
Minimum Ten (10) years of experience in workplace job performance assessments and/or evaluations. (with MS)

Responsibilities

The Senior Instructional Testing Expert designs, develops, and revises tests and/or assessments for highly-technical evaluation programs.
The Testing Expert will work closely with content developers and subject matter experts (SMEs) to design and develop formative and summative assessments.
The Testing Expert conducts data gathering and needs analyses to ensure learning objectives; Knowledge, Skills, and Abilities (KSA); and/or Job Qualification Standards (JQS) are mapped to test questions and case studies.
The Testing Expert develops test blueprints and oversees the creation of job-knowledge tests and performance-oriented assessments.
The Testing Expert conducts standard setting activities, develops survey forms to collect student feedback, and performs data and exam analysis and customer reporting.
The Testing Expert develops reports to satisfy contractual reporting requirements.
The Testing Expert should be familiar with tools such as Excel, SPSS Statistics software, and applications used to deliver testing solutions.