Specialist II, Assessment Development

NIGHTINGALE EDUCATION LLC SOLE MB•Salt Lake City, UT

About The Position

The Assessment Developer will design, develop, and refine concept and competency-based, objective, and performance-based assessments that align with program outcomes and institutional goals. This role requires expertise in concept-based learning, CBE, assessment best practices, and data-driven evaluation methods to ensure the validity and reliability of assessments. The Assessment Developer will collaborate with leadership, faculty, subject matter experts (SMEs), curriculum designers, and psychometricians to develop innovative and secure assessment solutions. This individual will also ensure assessment integrity, security, and compliance with accreditation standards while leveraging emerging technologies and solutions to enhance assessment development. The Assessment Developer will also support training efforts to ensure faculty and curriculum teams understand and apply best practices in assessment design and evaluation.

Requirements

Master’s degree in a relevant field (e.g., Education, Learning Science, Psychometrics, Instructional Design, or a related discipline). (Bachelors with 5-7 years of equivalent experience)
3+ years of experience in assessment design and development, preferably in higher education, licensure, or competency-based education.
Expertise in concept and competency-based assessment development, including backward design, formative and summative assessment models, and rubric-driven performance assessment.
Strong project management skills with the ability to manage multiple projects and deadlines.
Experience with prototyping and validating new assessment types, adaptive testing, and psychometrics.
Knowledge of assessment security, compliance, and accreditation standards.
Experience analyzing assessment data to inform decision-making and improve assessment quality.
Experience utilizing various types of LMS, specifically Canvas.
Strong analytical and problem-solving skills with attention to detail.
Excellent communication skills (verbal and written) for explaining complex assessment concepts to diverse audiences.
Ability to work collaboratively across departments and with external partners.
Initiative and adaptability to navigate ambiguous and evolving assessment landscapes.
Passion for quality improvement, innovation, and student success.

Nice To Haves

Experience in concept-based and competency-based education learning environments, particularly in nursing or healthcare education.
Proficiency in assessment software and AI/VR-driven assessment tools.
Strong understanding of emerging technologies for assessment innovation.
Familiarity with accreditation and regulatory requirements in higher education, particularly with nursing.

Responsibilities

Develop, align, and review concept-based, competency-based, and performance-based assessments that support institutional goals.
Design and prototype innovative and flexible assessment models, including adaptive testing and technology-enhanced item types.
Develop rubrics, scoring guidelines, and grading methodologies to ensure consistent and fair evaluation of student performance.
Ensure assessments align with course learning materials, student engagement strategies, and competency-based learning frameworks.
Collaborate with SMEs, psychometricians, and faculty to ensure all assessments are valid, reliable, and defensible.
Incorporate feedback from quality assurance (QA) reviews, stakeholders, and data analysis to refine assessments.
Support and drive assessment development timelines and priorities in collaboration with the Director of Assessment Development.
Work closely with curriculum designers, faculty, and other stakeholders to ensure assessments integrate seamlessly into coursework.
Ensure assessments meet accreditation standards and institutional policies.
Partner with project management teams to meet critical deadlines and deliverables.
Conduct QA reviews of assessment tools and processes to identify gaps and opportunities for improvement.
Analyze assessment data and trends to recommend improvements and enhance student outcomes.
Collaborate with psychometricians and data teams to ensure assessments meet internal quality standards, external accreditation requirements, and industry best practices.
Prototype and test new assessment and item types, AI-driven assessments, adaptive testing models, and technology-enhanced assessments including VR immersions.
Stay updated on emerging trends in assessment design, online education, and AI and/or VR-driven solutions to enhance assessment practices.
Collaborate with technology teams to select and implement scalable assessment technology solutions.
Integrate best practices in formative and summative assessments to continuously innovate and improve student assessment experiences.
Identify and mitigate risks related to assessment integrity, security, and delivery.
Implement secure practices to protect the confidentiality, validity, and reliability of assessments.
Ensure compliance with accreditation and regulatory requirements, working with internal and external stakeholders as needed.
Support initiatives that align with training, consultation, and guidance to faculty, curriculum teams, and SMEs on assessment best practices, validity, and scoring models.
Serve as a resource for troubleshooting assessment-related issues and supporting faculty in the effective use of assessments.
Advocate for evidence-based, high-impact, and authentic assessment techniques.