About the position
Udemy is seeking a dynamic Assessment Content Manager to join our growing assessment team as part of the Instructor & Content Strategy department. This role will help manage day-to-day assessment content operations, leveraging automations and AI-driven processes to enhance the development and maintenance of our assessment content at scale. For this role, you will leverage your extensive foundational knowledge of assessments to ensure the smooth operation and scalability of our assessment content while contributing to assessment innovations in support of multiple products. As an Assessment Content Manager, you will play a pivotal role in fostering cross-functional collaboration with our Psychometric, Product, Learning Design, and Engineering teams to further establish and optimize our end-to-end assessment operations. You will contribute to and manage key aspects of our assessment content program including assessment creation and maintenance, vendor and instructor management, and assessment model development.
Responsibilities
- Oversee and manage the end-to-end scaled creation and maintenance of assessment content
- Drive the transition to scalable, AI-driven assessment content operations
- Manage relationships with vendors, instructors, and subject matter experts (SMEs) for project execution, exploration, and feedback
- Collaborate with cross-functional teams to support strategic initiatives, including content strategy development and the development of new assessment models
Requirements
- 3+ years of hands-on industry experience in an assessment development role
- Experience in managing end-to-end assessment content operations, including development and maintenance
- Strong understanding of assessment fundamentals (validity, reliability, fairness) and diverse assessment models (formative, summative, diagnostic)
- Experience with learning and assessment product design
- Ability to analyze results and metrics to inform data-driven decisions
- Thrive in dynamic environments and demonstrate flexibility and adaptability in response to evolving business needs
- Highly organized with excellent project management and communication skills capable of managing multiple tasks independently
Nice-to-haves
- +5 years of relevant industry experience such as leading assessment development projects, managing assessment content operations, and/or leading assessment product teams
- Educational background in assessment, learning, and/or instructional design fields
- Experience with learning and assessment product design and development
- Experience with e-learning content and assessment management systems, platforms, and tooling
- Strong fundamentals using generative AI in assessment contexts (e.g., prompt engineering) as well as familiarity with AI-tooling (e.g., ChatGPT)
- Familiarity with technical skills space (computer science, AI/ML, data science, etc.)
Benefits
- Inclusive environment that welcomes a diverse range of backgrounds and experiences
- Unlimited access to Udemy courses
- Monthly UDays (meeting-free professional development days)
- Generous annual professional development stipend
- Recognition as a Great Place to Work
