Content Strategy Manager, Assessments

About the position

Udemy is seeking a dynamic Assessment Content Manager to join our growing assessment team as part of the Instructor & Content Strategy department. This role will help manage day-to-day assessment content operations, leveraging automations and AI-driven processes to enhance the development and maintenance of our assessment content at scale. For this role, you will leverage your extensive foundational knowledge of assessments to ensure the smooth operation and scalability of our assessment content while contributing to assessment innovations in support of multiple products.

Responsibilities

• Oversee and manage the end-to-end scaled creation and maintenance of assessment content
• Drive the transition to scalable, AI-driven assessment content operations
• Manage relationships with vendors, instructors, and subject matter experts (SMEs) for project execution, exploration, and feedback
• Collaborate with cross-functional teams to support strategic initiatives, including content strategy development and the development of new assessment models

Requirements

• 3+ years of hands-on industry experience in an assessment development role
• Experience in managing end-to-end assessment content operations, including development and maintenance
• Strong understanding of assessment fundamentals (validity, reliability, fairness) and diverse assessment models (formative, summative, diagnostic)
• Experience with learning and assessment product design
• Ability to analyze results and metrics to inform data-driven decisions
• Thrive in dynamic environments and demonstrate flexibility and adaptability in response to evolving business needs
• Highly organized with excellent project management and communication skills capable of managing multiple tasks independently

Nice-to-haves

• +5 years of relevant industry experience such as leading assessment development projects, managing assessment content operations, and/or leading assessment product teams
• Educational background in assessment, learning, and/or instructional design fields
• Experience with learning and assessment product design and development
• Experience with e-learning content and assessment management systems, platforms, and tooling
• Strong fundamentals using generative AI in assessment contexts (e.g., prompt engineering) as well as familiarity with AI-tooling (e.g., ChatGPT)
• Familiarity with technical skills space (computer science, AI/ML, data science, etc.)