Head of Assessment and Certification Content

DataCamp

3d

About The Position

DataCamp is seeking a Head of Assessment and Certification Content to own the design and production of assessment and certification content. This role involves collaborating with instructors and teams across curriculum, engineering, product, and marketing to build and scale assessments and certifications. The goal is to help millions worldwide validate their learned skills and signal them to employers. The individual contributor will work with subject-matter experts and build AI systems to generate, review, and refresh high-quality questions at scale.

Requirements

• A technical background in a STEM field—such as Computer Science, Data Science, AI, Statistics, or Engineering—paired with experience evaluating technical competency (e.g., designing coding assessments, technical interviews, certification exams, or graded coursework), so you can judge whether an assessment item is accurate and genuinely tests skill.
• Demonstrated expertise in assessment design—item writing, scoring, standard-setting, and the validity, reliability, and fairness principles behind credible certification—with proven experience building or running technical assessments or certification programs.
• A clear grasp of the skills hiring managers actually screen for in data and AI roles, and how to translate them into what a certification measures.
• Strong experience with agentic AI systems such as Claude Code, Cursor, or Replit, and building AI automation systems. You can demonstrate you've increased your output 10x with AI.
• Graduate degree (Master's or PhD) in a related STEM discipline, or equivalent industry experience with hands-on expertise in data science, machine learning, or software development.

Nice To Haves

• A deep understanding of the DataCamp courses, assessments, and certifications.
• An extensive track record of building sophisticated AI systems and workflows.
• An understanding or interest in the current certification landscape in data and AI: how leading programs are structured, where they fall short, and what makes a credential respected by employers.

Responsibilities

• Own the end-to-end lifecycle for assessment and certification content—from blueprint and item design through review, publication, and ongoing maintenance—and manage deadlines across it.
• Design psychometrically sound assessments: write and review items, define scoring and passing standards, and safeguard validity, reliability, and fairness.
• Build and operate AI workflows—prompting, pipelines, and evaluation—that draft, grade, and quality-check items, so content production scales without sacrificing rigor.
• Source and collaborate with subject-matter experts to keep certifications current with the fast-moving data and AI landscape.
• Map certifications to the real skills hiring managers screen for, so a DataCamp credential is a credible signal to employers.
• Benchmark against the wider certification landscape—competing programs, industry standards, and emerging role definitions—and set the strategy for where our certifications go next.
• Continuously assess certification performance using pass rates, item statistics, and learner and employer feedback to drive improvements.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior