Senior Certification Program Manager

Atlassian • San Francisco, CA

35d

About The Position

We're hiring a Senior Certification Program Manager with testing industry experience to support the high-stakes technical Certifications for the Atlassian Certification Program. This critical role will be responsible for overseeing our third-party testing platforms, ensuring the integrity and security of our exams, and driving the psychometric analysis necessary to maintain the validity and reliability of our certification assessments.

Requirements

• 5+ years of experience managing operations within high-stakes certification programs, preferably in the tech industry.
• 5+ years of experience conducting item and exam analysis using both classical test theory and item response theory.
• 5+ years experience in quantitative measurement and statistics.
• You hold deep expertise experience in data-driven decision making and are comfortable using different forms of analytical, testing & item bank software.
• Expertise in designing and implementing operational processes, policies, and procedures to support certification program objectives, ensuring compliance with industry standards and regulations.
• Proficiency in data-driven decision-making, analyzing operational data sets to inform strategic decisions and continuous improvement initiatives.
• Proficiency of test delivery and item banking software, platforms, and tools for efficient management of certification exams and candidate administration processes.
• You have a strong understanding of certification program governance, and industry best practices for certification operations, administration, and delivery.
• Ability to thrive in collaborative, fast-paced environments, with a creative and innovative approach to optimizing certification program operations.
• Strong stakeholder management skills, with the ability to build and maintain relationships with internal and external stakeholders, and proven project management expertise in planning and executing complex initiatives.

Responsibilities

• Support certification program operations such as exam delivery and publication, certification support, messaging, exam voucher management, and process and procedure documentation.
• Manage Certification third-party vendors and support key systems, including credential and badging management systems, item banking, publication, and verification. Ensure external partners meet quality, compliance, and service level agreements.
• Ensure effective management of business reviews and compliance with third-party vendors to align their roadmaps with the objectives of Atlassian’s certification program and adhere to Atlassian’s procurement policies.
• Responsible for developing and implementing Certification Exam security policies, procedures, and guidelines to safeguard sensitive information, data, and assets related to the certification program.
• Provide guidance on innovative methods of exam delivery such as events and performance exams.
• Investigate security breaches, including exam dumps on third-party sites, and coordinate necessary actions with Atlassian’s legal team.
• Monitor industry best practices and evolving trends in certification, psychometrics, and online proctoring to inform program enhancements.
• Responsible for the maintenance and health of the Atlassian Certification program through the creation of a psychometric and environmental maintenance program.
• Conduct comprehensive statistical analyses of exam performance data, including item analysis, reliability studies, validity studies, and standard setting.
• Using data-driven decisions, ensure that both Professional and Associate Certification programs are appropriately maintained to ensure they are valid, reliable, and fair.
• Provide strategic influence and guidance for exam development and maintenance processes. You will establish best practices and provide recommendations for exam development, item development, subject matter expertise, community feedback, data analysis, and psychometric analysis, educational and industry knowledge.
• Using a variety of standard setting methods (Beta, Angoff) determine exam cut scores, assemble forms, and provide guidance on item amounts, non-scored process, and other activities related to exam publishing.
• Identify areas for improvement in exam content, structure, and difficulty based on psychometric findings.
• Maintain detailed documentation of all psychometric activities and analyses.
• Ensure all certification processes and materials adhere to industry best practices, accreditation standards (if applicable), and legal/ethical guidelines.
• Establish strong working relationships with cross-functional teams in Community, Learning, product, and other areas. Serve as an advocate and evangelist for the program and its legal defensibility.
• Join collaborative projects that are meaningful across the wider Learning team and provide guidance on exam design, development, and delivery to the team.

Benefits

• Atlassian offers a wide range of perks and benefits designed to support you, your family and to help you engage with your local community. Our offerings include health and wellbeing resources, paid volunteer days, and so much more.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed
• Number of Employees: 5,001-10,000 employees