Assessment Solution Strategist

Pluralsight

2d • $80,000 - $100,000 • Hybrid

About The Position

Assessments are only as powerful as the thinking behind them. At Pluralsight, we believe that measuring skills well is one of the most meaningful things you can do for a technologist's career — and we're looking for someone who feels the same way. As an Assessment Solution Strategist, you'll own the full lifecycle of assessment design and quality for a platform used by thousands of learners and organizations worldwide. This isn't a role where you'll be handed a template and told to fill it in. You'll shape the blueprints, apply the psychometric rigor, analyze the data, and drive the kind of continuous improvement that keeps our assessments genuinely best-in-class. If you're energized by the craft of measurement — and you want your work to directly impact how people demonstrate and grow their technical skills — this is the role for you.

Requirements

• Bachelor's degree in educational or psychological measurement, instructional design, psychometrics, or a related field
• 3+ years of relevant professional experience designing and developing high-integrity assessments
• Strong command of assessment types, taxonomy, and principles of validity and reliability
• Excellent writing, editing, and quality assurance skills
• Experience working with vendors, SMEs, and cross-functional teams
• Proficiency with learning management systems, authoring tools, and item banks
• Strong organizational and project management skills with the ability to manage multiple projects simultaneously
• Strong analytical skills and a data-driven approach to decision making
• Exceptional attention to detail

Nice To Haves

• Master's degree or 3–5 years of specialized experience in assessment design, development, or measurement
• Experience with technical/IT content or certifications (e.g., AWS, Azure, Python, security)
• Background in psychometrics or data analysis using tools like Excel, R, or SPSS
• Knowledge of accessibility and Universal Design for Learning (UDL) standards
• Experience with adaptive testing or automated assessment tools
• Familiarity with the Pluralsight platform and value proposition
• Experience with SaaS software (e.g., ZenDesk, Asana, Confluence, Smartsheet)

Responsibilities

• Design assessment blueprints, generate item prompts, develop items across the full complexity spectrum, and manage forms from creation through continuous improvement.
• Run item and test analyses, calibration, equating, scaling, and reliability/validity checks. Flag issues, investigate root causes, and drive continuous improvement across the assessment portfolio.
• Contribute to assessment content standards and ensure the portfolio aligns to curriculum and learning objectives. Apply item-level QA with a sharp editorial eye and advise on evidence-based assessment practices.
• Lead day-to-day collaboration with SMEs and vendors, support SOW execution, and manage multiple concurrent projects to deadline — independently and without hand-holding.
• Author and maintain processes, procedures, and decisions related to assessment design, development, and continuous quality monitoring. Resolve complex queries from internal partners and escalate where appropriate.

Benefits

• competitive compensation
• bonus eligibility
• comprehensive medical coverage
• unlimited PTO
• wellness reimbursement
• professional development funds

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level