Remote | Engineering Assessment Expert (AI Benchmarking) — $50–$70/hour

24-Mag • New York, NY

1d • Remote

About The Position

We are sharing a specialised part-time consulting opportunity for engineers, technical researchers, and subject-matter experts with advanced knowledge of engineering principles, applied mathematics, technical systems, and domain-specific engineering practice. This role supports an AI research initiative focused on developing rigorous engineering benchmarks. Selected experts will author or verify challenging multiple-choice assessment content, evaluate technical accuracy and solution quality, develop well-supported reference solutions, and help establish high-quality evaluation standards for advanced AI systems.

Requirements

• PhD or current doctoral candidacy in Engineering or a closely related technical discipline
• Master's degree may be considered for candidates with exceptional expertise in a relevant engineering subdomain
• Strong command of graduate-level engineering principles and applied mathematics
• Expertise in one or more areas including Semiconductor Design, VLSI, Control Engineering, Mechatronics, Reactor or Plant Design, Separations, Reservoir Engineering, Engineering Maintenance, Bioinstrumentation, or Biotechnology
• Strong ability to analyse complex engineering systems and verify quantitative solutions
• Familiarity with relevant technical standards and professional engineering practice
• Excellent written English and ability to communicate complex technical concepts clearly and precisely
• Academic research publications or substantial industry experience are highly valued
• Professional engineering licensure or comparable technical credentials are advantageous
• University-level teaching, examination development, or technical assessment experience is highly valued
• Strong attention to mathematical precision, engineering feasibility, and problem solvability
• Work must be completed without using confidential or proprietary information belonging to any employer, client, institution, or other third party

Nice To Haves

• Academic research publications or substantial industry experience are highly valued
• Professional engineering licensure or comparable technical credentials are advantageous
• University-level teaching, examination development, or technical assessment experience is highly valued

Responsibilities

• Create original multiple-choice questions that test deep engineering understanding rather than surface-level recall
• Develop challenging problems within relevant areas of engineering expertise
• Ensure questions are self-contained, precise, unambiguous, and independently solvable
• Design questions appropriate for undergraduate, advanced undergraduate, and postgraduate difficulty levels
• Produce one correct answer alongside nine plausible and carefully constructed distractors
• Review pre-written engineering questions for correctness, clarity, rigour, and completeness
• Identify technical errors, hidden assumptions, mathematical mistakes, or solvability issues
• Edit questions and answer choices where required
• Verify calculations, engineering reasoning, assumptions, and designated correct answers
• Document substantive changes and explain the technical reasoning behind them
• Develop assessment content involving semiconductor devices, VLSI design, and integrated-circuit manufacturing
• Create problems covering circuit architecture, fabrication processes, device behaviour, and design trade-offs
• Evaluate semiconductor manufacturing constraints and performance considerations
• Apply electrical and electronic engineering principles to advanced device scenarios
• Develop technically rigorous problems involving modern semiconductor systems
• Create questions involving control theory, system dynamics, stability, feedback, and optimisation
• Develop problems integrating mechanical, electrical, electronic, and computational systems
• Apply mathematical modelling to dynamic engineering systems
• Evaluate sensors, actuators, controllers, and system-level behaviour
• Design scenarios requiring multi-step reasoning across control and mechatronic applications
• Develop assessment content involving reactor design, process engineering, and industrial plant systems
• Create problems addressing mass and energy balances, reaction engineering, and process optimisation
• Evaluate separation processes and equipment selection
• Apply engineering judgement to system design, operating conditions, and process constraints
• Develop scenarios reflecting realistic chemical and industrial engineering workflows
• Create problems involving reservoir modelling, production behaviour, and subsurface engineering
• Evaluate fluid flow, recovery strategies, reservoir performance, and operational constraints
• Develop questions involving equipment reliability, maintenance strategy, and asset performance
• Apply quantitative methods to engineering planning and operational decisions
• Assess trade-offs involving safety, efficiency, reliability, and production objectives
• Develop questions involving biomedical instrumentation, sensors, measurement systems, and biotechnology
• Apply engineering principles to biological and healthcare-related technologies
• Create problems involving signal acquisition, system design, instrumentation, and data interpretation
• Evaluate technical performance and design constraints in bioengineering applications
• Develop interdisciplinary problems integrating engineering with biological systems
• Provide 1–5 academic references per question where required
• Use reputable sources such as peer-reviewed journals, academic publications, engineering standards, and university repositories
• Develop clear, structured solution explanations supporting the correct answer
• Rate question difficulty according to defined Medium, Hard, and Expert standards
• Help maintain consistent technical and academic quality across benchmark content
• Contribute to gold-standard evaluation materials used to assess advanced AI capabilities

Benefits

• Part-time independent contractor engagement
• Fully remote and asynchronous
• Expected availability of at least 10 hours per week
• Flexible scheduling based on project requirements
• Compensation: $50–$70/hour
• Contributors may be assigned either question-authoring or question-verification workstreams
• Projects may be extended, shortened, or concluded based on project needs and performance

What This Job Offers

• Job Type: Part-time
• Career Level: Entry Level
• Education Level: Ph.D. or professional degree