hour

24-Mag•New York, NY

21h•$75 - $145•Remote

About The Position

We are sharing a specialised consulting opportunity for experienced UI/UX and product designers with strong expertise in digital product design, design systems, responsive interfaces, end-to-end user flows, and production-ready design workflows. This role supports an advanced AI research initiative focused on evaluating how effectively AI systems perform real-world digital product design work. Selected professionals will establish clear quality standards, develop task-specific evaluation criteria, and review AI-generated and human design work using the judgment expected from experienced product and UX professionals.

Requirements

At least 5 years of professional experience in UI/UX, product design, or design systems
Experience designing real digital products rather than primarily brand or marketing websites
Background in product-led companies, digital-product studios, e-commerce, marketplaces, SaaS, or comparable environments
Strong expertise in interaction design and visual design
Experience creating or maintaining design systems and component libraries
Hands-on experience designing responsive interfaces and complex product flows
Strong proficiency with Figma and production handoff workflows
Ability to articulate detailed design critique at a senior professional level
Excellent written communication and attention to detail
A strong portfolio demonstrating substantial work on real digital products is particularly valuable

Nice To Haves

Experience as a Product Designer, UX Designer, UI Designer, UX Lead, or Design Systems Designer
Background in UX writing or content design
Experience with sophisticated customer portals, dashboards, or transactional products
Familiarity with e-commerce or marketplace experiences
Experience reviewing or mentoring other designers
Strong knowledge of prototyping and interaction patterns
Experience collaborating closely with product managers and engineering teams
Prior experience with AI training, evaluation, structured review, or human-data projects

Responsibilities

Evaluate realistic digital product and user-experience deliverables
Review responsive interfaces, dashboards, customer portals, and complex product experiences
Assess end-to-end flows such as onboarding, checkout, booking, and account management
Evaluate interaction design, visual hierarchy, usability, accessibility, and overall product quality
Determine whether proposed solutions meet the expectations of real users and production environments
Assess design systems, component libraries, patterns, and reusable interface elements
Evaluate consistency across components, states, layouts, and responsive breakpoints
Review the scalability and practical usability of design-system decisions
Assess whether interfaces follow coherent interaction and visual-design principles
Identify inconsistencies, usability issues, and production-readiness concerns
Develop precise, task-specific grading criteria for digital product design work
Define standards that distinguish strong professional design from incomplete or superficial solutions
Score AI-generated and human work samples against established criteria
Provide detailed written justification for evaluation decisions
Apply consistent, evidence-based judgment so assessments remain reproducible and defensible
Review prototypes and end-to-end product journeys
Evaluate UX writing, product content, and interface communication where relevant
Assess Figma-based design and design-to-engineering handoff
Review specifications, component behaviour, responsive states, and implementation readiness
Incorporate structured reviewer feedback and refine evaluations efficiently