Remote | Architecture Visual Document Evaluation Consultant — Up to $70/hour
24-Mag•New York, NY
•$70 - $70•Remote
About The Position
We are sharing a specialised part-time consulting opportunity for experienced architecture professionals based in the United States or Canada with backgrounds in building design, architectural documentation, construction drawings, spatial reasoning, visual document interpretation, technical review, and structured evaluation. This role supports current and upcoming remote consulting opportunities focused on AI-assisted visual document understanding, instruction-following evaluation, architecture benchmark development, grounded task authoring, ground truth creation, objective rubric design, and high-quality project execution. Selected professionals will translate real-world building architecture expertise into complex document-grounded tasks, define accurate outputs, and provide detailed evaluation criteria based on architectural knowledge, visual reasoning, and domain-specific judgment.
Requirements
- Professional or academic experience in architecture, building design, architectural documentation, construction drawings, spatial planning, or a closely related field
- Strong ability to interpret visual architectural documents, plans, elevations, sections, diagrams, schedules, specifications, or building-related source materials
- Experience creating architectural explanations, structured documentation, design review notes, educational materials, evaluation rubrics, or QA review outputs
- Strong visual reasoning and ability to verify architectural information for accuracy, completeness, and practical relevance
- Ability to clearly articulate architecture-related reasoning in written form
- Strong attention to detail and ability to identify incomplete instructions, inaccurate outputs, unsupported assumptions, or document-grounding issues
- Comfort reviewing AI-generated architecture or visual document content and applying detailed evaluation criteria
- Excellent written communication skills
- Ability to work independently in a remote, asynchronous, project-based environment
- Current location in the United States or Canada
Nice To Haves
- Experience with architectural plans, building layouts, construction documentation, design drawings, technical specifications, building diagrams, or project documentation
- Familiarity with benchmark datasets, visual document understanding tasks, instruction-following evaluations, or rubric-based QA workflows
- Experience creating ground truth answers, assessment materials, training datasets, technical review forms, or structured architecture tasks
- Comfort working with multi-step visual prompts, architectural source files, precise output specifications, and document-grounded reasoning
- Ability to design tasks that require careful spatial interpretation, architectural accuracy, and objective evaluation
Responsibilities
- Author complex, domain-grounded tasks in the building architecture domain using realistic visual documents, drawings, plans, diagrams, specifications, reports, or related source materials
- Design tasks that evaluate an AI system's ability to understand architectural documents, follow precise instructions, and produce accurate structured outputs
- Translate architectural expertise into clear task prompts, expected answers, and evaluation-ready examples
- Support work across building design, floor plans, elevations, sections, site plans, construction documentation, spatial layouts, or related architecture topics depending on expertise and project needs
- Review architectural drawings, plans, diagrams, visual materials, tables, annotations, and specifications for relevant building and design information
- Create tasks that require careful interpretation of visual document structure, spatial relationships, labels, measurements, symbols, and architectural context
- Evaluate whether task instructions are clear, complete, technically sound, and appropriately grounded in the provided materials
- Identify ambiguous prompts, missing context, incorrect assumptions, weak document grounding, or incomplete architectural reasoning
- Produce clearly defined ground truth outputs for architecture-focused tasks
- Create objective evaluation rubrics that specify correct answers, acceptable reasoning, formatting expectations, architectural requirements, and quality criteria
- Validate task outputs for accuracy, completeness, consistency, and alignment with source documents and instructions
- Identify gaps in answer keys, rubric logic, evaluation criteria, document interpretation, or instruction-following requirements
- Provide clear written feedback explaining architectural reasoning, visual document interpretation, task-quality issues, and suggested improvements
- Follow detailed task instructions, quality criteria, and project-specific standards accurately
- Review discrete benchmark deliverables and identify areas for improvement
- Collaborate through asynchronous project workflows to improve architecture-focused AI evaluation materials and benchmark quality
Benefits
- Competitive rates of up to $70 USD per hour
- Remote structure with flexible scheduling
- Weekly payments via Stripe or Wise
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Part-time
Career Level
Senior
Education Level
No Education Listed
