Remote | 211 Specialist — $30–$40/hour

24-Mag • New York, NY

3d • Remote

About The Position

24-MAG LLC is recruiting experienced 211 Specialists, Information & Referral Specialists, Benefits Navigators, and professionals in related public assistance roles for a remote consulting engagement contributing professional expertise to AI training and evaluation initiatives. The work involves reviewing realistic public assistance inquiries, developing structured evaluation criteria, and assessing AI-generated responses for accuracy, completeness, and practical usefulness. Prior AI training or evaluation experience is not required.

The engagement is freelance/contract, fully remote, and limited to candidates based in the United States. Compensation is $30–$40 per hour, with an expected commitment of 10–20 hours per week. The project is short term, with 10 openings, and candidates should be prepared to begin promptly. Work is performed independently in an asynchronous environment, with structured written collaboration and submissions to the project team. Deliverables include structured assessments, written evaluation criteria, and actionable feedback.

Requirements

• Professional experience as a 211 Specialist, Information & Referral Specialist, Benefits Navigator, or in a closely related public assistance role.
• At least 1 year of regular, high-volume public contact experience by telephone, chat, or in person.
• Demonstrated experience answering public inquiries about government services and community resources.
• Working knowledge of public benefits programs, eligibility-related questions, and referral procedures.
• Familiarity with community assistance organizations and information and referral practices.
• Ability to identify appropriate resources and explain practical next steps to service users.
• Strong understanding of common questions and challenges faced by people seeking public assistance.
• Ability to recognize inaccurate, incomplete, or outdated public service guidance.
• Excellent written communication, with an emphasis on clear, precise, actionable feedback.
• Strong attention to detail and ability to apply consistent evaluation standards.
• Ability to work independently and communicate effectively in an asynchronous remote environment.
• Strong organizational skills and ability to complete structured review assignments accurately.
• Must be based in the United States.
• Availability to begin promptly and commit 10–20 hours per week.

Nice To Haves

• Experience conducting needs assessments or providing crisis intervention support.
• Familiarity with community resource databases and service directories.
• Experience preparing informational guides, service scripts, or training materials.
• Experience supporting diverse populations, including rural communities and Spanish-speaking service users.
• Prior AI training or evaluation project experience is not required.

Responsibilities

• Review sample questions about government services, public benefits, and community assistance programs.
• Evaluate whether inquiries reflect questions commonly received by 211 information and referral services; identify unrealistic scenarios, unclear requests, and missing context.
• Recommend improvements to make sample questions reflect practical information and referral situations.
• Assess the relevance of government programs, public benefits, and community resources to different caller needs.
• Identify appropriate referral information and practical next steps for public assistance scenarios.
• Evaluate whether suggested resources address callers’ stated circumstances and service requirements.
• Review guidance for completeness, accuracy, and usefulness to the public.
• Evaluate AI-generated responses for factual inaccuracies, missing referral information, outdated guidance, and incomplete explanations.
• Assess whether responses provide clear, relevant, actionable information suited to callers’ circumstances.
• Develop structured rubrics and standards for correct and complete responses, including accurate information, relevant referrals, and appropriate next steps.
• Apply documented evaluation standards consistently and explain why responses meet or fall short of quality requirements.
• Document response errors, omitted information, and recommended improvements in clear, precise written feedback.
• Complete assigned reviews independently in an asynchronous project environment and collaborate through structured written feedback and evaluation submissions.

What This Job Offers

• Education Level: No Education Listed