Business Analyst: US Raters

Weekday AI

1d • Remote

About The Position

This role supports a client project evaluating and comparing responses generated by multiple AI chatbots. The Business Analyst reviews chatbot outputs, assesses their quality against predefined criteria, conducts structured evaluations, and provides accurate, evidence-based final judgments. The work also includes gathering and documenting business requirements, translating them into evaluation guidelines, analyzing workflows and data, communicating findings, and tracking project quality and deliverables.

This is a fully remote, short-term contract for candidates based in the United States. The contract lasts 16 weeks and pays USD 30 per hour. The role requires a full-time commitment of eight hours per day, five days per week, with at least four hours of overlap with US Pacific Time. The schedule may include weekends, with two weekdays off each week. The start date is immediate.

Requirements

• Bachelor's degree in Business Administration, Finance, Computer Science, or a related field.
• At least 3 years of experience as a Business Analyst or in a similar analytical role.
• Strong analytical thinking, problem-solving, and decision-making skills.
• Excellent written and verbal communication skills.
• Proficiency in Microsoft Excel, SQL, Power BI, Tableau, or similar analytical tools.
• Experience with requirement gathering, process mapping, and business documentation.
• Ability to work effectively with cross-functional teams and manage multiple priorities.
• Strong attention to detail and ability to make consistent, objective assessments.
• Ability to follow detailed instructions, meet deadlines, and work independently in a remote environment.
• Must be based in the United States and comply with applicable country-specific eligibility guidelines.
• Must be available for 8 hours per day, five days per week, with at least 4 hours of overlap with US Pacific Time.

Nice To Haves

• Familiarity with Agile or Scrum methodologies.

Responsibilities

• Review, analyze, and compare responses generated by multiple AI chatbots.
• Evaluate chatbot responses using predefined criteria, including accuracy, relevance, completeness, clarity, consistency, and overall quality.
• Gather and document business requirements and translate them into clear evaluation guidelines.
• Conduct structured assessments and provide objective, evidence-based judgments.
• Analyze workflows, processes, and data to identify gaps, inconsistencies, and areas for improvement.
• Prepare reports, summaries, and supporting documentation to communicate evaluation findings.
• Collaborate with project managers and cross-functional teams to clarify requirements and resolve assessment-related questions.
• Track task progress, quality metrics, and deliverables to ensure timely completion.
• Identify recurring issues in chatbot responses and share actionable observations.
• Maintain accuracy, consistency, confidentiality, and thorough documentation throughout the project.

Benefits

• Opportunity to contribute to projects focused on AI evaluation and chatbot response quality.
• Fully remote work arrangement.
• Exposure to structured AI assessment and quality assurance processes.
• Opportunity to work on projects with broader business and technological applications.
• Clearly defined contract duration, hourly compensation, and project expectations.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level