Business Operations Expert

EVB•Remote, USA

3d•Remote

About The Position

The Business Operations Expert designs realistic, multi-step benchmark tasks based on real business operations workflows to assess what AI systems can do. Tasks should be challenging, require judgment based on correctly interpreting provided materials, and include objective grading criteria that allow qualified reviewers to reach consistent conclusions. The work includes developing tasks involving areas such as reporting, process design, and workflow management, and creating or sourcing supporting materials such as spreadsheets, system exports, process documentation, and operational reports. The role also involves identifying tasks that are ambiguous or cannot be graded reliably and delivering approved tasks on schedule and at the required quality level. No prior AI experience is required.

Requirements

At least 5 years of hands-on responsibility in business operations, operations reporting, process design, or workflow management; direct ownership is required, rather than supervisory-only or adjacent exposure.
Strong Excel capability.
Comfort reasoning across multiple documents at once.
Strong written and spoken English, with B2 minimum and C1 preferred.

Nice To Haves

Experience creating or applying structured standards such as SOPs, QA checklists, process documentation, service level definitions, or training assessments.
AI or LLM evaluation experience.

Responsibilities

Design multi-step tasks drawn from real operations work, including reporting, process design, and workflow management.
Provide realistic reference files and clear instructions for each task.
Define objective grading criteria so qualified reviewers can assess outputs consistently.
Build tasks that require judgment and careful interpretation of supplied materials rather than simple lookup.
Create or source supporting materials such as spreadsheets, system exports, process documentation, and operational reports.
Flag tasks that are ambiguous or ungradable rather than submitting them.
Deliver approved tasks on schedule and at the required quality level.