Expert Rater Project - English (US)

Welo Global

4d•Remote

About The Position

As an Expert Rater (ER), you will specialize in providing Rater's support and guidance. You will be instrumental in enhancing the knowledge and skills of other Raters, with a particular focus on developing their rating expertise. Your responsibilities include facilitating client test rounds, understanding templates and workflows, cascading quality expectations to the broader Raters team, and actively monitoring progress and deliverables to meet client expectations. Additionally, you will play a key role in coaching and mentoring Raters, ensuring they gain the necessary skills to improve rating accuracy and decision-making. Your expertise will contribute to elevating the overall quality of our AI-powered advertising systems.

Requirements

1+ years of rating experience required
Understanding of data labeling, annotation, and evaluation methodologies - Required
Knowledge of English Language Required (Oral and written comprehension).
Google Workspace - Intermediate proficiency
Understanding of U.S. and project locale customs and societal norms
Ability to evaluate and discern content thoughtfully and understand its societal impact
Understanding of survey structures and data collection methodologies
Active Listening Skills: Engage with speakers attentively, seek clarification, provide feedback, and demonstrate empathy to comprehend their message deeply.
Effective Communication and Empathy: Clearly express thoughts, emotions, and needs while respecting others' perspectives, communicating assertively yet respectfully.
Proactiveness: Anticipate and prepare for future needs or obstacles to tackle them efficiently before they arise.
Cultural Adaptability: Navigate differences in values, behaviors, and communication styles to foster effective interactions in diverse cultural contexts.
Psychological Safety Cultivation: Create an atmosphere where individuals feel safe expressing themselves, taking risks, and sharing ideas without fear of criticism.
Research Skills: Methodically explore online sources to extract data, insights, or knowledge relevant to specific topics and cross-reference information.

Nice To Haves

An academic background in social sciences or quality roles is a plus

Responsibilities

Support Raters in skill development, guiding them in best practices for accurate and consistent ratings.
Ensure annotation selection and gold set creation adheres to template instructions, guaranteeing unbiased outcomes that are reached through elaborate peer-driven consensus.
Analyze diverse datasets to identify significant patterns and trends, demonstrating proficiency in interpreting and utilizing KPIs to drive data-informed decision-making.
Employ strategic questioning techniques to gather information, enhance understanding, and stimulate critical thinking for effective problem-solving and decision-making.
Craft written materials such as emails, questions, and feedback specifically customized for client communication, ensuring clarity and relevance.
Facilitate information or concepts to audiences using relevant documentation and clear communication strategies to align with specific client objectives.
Collaborate with research and development teams in experiments aimed at enhancing the clientâ€™s data.
Work closely with clients and CEM to conduct test rounds, gain insights into their requirements, and understand the quality benchmarks expected.
Conduct evaluations independently to sustain and enhance the level of proficiency or skill in particular projects.