Merchant Operations and Quality Lead

Mecka•New York, NY

About The Position

Mecka AI is building the data infrastructure layer for robotics and embodied AI. We design and operate global systems for data capture, data labeling, and hardware-enabled workflows used by leading AI labs and robotics companies to train and validate humanoid and embodied AI systems. We work closely with frontier robotics teams to bridge real-world data, simulation, learning-based systems, and deployed hardware. Our dataset is valuable only to the extent that it is authentic, complete, and operationally usable across all machine learning and operational workflows. We maintain and continuously evaluate data quality through a rigorous hybrid approach combining models with verification. In this role, you will build, scale, and lead our global review operations organization, taking full operational accountability for critical quality and performance metrics including review coverage, multi-pass accuracy, reviewer throughput, SLA compliance, and unit economics/cost management. You will establish robust, continuous feedback loops connecting local merchants, external BPO partners, field capture teams, and executive management to drive dataset standards. Serving as the operational partner to our quality engineering and machine learning teams, you will ensure our operational insights directly inform, calibrate, and improve automated models, annotation workflows, and field capture guidelines.

Requirements

5 to 8+ years of progressive operational leadership experience managing large-scale review, merchant, trust and safety, community, or data quality operations in high-growth environments.
Demonstrated track record of architecting comprehensive quality control frameworks from scratch, including balanced scorecards, statistical sampling techniques, cross-team calibration sessions, and targeted coaching loops.
Exceptional analytical acumen with proficiency in building operational dashboards, writing SQL queries, modeling unit economics, and communicating complex statistical performance data effectively with AI/ML engineers.

Nice To Haves

Direct experience in merchant operations, content moderation, or onboarding at a top-tier marketplace, hyper-local logistics, or delivery platform operating across Southeast Asia or international markets.
Hands-on experience procuring, negotiating, and managing third-party BPO vendor relationships, setting up vendor SLAs, and running quarterly business reviews
Deep familiarity with computer vision data collection, video stream evaluation, bounding-box/semantic segmentation annotation pipelines, or synthetic data training setups.

Responsibilities

Lead, structure, and scale a high-volume review and approval organization encompassing internal teams and vendor partners.
Hire, develop, and coach operational team leads, establish clear performance management frameworks, and manage headcount, shift scheduling, and operational budgets to optimize unit economics.
Take end-to-end ownership of review coverage, SLA adherence, reviewer throughput, and multi-tier accuracy.
Design and execute regular calibration sessions, inter-annotator agreement audits, and QA reporting to enforce a unified quality standard across all global locations.
Define and enforce merchant approval workflows, automated pre-payout verification checks, and merchant compliance standards.
Publish weekly quality scorecards and establish structured feedback loops with sales, account management, and business development teams with strict service level agreements for resolution.
Partner closely with data engineering, product, and AI research teams to embed our evaluation insights into model training.
Define active learning edge cases, continuously refine automated rule checks, and report operational quality metrics and cost models to executive leadership on a weekly cadence.
Lead the operational protocol and response framework when fraud, data tampering, or platform integrity issues are detected.
Collaborate with engineering, legal, and finance to investigate root causes, mitigate risk, enforce merchant suspensions, and prevent future recurring vulnerabilities.