Machine Learning Engineer

Arena Intelligence, Inc. • Bay Area, CA

1d

About The Position

Arena Intelligence is seeking a Machine Learning Engineer to help scale and strengthen the core infrastructure powering real-world AI evaluation. The role helps shape how the company builds, deploys, and improves model benchmarking systems, working across data pipelines, inference APIs, and evaluation methodologies. The position offers an opportunity to apply technical expertise to a platform used by millions and help define how cutting-edge AI is assessed in real-world settings.

As one of the first ML engineers on the team, the successful candidate will work closely with researchers, engineers, and product leadership to turn ideas into reliable systems. The role focuses on improving reproducibility, supporting new modalities, and advancing the ability to understand and compare frontier models while contributing to a centralized, scalable evaluation platform.

Requirements

• Strong programming skills and ability to work across the stack in a typical recommendation system or LLM stack.
• Experience in deep learning, language models, or reward model training.
• Experience working with LLMs for fine-tuning, prompt engineering, function calling, and related tasks.
• Self-motivation and willingness to take ownership of tasks.
• Passion for shipping quality products.
• At least 4 years of industry experience or relevant projects.
• Solid understanding of statistics and tools and methodologies for evaluating uncertainty in ways specific to the product being shipped.

Responsibilities

• Architect and build core modeling for data and evaluation products.
• Own data, model training, and evaluation pipelines across the full stack.
• Help grow a culture of feedback and rapid product iteration while building new features as part of a tight-knit team.
• Research state-of-the-art evaluation methods and contribute to the long-term vision for a centralized, scalable evaluation platform.

Benefits

• Competitive compensation aligned to the markets where team members are based; compensation depends on the candidate's experience and work location.
• Comprehensive health and wellness benefits, including medical, dental, vision, and additional support programs.
• Opportunity to work on cutting-edge AI with a small, mission-driven team.
• A culture that values transparency, trust, and community impact.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed