Member of Technical Staff, AI Researcher (New Stealth Startup)

Red Cell Partners

2h • $250,000 - $400,000

About The Position

Red Cell Partners is an incubation firm building and investing in technology-led companies across healthcare, cyber, and national security. Its new stealth startup is developing a platform that helps organizations in healthcare, government, and other regulated industries turn institutional knowledge into intelligence assets that improve the accuracy, reliability, and impact of AI in real-world workflows.

The Member of Technical Staff, AI Researcher is a blended research and engineering role focused on turning complex real-world workflows into evaluation frameworks, reinforcement learning environments, and feedback systems that advance frontier AI. The role investigates how data, evaluations, and feedback systems influence model behavior, while building the infrastructure and tools to test and apply those findings.

Requirements

• At least 5 years of relevant experience in machine learning, artificial intelligence, computer science, data science, software engineering, or a related technical field.
• Demonstrated ability to work at the intersection of AI research and software engineering.
• Strong Python skills and experience building reliable, scalable software.
• Hands-on experience with AI agents, model evaluations, reinforcement learning, post-training, or related systems.
• Strong understanding of frontier AI methods, including benchmarks, evaluation techniques, agent harnesses, post-training approaches, and training-data design.
• Experience building or working with reward models, automated verifiers, graders, or other model-feedback systems.
• Experience designing evaluations or experiments that measure model capability, generalization, alignment, or agent performance.
• Ability to build research prototypes and develop them into maintainable, production-quality systems.
• Strong analytical, problem-solving, written communication, and technical documentation skills.
• U.S. citizenship is required.

Nice To Haves

• An advanced degree in machine learning, artificial intelligence, computer science, data science, or a related field; equivalent research and engineering experience, including strong technical, open-source, or published output, is also encouraged.

Responsibilities

• Design and build evaluation frameworks, benchmarks, and methodologies for frontier large language models, AI agents, multimodal models, and reinforcement learning environments.
• Develop reward models, programmatic verifiers, graders, and other feedback systems that make model behavior measurable and improvable.
• Design and run controlled supervised fine-tuning and reinforcement learning experiments to measure how datasets affect model capability, generalization, and alignment.
• Research and define what makes evaluations representative of real-world work and operational environments.
• Build systems for producing high-quality human data, including expert task design, annotation methodologies, data-quality signals, and data-attribution techniques.
• Translate research questions into lightweight, rigorous experiments that generate actionable findings.
• Prototype quickly, evaluate results, diagnose failure modes, and turn findings into improved benchmarks, datasets, or technical systems.
• Move promising methods from experimentation into scalable, production-quality implementations.
• Work across research, engineering, product, and operations to advance a shared technical roadmap.
• Contribute to the broader technical community through benchmarks, open-source tools, research, and technical writing.

Benefits

• Career track opportunity with potential for rapid advancement as the firm grows, subject to strong performance.
• 100% employer-paid comprehensive medical, dental, and vision coverage for the employee and family.
• 14 weeks of paid maternity and paternity leave at normal pay.
• Unlimited PTO, with management approval.
• Professional development and continued-learning opportunities.
• Optional 401(k), FSA, and equity incentives.
• Mental health benefits through Tara Mind.
• Cost-effective GLP-1 solutions through Crux.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed