Senior to Staff ML Engineer

Recruiting From Scratch • New York, NY

2d • Remote

About The Position

The ML Engineer will build and own the intelligence layer at the core of the product, including models, pipelines, and agent systems that reason over complex, sensitive enterprise data within controlled, private environments. This is a production-focused, high-stakes role supporting enterprise customers with demanding security and accuracy requirements. The role is based in or requires willingness to relocate to New York City; remote work may be accommodated initially for candidates outside New York, with relocation assistance considered case by case. Applicants must be U.S. persons because the role requires access to export-controlled information.

Requirements

• At least 4 years of experience in AI/ML engineering, with a strong emphasis on production systems.
• Deep experience fine-tuning and evaluating large language models for domain-specific applications and achieving reliable, accurate results.
• Strong experience building RAG systems, including retrieval architecture, chunking strategies, embedding models, and evaluation.
• Experience designing and deploying multi-agent systems, including orchestration, tool use, failure modes, and observability.
• Hands-on experience fine-tuning and serving open-weight models locally, including LoRA/QLoRA or full fine-tuning.
• Deep understanding of optimizing inference latency, throughput, and memory constraints in air-gapped or restricted infrastructure without external APIs.
• Strong software engineering fundamentals and ability to build and ship production systems.
• Must be a U.S. person as defined under applicable U.S. law, due to access to export-controlled information.
• Based in or willing to relocate to New York City.

Nice To Haves

• Experience with information extraction, document classification, or NLP at scale.

Responsibilities

• Design and own AI architecture, selecting, fine-tuning, and deploying appropriate models for each use case in controlled, private environments.
• Build and maintain RAG pipelines for reasoning over sensitive, proprietary enterprise data without exposing it to public APIs.
• Fine-tune foundation models on domain-specific data to meet required classification accuracy and reliability.
• Design and orchestrate specialized AI agents, including agents that process and tag internal enterprise documents and agents that monitor and analyze external data sources.
• Build evaluation frameworks, benchmarks, and observability tooling to ensure model reliability, accuracy, and auditability in production.
• Own private inference infrastructure and ensure AI systems run in controlled environments that meet demanding customer security requirements.
• Work with platform and infrastructure teams to integrate AI systems securely and scale them across the product.

Benefits

• Competitive compensation commensurate with experience.
• Meaningful equity in a company at an early and critical stage of growth.
• Comprehensive health, dental, and vision benefits.
• Opportunity to build proprietary AI at the frontier of national security infrastructure.
• Direct access to leadership and genuine influence over how the product is built.
• Relocation assistance may be available on a case-by-case basis.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed