Principal ML Solutions Architect - Token Factory

Nebius

9d • $208,000 - $261,000 • Remote

About The Position

Nebius is hiring a Principal ML Solutions Architect for Token Factory, its serverless platform for running and customizing open-source large language models in production. The platform supports serverless inference and fine-tuning, including LoRA, full fine-tuning, and reinforcement fine-tuning, and incorporates optimizations such as speculative decoding, quantization, cache-aware routing, and dedicated endpoints.

The role is the most senior technical authority for customers using Token Factory’s inference and fine-tuning platforms. The architect will lead complex customer engagements from architecture through production, optimize inference and fine-tuning workflows, resolve challenging performance and quality problems, mentor Solutions Architects, and help shape the platform roadmap in collaboration with backend, product, engineering, and research teams. The position may be performed remotely from the United States.

Requirements

• At least 8 years of experience in ML/AI systems, including at least 4 years focused on LLMs and generative AI.
• Demonstrated technical leadership, including owning ambiguous, high-impact problems end to end and influencing decisions across teams and customers.
• Expert knowledge of the LLM ecosystem, including model architectures, fine-tuning approaches, and inference internals.
• Deep hands-on command of inference optimization, including quantization, KV-cache management, batching, and routing.
• Experience running LLMs in production at scale, including deploying, operating, and debugging inference workloads at the framework level.
• Experience with LLM fine-tuning, including SFT/LoRA and data preparation or curation; experience with RL-based fine-tuning.
• Experience building task-specific LLM benchmarks and offline/online evaluation pipelines, including LLM-as-a-judge setups.
• Experience with inference frameworks and libraries such as vLLM, SGLang, and TensorRT-LLM, including reading, modifying, and contributing to their internals.
• Experience deploying LLM-powered applications using APIs from OpenAI, Anthropic, or open-source models.
• Strong Python programming skills.
• Excellent communication skills and ability to explain technical concepts to audiences ranging from engineers to executives.

Nice To Haves

• Contributions to or maintainership of major open-source inference or ML projects such as vLLM, SGLang, or TensorRT-LLM.
• Published research, conference talks, or widely read technical writing in the LLM/serving space.
• Deep experience with multimodal AI models, including vision-language or speech models.
• Proficiency with DevOps tooling such as Docker and Kubernetes, and infrastructure-as-code.
• Experience building or owning internal tooling or automation for ML workflows at scale.

Responsibilities

• Own complex, high-stakes customer engagements from architecture through production across multiple modalities, delivering measurable business value.
• Optimize LLM inference at the framework and hardware levels and document reusable best practices for the team.
• Lead supervised and reinforcement fine-tuning to maximize model quality.
• Design and implement production-ready LLM solutions using Token Factory inference services.
• Advise on prompt engineering, RAG architectures, model selection, and cost/performance trade-offs at scale.
• Partner with product, engineering, and research teams to identify customer needs, prototype platform features, and influence the roadmap.
• Guide customers from proof of concept to production, emphasizing performance, reliability, and cost efficiency, and define team standards for this work.
• Mentor Senior and mid-level Solutions Architects through review, enablement, and knowledge sharing.
• Represent Token Factory externally through talks, blog posts, and conferences.

Benefits

• 100% company-paid medical, dental, and vision coverage for employees and families.
• 401(k) plan with up to 4% company match and immediate vesting.
• Paid parental leave: 20 weeks for primary caregivers and 12 weeks for secondary caregivers.
• Remote work reimbursement of up to $85 per month for mobile and internet.
• Company-paid short-term disability, long-term disability, and life insurance coverage.
• Competitive compensation.
• Career growth and learning opportunities.
• Flexibility and ownership.
• Collaborative and innovative culture.
• Opportunity to work on impactful AI projects.
• International environment and talented teams.

What This Job Offers

• Job Type: Full-time
• Career Level: Principal
• Education Level: No Education Listed