Staff Machine Learning Engineer

Mural Group•Madison, MS

3d•$230,000 - $300,000•Remote

About The Position

Mural Group is recruiting on behalf of a late-stage, venture-backed enterprise AI company for a Staff Machine Learning Engineer to set the technical direction for its agent systems. The role involves model and systems work that ships to large enterprise customers. The engineer will design multi-step LLM systems involving reasoning, retrieval, planning, and tool use; own evaluation across offline benchmarks, online experiments, and model-graded review; and identify and address failure modes such as hallucination and tool misuse. The role also sets quality, latency, and cost targets, mentors senior engineers, and shapes how the group works.

Requirements

At least 7 years of experience shipping machine learning in production, including LLMs at scale.
Experience leading the design of complex, multi-step LLM systems.
Deep knowledge of transformers, embeddings, and retrieval.
Evaluation experience beyond single prompts.
Experience with PyTorch or a similar framework on distributed cloud infrastructure.
Bachelor of Science in Computer Science or a related field.

Nice To Haves

A master's degree or PhD.
Experience shipping machine learning before the LLM era and then moving into generative AI.
Detailed retrieval experience, including chunking, reranking, and evaluations.

Responsibilities

Design multi-step LLM systems for reasoning, retrieval, planning, and tool use.
Own evaluation, including offline benchmarks, online experiments, and model-graded review.
Identify and fix failure modes such as hallucination and tool misuse.
Set the quality, latency, and cost targets the team builds against.
Mentor senior engineers and shape how the group works.