Senior Machine Learning Engineer
About The Position
Atlassian is betting that the next era of teamwork will be shaped by people and AI agents working together, with Rovo as the intelligent teammate that understands an organization’s context and helps move work forward. Turning Rovo’s reach into lasting customer value, experiences people trust, return to, and rely on, is central to Atlassian’s ambition to lead in AI and to our next chapter of growth. Getting quality right is what turns that ambition into customer success, deeper adoption, and durable business impact. You’ll join the Rovo Chat Quality team within Atlassian’s Rovo + AI organization. We are the team that turns “make Rovo better” into something we can measure, understand, and ship. We build the evaluation systems, datasets, quality signals, and production ML capabilities that reveal where Rovo succeeds, where it falls short, and which changes make it meaningfully more useful to customers.
Requirements
- A track record of architecting and shipping large-scale ML or AI systems that deliver measurable customer and business impact.
- Deep experience with LLM-powered products, agentic systems, model evaluation, experimentation, and dataset development.
- Strong production engineering skills and the ability to remain hands-on in a modern ML stack.
- Technical leadership: setting direction, influencing across teams, and leading complex initiatives from ambiguity to production.
- Excellent product and technical judgment, including balancing quality, speed, reliability, safety, latency, and cost.
- The ability to communicate complex ideas clearly and raise the effectiveness of engineers around you through mentorship and technical leadership.
Responsibilities
- Architect and build production ML and evaluation systems that operate at scale, including datasets, simulations, automated judges, regression suites, experimentation platforms, and online quality signals.
- Advance the state of Rovo’s agentic capabilities across reasoning, planning, tool selection and use, action correctness, retrieval, memory, and long-horizon execution.
- Close the loop between evaluation and product impact: identify systemic failure modes, develop interventions, ship them to production, and establish whether they improved customer outcomes.
- Make high-leverage technical decisions across model choice, prompting, fine-tuning, data strategy, system architecture, and inference; balancing quality with latency, reliability, safety, andించడం.
- Lead ambitious, cross-organizational initiatives with ML, engineering, product, analytics, research, and design partners, creating clarity and momentum where neither the problem nor the solution is well defined.
- Establish reusable methods, systems, and quality standards that raise the bar not only for Rovo Chat, but for AI-powered experiences across Atlassian.
- Multiply the impact of other engineers through technical leadership, design reviews, mentorship, and a compelling long-term vision for how we build and evaluate world-class AI products.
Benefits
- health and wellbeing resources
- paid volunteer days
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
