Senior Machine Learning Engineer

Atlassian • Seattle, WA

12d

About The Position

Working at Atlassian Atlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity.

Responsibilities

• Search Quality Definition & Evaluation
• Define and track core retrieval metrics (Hit@K, Precision, Recall) to objectively measure the effectiveness of the search tool across different internal datasets.
• Collaborate with domain experts to curate "Golden Datasets" (Ground Truth) to benchmark passage ranking and chunking strategies against real-world agent queries.
• Develop automated regression suites that flag degradation in retrieval quality before code reaches production.
• Latency Optimization & High-Scale Engineering
• Optimize the retrieval path to ensure low-latency responses, critical for multi-step agent chains where search creates compounding delays.
• Operational Excellence & Quality "Dissat" Response
• Serve as the primary on-call engineer for "Search Dissatisfaction" (Dissat), investigating instances where agents failed tasks due to poor information retrieval.
• Perform root cause analysis on bad queries to determine if the fix requires re-indexing, better chunking logic, or updated embedding models.
• Monitor system health and search saturation, proactively scaling infrastructure to handle bursty workloads from concurrent agents.

Benefits

• Atlassian offers a wide range of perks and benefits designed to support you, your family and to help you engage with your local community. Our offerings include health and wellbeing resources, paid volunteer days, and so much more.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed
• Number of Employees: 5,001-10,000 employees