Senior Machine Learning Engineer

Atlassian•Seattle, WA

12d•Hybrid

About The Position

Working at Atlassian Atlassians can choose where they work – whether in an office, from home, or a combination of the two. That way, Atlassians have more control over supporting their family, personal goals, and other priorities. We can hire people in any country where we have a legal entity.

Responsibilities

Define and track core retrieval metrics (Hit@K, Precision, Recall) to objectively measure the effectiveness of the search tool across different internal datasets.
Collaborate with domain experts to curate "Golden Datasets" (Ground Truth) to benchmark passage ranking and chunking strategies against real-world agent queries.
Develop automated regression suites that flag degradation in retrieval quality before code reaches production.
Optimize the retrieval path to ensure low-latency responses, critical for multi-step agent chains where search creates compounding delays.
Serve as the primary on-call engineer for "Search Dissatisfaction" (Dissat), investigating instances where agents failed tasks due to poor information retrieval.
Perform root cause analysis on bad queries to determine if the fix requires re-indexing, better chunking logic, or updated embedding models.
Monitor system health and search saturation, proactively scaling infrastructure to handle bursty workloads from concurrent agents.