Sr. Data Scientist/Data Engineering Lead, Siri

Apple • Cupertino, CA

90d • $181,100 - $318,400

About The Position

As part of the work on machine-generated dialog, we are developing novel measurements of its quality. These include cutting-edge llm-judges for aspects like groundedness (lack of hallucinations), Siri Tone and Style (a suite of Design requirements), Safety, and others. To measure our progress on this front, we need to track the state of our dataset composition, accuracy of llm-judges, human expert review results in a central and visual representation.

Requirements

• B.S., M.S. or Ph.D. in Computer Science, Data Science, Data Engineering
• 3+ years in data-science and/or data-engineering (iceberg, pandas python, Tableau or equivalent, data collection and visualization)
• Good understanding of metrics, crowd science, annotation analysis, statistics
• Ability to work independently and cross-functionally to integrate in partner team reporting systems and pipelines
• Excellent communication skills and the ability to thrive in a highly collaborative work environment

Nice To Haves

• Good engineering practices to create sustainable and easy to use metric reporting pipelines
• Attunement to computational linguistics, language quality is a plus

Responsibilities

• Build an easy to use dashboard for our datasets - requires integration with other teams
• Build dashboards to visualize our status
• Help define useful metrics
• Build tools to facilitate processing of human review results (inter-annotator agreement, storage, selection of the most useful data points for human expert review)

Benefits

• Comprehensive medical and dental coverage
• Retirement benefits
• A range of discounted products and free services
• Reimbursement for certain educational expenses — including tuition
• Discretionary bonuses or commission payments
• Relocation assistance

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: Computer and Electronic Product Manufacturing
• Education Level: Master's degree