Director, Data Engineering (Machine Learning Observability Lead)

The Travelers Companies • Saint Paul, MN

43d

About The Position

This ML Observability Lead role will build out a centralized platform for ML and GenAI observability across Business Insurance's portfolio of models, ensuring visibility into operational, data quality, and model performance insights. This role will partner closely with data scientists, decision scientists, actuaries, and other business stakeholders to define a consistent strategy and framework for monitoring models. They will standardize and consolidate logging, assemble disparate data, automate pipelines, create reports and dashboards, and enable proactive alerting.

Requirements

• Bachelor's Degree in STEM related field or equivalent
• 5+ years of relevant professional experience
• 2+ years of management or leadership experience
• Experience with Machine Learning and ML Operations
• Proficiency in ML monitoring and observability practices
• Proven ability to define and drive ML Ops strategy
• Skilled in building dashboards for model and data insights
• Experience with model monitoring and performance tracking
• Familiarity with Generative AI and Large Language Models (LLMs)
• Hands-on experience deploying and implementing machine learning models
• Knowledge of data logging and data capture methodologies
• Strong leadership and team management capabilities
• Experience with AWS Cloud services, including Databricks, CloudWatch, and SageMaker
• Advanced knowledge of data tools, programming languages, cloud platforms, and data manipulation techniques
• Bachelor's degree or equivalent training with data tools, techniques, and manipulation.
• Five years of data engineering or equivalent experience

Responsibilities

• Lead development of analytic data products, including pilots and proof of concepts.
• Execute data strategies with an understanding of enterprise architecture, consumption patterns, platforms and application infrastructure.
• Manage the operationalizing and automating of all capabilities to ensure secure, supported and scalable solutions.
• Present analysis and recommendations to help influence management decisions.
• Guide and coach team members to accelerate career development.
• Establish team processes and procedures.
• Maintain relationships with partner teams to ensure needs are met and impacted areas plan work accordingly.
• Perform other duties as assigned.

Benefits

• Health Insurance: Employees and their eligible family members - including spouses, domestic partners, and children - are eligible for coverage from the first day of employment.
• Retirement: Travelers matches your 401(k) contributions dollar-for-dollar up to your first 5% of eligible pay, subject to an annual maximum. If you have student loan debt, you can enroll in the Paying it Forward Savings Program. When you make a payment toward your student loan, Travelers will make an annual contribution into your 401(k) account. You are also eligible for a Pension Plan that is 100% funded by Travelers.
• Paid Time Off: Start your career at Travelers with a minimum of 20 days Paid Time Off annually, plus nine paid company Holidays.
• Wellness Program: The Travelers wellness program is comprised of tools, discounts and resources that empower you to achieve your wellness goals and caregiving needs. In addition, our mental health program provides access to free professional counseling services, health coaching and other resources to support your daily life needs.
• Volunteer Encouragement: We have a deep commitment to the communities we serve and encourage our employees to get involved. Travelers has a Matching Gift and Volunteer Rewards program that enables you to give back to the charity of your choice.

What This Job Offers

• Job Type: Full-time
• Career Level: Director
• Industry: Insurance Carriers and Related Activities
• Number of Employees: 5,001-10,000 employees