Director, Data Science - Rollout acceleration AI
About The Position
US Data Science (USDS) is building a new team to use advanced AI to bring insurance pricing programs to market faster. The team will develop evaluations for AI and agentic systems to assess their value, accuracy, and risks, enabling high-value applications to move into production with confidence. This highly visible work will shape how AI is used in the core pricing work of US Retail Markets (USRM). The role partners with one line of business—Property & Specialty, Auto, or Small Commercial—while collaborating with the other data scientists on shared methods and tools. It reports into the Rollout AI team in USDS and has a dotted-line relationship with the relevant line of business. The position will be filled at the Assistant Director or Director I level depending on skills and experience, at manager discretion. In-office requirements depend on candidate location. Candidates within 50 miles of Boston, MA; Portsmouth, NH; Seattle, WA; Columbus, OH; or Plano, TX work a hybrid schedule, attending the office two days per week. Otherwise, the role is remote with occasional travel.
Requirements
- Hands-on experience building and deploying insurance pricing models.
- Strong expertise in model evaluation, statistics, and experimental design.
- Strong coding skills, such as Python, and a track record of building and shipping data science solutions.
- Strong, recent hands-on experience with modern LLMs, including agentic coding, building LLMs into applications, and/or retrieval-augmented generation (RAG).
- Strong communication and stakeholder skills, with comfort working across business, delivery, and technology teams.
- Broad knowledge of predictive analytic techniques and statistical diagnostics of models.
- Advanced knowledge of predictive tools and the ability to serve as an expert resource for tool development.
- Ability to exchange ideas and convey complex information clearly and concisely.
- Ability to establish and build relationships within and outside the organization.
- Ability to provide effective training and presentations to management and other groups.
- Ability to use analysis results to persuade teams and department or senior management toward a course of action.
- Broad knowledge of business drivers and market context, and a value-driven understanding of work context and impact.
- Competencies typically acquired through a Ph.D. in Statistics, Mathematics, Economics, Actuarial Science, or another scientific field and at least 3 years of relevant experience; a master's degree in a scientific field and at least 6 years of relevant experience; or a bachelor's degree in a scientific field and at least 8 years of relevant experience.
- Resilience, curiosity, commitment to finding the best answer, high personal standards, and a desire to work with others who share those qualities.
Nice To Haves
- Experience evaluating generative AI or agentic systems.
Responsibilities
- Partner with pricing, delivery, and technology teams in the assigned line of business to identify where AI can accelerate pricing program rollout.
- Build evaluations for AI and agentic applications, including defining accuracy metrics and ground truth, generating statistical tests and edge cases, and designing experiments such as production tests.
- Measure the value and risk of AI applications, including effort reduced, errors avoided, and time to market gained.
- Apply pricing expertise and product sense to translate business needs into AI project requirements and evaluation criteria.
- Prototype and build evaluation tooling and, over time, AI applications that accelerate rollout.
Benefits
- Comprehensive benefits that support employees' life and well-being.
- Workplace flexibility.
- Professional development opportunities.
- Employee Resource Groups.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
