Senior Data Analyst, Clinical AI Evaluation & Responsible AI - 0125-US-010

Relx-posted 3 months ago
Full-time • Mid Level
Management of Companies and Enterprises
Resume
Match Score
Upload and Match ResumeTrack Jobs with Teal

Elsevier is singularly focused on helping healthcare professionals improve clinical outcomes through evidence-based care. Our generative AI team works on evaluating and implementing cutting-edge AI technologies to enhance our healthcare solutions while ensuring their safety, reliability, and compliance with healthcare standards. We are seeking a motivated individual to join our dynamic generative AI evaluation team. We focus on assessing and validating AI models that support healthcare decision-making tools. Our team ensures that our AI solutions meet rigorous standards for accuracy, fairness, and clinical relevance. The successful candidate will help evaluate model performance, analyze output quality, and ensure our AI solutions align with healthcare best practices.

  • Leading requirements gathering and development of analytics frameworks for evaluating generative AI models in healthcare applications
  • Leading and defining the strategic direction for AI evaluation methodologies in their product area
  • Managing the analytics roadmap for model evaluation
  • Collaborating with internal and external stakeholders to manage evaluation timelines and deliverables
  • Defining, developing, and deploying queries and metrics to assess AI model performance and output quality
  • Leading data model creation and maintenance for AI evaluation frameworks and monitoring systems
  • Conducting comprehensive QA of AI outputs and participating in risk analysis and mitigation
  • Understanding how security and privacy laws such as HIPAA affect AI deployment in healthcare
  • Understanding how to handle sensitive data including PHI and PII in AI contexts
  • 6-9 years of relevant experience in data analytics with focus on AI/ML evaluation
  • Bachelor's degree required, Master's or PhD preferred in Mathematics/Science
  • Demonstrated thought leadership in analytics strategy and enterprise-wide project implementation
  • Have experience in a data analytics role with focus on AI/ML evaluation
  • Have expertise in creating evaluation frameworks for large language models and other AI systems
  • Have expertise in using and querying relational database management systems such as Microsoft SQL Server, Snowflake or postgreSQL
  • Have expertise in using BI tools such as Tableau or PowerBI for AI performance visualization
  • Be able to demonstrate experience using Python for AI model evaluation and output analysis
  • Comprehensive, multi-carrier program for medical, dental and vision benefits
  • 401(k) with match and an Employee Share Purchase Plan
  • Wellness platform with incentives, Headspace app subscription, Employee Assistance and Time-off Programs
  • Short-and-Long Term Disability, Life and Accidental Death Insurance, Critical Illness, and Hospital Indemnity
  • Family Benefits, including bonding and family care leaves, adoption and surrogacy benefits
  • Health Savings, Health Care, Dependent Care and Commuter Spending Accounts
  • Up to two days of paid leave each to participate in Employee Resource Groups and to volunteer with your charity of choice
Track Jobs with Teal

Job Search Resources

•
AI Resume Builder
•
Senior Data Analyst Resume Examples
•
Senior Data Analyst Cover Letter Examples

Tools

Career Hubs

Guides

Company

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service