AI Analyst IV

CareSource•Dayton, OH

6d•$94,100 - $164,800

About The Position

The AI Analyst IV leads the design, implementation, and optimization of complex AI solutions and initiatives. Serving as a subject matter expert for an assigned business area, this role provides strategic guidance on AI capabilities and opportunities, aligns solutions with governance requirements, consults with stakeholders, and mentors less experienced team members. The position partners with business leaders to identify and deliver AI-enabled solutions that improve outcomes, evaluates solution performance and adoption, and drives continuous improvement. It also establishes practices for AI configuration, testing, documentation, and oversight; supports responsible AI use and risk mitigation; leads cross-functional initiatives; and researches emerging AI capabilities. The role requires a bachelor's degree in a related field or equivalent relevant work experience, along with seven years of relevant experience. Candidates must have experience with AI-enabled tools, digital engagement, automation, or conversational technologies; improving service journeys, knowledge resources, workflows, or AI-enabled experiences in cross-functional settings; and working in healthcare, health insurance, or another regulated industry. The role requires knowledge of generative AI, agents, large language models, prompts, knowledge retrieval, evaluation, responsible AI, privacy, accessibility, security, and human-in-the-loop review, as well as strong analytical, communication, facilitation, and documentation skills. The position is based in a general office environment, where employees may need to sit or stand for extended periods. Travel is not typically required. Compensation is $94,100 to $164,800, with potential eligibility for a bonus tied to company and individual performance. CareSource also offers a substantial and comprehensive total rewards package.

Requirements

Bachelor's degree in a related field; equivalent years of relevant work experience may be accepted in lieu of the required education.
Seven years of experience in healthcare operations, business analysis, automation, digital transformation, technology solutions, or a related field.
Experience with AI-enabled tools, digital engagement, automation, or conversational technologies.
Experience setting up or improving service journeys, knowledge resources, workflows, or AI-enabled experiences in a cross-functional environment.
Experience in healthcare, health insurance, or another regulated industry.
Understanding of generative AI tools, AI agents, large language model behavior, prompt patterns, agent instructions, model limitations, knowledge retrieval, and evaluation methods.
Expertise designing AI-enabled healthcare service experiences, customer or employee journeys, conversational flows, and operational workflows.
Ability to translate complex healthcare operations needs into AI experience designs, prompts, agent instructions, business requirements, acceptance criteria, and quality standards.
Ability to support testing, validation, and quality review of AI solution outputs for accuracy, usability, and alignment with business outcomes.
Strong analytical, critical-thinking, problem-solving, facilitation, communication, and documentation skills.
Knowledge of responsible AI principles, privacy, accessibility, security, risk controls, and human-in-the-loop review practices.
Ability to build and maintain effective working relationships with cross-functional stakeholders.
Ability to manage multiple assignments, prioritize work, meet deadlines, and adapt in a fast-paced environment.
Proficiency with Microsoft Office tools, including Word, Excel, PowerPoint, Outlook, Teams, and related collaboration tools.

Responsibilities

Serve as the AI subject matter expert for an assigned business area and provide strategic guidance on AI capabilities and opportunities.
Lead the design, implementation, and optimization of highly complex AI solutions, agents, and automations.
Partner with business leaders to identify, prioritize, and deliver AI-enabled solutions that improve business outcomes.
Evaluate solution performance, adoption, and business value, and drive continuous improvement.
Establish best practices for AI solution configuration, testing, documentation, and oversight.
Provide guidance on responsible AI use, governance requirements, and risk mitigation.
Lead complex cross-functional initiatives involving multiple stakeholders, processes, and technologies.
Research emerging AI capabilities and recommend innovative solutions to business challenges.
Mentor AI Analysts and provide technical leadership to support capability development and knowledge sharing.
Perform other job-related duties as requested.