AI Compliance Analyst II - Healthcare preferred

CareSource•Dayton, OH

3d•$72,200 - $115,500

About The Position

The AI Compliance Analyst II develops, configures, and optimizes AI solutions and agents that support business processes and operational objectives. The role partners with stakeholders to identify opportunities for AI enablement, recommend improvements, and deliver measurable business value while aligning with governance requirements. The analyst designs, builds, and administers moderately complex solutions using Copilot, Copilot Studio, Power Automate, Nintex, and other approved tools. Responsibilities include business-level oversight, evaluating and improving solution behavior, monitoring metrics and outcomes, testing and validating outputs, and maintaining documentation about configurations, workflows, prompts, user guidance, and performance observations. The role also collaborates with technical, governance, compliance, and business partners to support responsible use, adoption, and continued improvement of AI solutions.

Requirements

Bachelor's degree in a related field; equivalent years of relevant work experience may be accepted in lieu of the required education.
Three years of experience in healthcare operations, business analysis, automation, digital transformation, technology solutions, or a related field.
Experience with AI-enabled tools, digital engagement, automation, or conversational technologies.
Understanding of generative AI tools, AI agents, large language model behavior, prompt patterns, agent instructions, model limitations, knowledge retrieval, and evaluation methods.
Ability to design AI-enabled healthcare service experiences, customer or employee journeys, conversational flows, and operational workflows.
Ability to translate complex healthcare operational needs into AI experience designs, prompts, agent instructions, business requirements, acceptance criteria, and quality standards.
Ability to support testing, validation, and quality review of AI solution outputs for accuracy, usability, and alignment with expected business outcomes.
Analytical, critical-thinking, problem-solving, facilitation, communication, and documentation skills.
Knowledge of responsible AI principles, privacy considerations, accessibility, security, risk controls, and human-in-the-loop review practices.
Ability to establish and maintain effective working relationships with cross-functional stakeholders.
Ability to manage multiple assignments, prioritize work, meet deadlines, and adapt in a fast-paced environment.
Proficiency with Microsoft Office tools, including Word, Excel, PowerPoint, Outlook, Teams, and related collaboration tools.
Working knowledge of Nintex Workflows.

Nice To Haves

Experience setting up or improving service journeys, knowledge resources, workflows, or AI-enabled experiences in a cross-functional environment.
Experience in healthcare, health insurance, or another regulated industry.

Responsibilities

Design, build, and administer moderately complex AI solutions and agents using Copilot, Copilot Studio, Power Automate, Nintex, and other approved tools.
Provide ongoing oversight of AI solutions at the business level.
Evaluate and optimize AI solution behavior and identify configuration improvements.
Monitor metrics and business outcomes.
Test, validate, and review AI solution outputs for accuracy, usability, and alignment with expected business outcomes.
Maintain documentation related to AI solution configuration, workflows, prompts, user guidance, and performance observations.
Collaborate with technical, governance, compliance, and business partners to support responsible use, adoption, and ongoing enhancement of AI solutions.
Perform other job-related duties as requested.