AI Engineer I

Duly Health and Care • Downers Grove, IL

1d • $65,000 - $85,000

About The Position

The AI Engineer I is an early-career role within the Data & Analytics team, working with the AI/ML team to implement, deploy, and support AI platforms and models intended to improve patient care, operations, and the colleague experience. The position focuses on conversational AI and generative AI solutions, including the Kore.ai platform and large language model applications built on Claude, as well as the automation, monitoring, and operational practices that help keep these solutions reliable, secure, and cost-effective. It is suited to someone with programming and cloud fundamentals who wants to develop AI engineering and MLOps skills in a healthcare setting. Healthcare or Epic experience is not required; training is provided.

The role includes configuring and integrating AI solutions; supporting deployment, monitoring, and operational troubleshooting; and collaborating with technical teams and business stakeholders. The position also supports responsible AI practices, data privacy, security, and protection of PHI/PII.

Requirements

• Bachelor's degree in computer science, data science, information systems, engineering, or a related field; or 2 years of related experience; or an equivalent combination of education and experience.
• 0–2 years of experience in software development, data engineering, DevOps, or machine learning; internships, co-ops, research, and academic projects count.
• Proficiency in Python and working knowledge of SQL.
• Experience working with REST APIs and JSON.
• Solid foundation in software engineering practices, including version control, testing, and code review.
• Understanding of how LLMs work, including their strengths and limitations.
• Understanding of the machine learning lifecycle, including deployment, monitoring, and retraining.
• Strong analytical, organizational, and problem-solving skills, including troubleshooting production issues.
• Strong communication skills and ability to explain technical concepts to all levels of the organization.
• Ability to work independently and in a team-oriented environment.
• Intellectual curiosity and a desire to learn and adopt new AI and MLOps techniques.

Nice To Haves

• Experience with LLMs, prompt engineering, or GenAI frameworks.
• Experience with conversational AI or chatbot platforms, such as Kore.ai.
• Experience with Git, CI/CD, and cloud platforms (Azure preferred), Databricks, or MLflow.
• Awareness of ethical AI, data privacy, and information security considerations.

Responsibilities

• Help configure, build, and integrate conversational AI and virtual assistant solutions on the Kore.ai platform.
• Support Claude-powered applications, including API integrations, prompt and system configuration, retrieval-augmented generation (RAG) pipelines, and tool or agent workflows.
• Integrate AI solutions with enterprise systems, data sources, and APIs in collaboration with data engineers and application teams.
• Support functional and regression testing, and evaluate AI output quality, accuracy, and safety.
• Document solution designs, configurations, integrations, and release notes.
• Build and maintain CI/CD pipelines and infrastructure-as-code for deploying models, prompts, and AI applications across environments.
• Monitor AI solution performance, availability, usage, latency, and cost, and respond to alerts and incidents.
• Provide day-to-day support and troubleshooting for AI platforms and their users, escalating to vendors and senior engineers as needed.
• Support model and prompt versioning, evaluation, and retraining or refresh using the organization's ML platform and MLOps practices.
• Follow organizational standards for responsible AI, data privacy, security, and PHI/PII protection, including access control and audit practices.
• Partner with data scientists, data engineers, architects, application teams, and business stakeholders to define requirements and deliver reliable AI solutions.
• Communicate technical concepts to non-technical audiences, including clinical and operational leaders.
• Learn from senior engineers and data scientists through code reviews and mentoring.
• Stay current with advances in generative AI, conversational AI, and MLOps practices and share learnings with the team.
• Perform all other duties as assigned.

Benefits

• Comprehensive medical, dental, and vision benefits, including healthcare navigation assistance.
• Access to a mental health benefit at no cost.
• Employer-provided life and disability insurance.
• $5,250 tuition reimbursement per year.
• Immediate 401(k) match.
• 40 hours of paid volunteer time off.
• A culture committed to community engagement and social impact.
• Up to 12 weeks of parental leave at 100% pay and a financial benefit for adoption and surrogacy for non-physician team members once eligibility requirements are met.

What This Job Offers

• Job Type: Full-time
• Career Level: Entry Level