R-106449 EverHealth - AI Quality and Content Specialist (Remote, Canada)

EverCommerce

1d • CA$55,000 - CA$62,000 • Remote

About The Position

EverHealth, a business within EverCommerce, is seeking an AI Quality & Content Specialist to ensure the accuracy, reliability, and continuous improvement of its AI support experience. This role will serve as the quality gatekeeper, identifying risks, improving performance, and building trust in AI across customers and internal teams. The specialist will also be responsible for the ongoing auditing and governance of the knowledge and source content that powers AI experiences, ensuring that AI outputs remain accurate, trustworthy, and operationally effective. EverCommerce is a leading service commerce platform providing integrated SaaS solutions to service-based businesses globally. EverHealth specifically offers end-to-end solutions for healthcare providers, including five SaaS products: DrChrono, iSalus, CollaborateMD, Updox, and MDTec.

Requirements

• Must be eligible to work without sponsorship.
• Must be able to travel to Corporate Headquarters in Denver, Colorado, or other office locations around North America as needed.

Nice To Haves

• Experience in AI Quality Assurance.
• Experience in content governance.
• Familiarity with SaaS products in the healthcare industry.
• Experience with AI performance reporting and dashboard creation.
• Knowledge of AI training and optimization processes.

Responsibilities

• Audit AI-generated responses across chat, cases, and self-service flows to identify hallucinations, assumed resolves, incomplete answers, and compliance risks.
• Score AI performance against defined QA frameworks.
• Audit and validate knowledge content, workflows, and source materials leveraged by AI systems to ensure accuracy, comprehensiveness, compliance, and alignment with current product functionality and support policies.
• Identify outdated, conflicting, incomplete, or low-confidence content that may negatively impact AI-generated responses and customer experience.
• Establish ongoing content governance processes to maintain AI readiness across help center articles, macros, internal documentation, and workflow logic.
• Analyze AI failures, including content gaps, poor prompt handling, and edge cases, to provide actionable insights to the Content Strategist and Head of Support.
• Create a feedback loop with Product and Engineering teams, acting as the voice of the customer.
• Build and maintain dashboards tracking resolution accuracy, escalation drivers, and customer sentiment (AI vs. human).
• Surface trends and recommend improvements for AI performance.
• Partner with stakeholders to retrain AI, improve knowledge content, and adjust workflows and guardrails.
• Help establish a closed-loop AI optimization system.
• Partner with Content, Product, Engineering, and Support stakeholders to continuously optimize and maintain AI source content quality.
• Create scalable auditing mechanisms to proactively identify content gaps, stale documentation, and areas where AI confidence or resolution quality declines.
• Help define standards for AI-consumable knowledge design to improve answer consistency, containment, and customer trust.

Benefits

• Flexibility to work where/how you want within your country of employment – in-office, remote, or hybrid
• Robust wellness benefits, including an annual wellness stipend
• 3 weeks of vacation to start
• A paid volunteer day of your choosing
• 2 floating holidays to celebrate anything of significance to you
• Employee Stock Purchase Program
• Registered Retirement Savings Plan (RRSP) with 4% company match

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed