AI & Support Automation - Engineer

CertifyOS

23h

About The Position

CertifyOS is building the data infrastructure that powers modern healthcare. Today, healthcare organizations rely on fragmented and outdated provider data. This creates unnecessary administrative work, regulatory risk, and higher costs across the system. We’re solving that problem. Our API-first platform automates provider licensing, enrollment, credentialing, and network monitoring by connecting directly to hundreds of primary data sources. We help healthcare organizations maintain accurate, compliant, and reliable provider networks at scale. Our vision is simple: One API. One provider ID. Frictionless provider data. We’re backed by leading investors and built by a team with deep experience in provider data systems. At CertifyOS, we value authenticity, accountability, collaboration, results, and openness to feedback. We’re building a high-ownership team focused on solving real infrastructure problems that impact millions of patients.

Requirements

• 3+ years overall experience in software engineering, AI/ML, automation, technical operations or support technology.
• 2+ years of hands-on Generative AI/LLM application development, with demonstrated production experience.
• Experience in automation, integrations or workflow engineering.
• Strong experience taking AI/automation projects from concept and architecture through production and continuous improvement.
• Strong Python and/or JavaScript/TypeScript.
• LLM APIs and Generative AI application development.
• RAG, embeddings, vector databases and knowledge pipelines.
• AI agents, agentic workflows, tool/function calling and MCP.
• End-to-end AI/LLM pipelines: ingestion → orchestration → model → tools/actions → evaluation → production.
• REST APIs, webhooks, SQL and system integrations.
• LLM evaluation, observability, guardrails, monitoring and cost/latency optimization.
• Production deployment, CI/CD and troubleshooting of AI/automation systems.
• Strong understanding of customer-support workflows and automation opportunities.

Nice To Haves

• Experience with OpenAI/Anthropic/Claude/Gemini, Claude Code, LangChain/LangGraph, LlamaIndex, n8n/Make/Zapier/Power Automate, vector databases, AI evaluation/observability tools, AWS/Azure/GCP, Docker and CRM/helpdesk platforms such as Zendesk, Salesforce, Jira, Freshdesk or Zoho.

Responsibilities

• Identify high-impact support processes for AI/automation.
• Design, build, integrate, test and deploy AI-powered workflows and agents.
• Develop solutions using LLMs, RAG, AI agents and workflow automation.
• Build end-to-end AI pipelines covering knowledge/data ingestion, orchestration, model execution, tools/actions, evaluation and production monitoring.
• Integrate AI with CRM, ticketing, knowledge bases and internal tools.
• Monitor AI quality, accuracy, cost, latency and business impact; continuously improve solutions.
• Partner with Product and Engineering to drive AI-led transformation.

Benefits

• 100% coverage of health, dental, and vision insurance premiums for employees.
• Unlimited PTO, with at least two weeks off each year to recharge (for US-based team).
• Health insurance, statutory leave benefits, and additional wellness (menstrual) leave for women (for India employees).
• Pay transparency and an open culture where compensation conversations are encouraged and respected.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed