Senior AI Engineer

Incredible Health

1d • Remote

About The Position

This is a hands-on role for an engineer with range: notebook in the morning, eval suite by afternoon, production by Friday — full stack, all the way to the user. You think in systems, tradeoffs, and outcomes, not just models — and you'd rather ship a good feature that helps 10,000 nurses today than a perfect model that stays in a notebook.

This role is 100% remote and can be located in the following states: Alabama, Arizona, California, Colorado, Connecticut, District of Columbia, Florida, Georgia, Idaho, Illinois, Indiana, Iowa, Maryland, Massachusetts, Michigan, Minnesota, Mississippi, Missouri, Nebraska, Nevada, New Jersey, New York, North Carolina, Ohio, Oregon, Pennsylvania, South Carolina, Tennessee, Texas, Utah, Virginia, Washington, West Virginia

Requirements

• 6+ years of software engineering, including 2+ recent years taking ML- and LLM-powered features from concept through deployment and long-term production maintenance.
• Strong Python software engineering skills — with the depth to independently run, validate, and interpret a ranking-model retrain, an embedding pipeline, or an eval harness.
• Evaluation for non-deterministic systems: golden datasets, LLM-as-judge, regression tests that gate launches.
• Core ML foundations — classification, ranking, model evaluation — and the rigor to know what offline metrics predict about real users.
• Production LLM experience (prompt engineering, tool calling, structured outputs, agent and voice workflows), plus SQL-driven product analysis and the notebook fluency to set up an environment and train or run a model on your own box.

Nice To Haves

• Marketplaces or recommendation systems where both sides say yes.
• Voice agents in production.
• Embedding retrieval at scale.
• Claude Code as a daily force multiplier.
• Confident full-stack contributor.
• Ownership and adaptability: product-driven engineers who start from outcomes, work backwards to impact and step up independently to deliver for the team.
• Startup ethos is your default setting.

Responsibilities

• Lead LLM-powered products end to end using the foundation models best suited to the job: prototype a capability, validate it with evals, deploy, monitor, and iterate.
• Take end-to-end ownership of matching, search, and ranking — model design, offline validation, shadow-scoring, and A/B experiments — across embeddings and ElasticSearch.
• Ship production code across the stack — Python ML services, Rails and React web app — and diagnose whatever breaks: hallucinations, retrieval misses, ranking regressions.
• Turn ambiguous questions into production-minded data analysis that changes what we build, and raise the bar through rigorous code review with our ML, AI, and product engineers.

Benefits

• Competitive, market based salary aligned with your skills and experience
• Comprehensive benefits package covers medical, dental and vision coverage with shared premiums
• Company sponsored 401(k) allows you to save for retirement
• Commission and/or equity may be offered based on the position
• Unlimited vacation, so take a break when you need it!
• Generous family leave policy so that you can spend time bonding with new additions to your family.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed