Senior AI / ML Engineer (LLMs)

EvolutionIQ • New York, NY

12d • $200,000 - $235,000

About The Position

EvolutionIQ's mission is to deliver state of the art technology that helps insurance claims teams make claims handling more accurate, fair, and efficient, so that more people impacted by injury or illness can continue their lives with dignity and stability. We are currently experiencing massive growth and to accomplish our goals, we are hiring world-class talent who want to help build and scale internally, and transform the insurance space. Our team is our #1 priority, and we have been named one of Inc.’s Best Workplaces 3 years in a row and Built In’s Best Places to work in 2025 and 2026!

As an ambitious AI / ML Engineer, you will play a key role in advancing our industry-leading medical synthesis product. You take strong ownership of your work and have a proven track record of leading projects end-to-end, from ideation and requirements gathering through architecture, implementation, deployment, and iteration. You are comfortable operating with a high degree of autonomy, making thoughtful architectural and technical decisions, and helping guide the direction of AI/ML solutions across the product. Thriving in a fast-paced startup environment, you stay current with the latest AI and machine learning research. You’re passionate about applying hybrid approaches that combine large language models (LLMs), statistical machine learning techniques, and retrieval-augmented generation (RAG) with embeddings-based models to deliver better, more reliable outcomes for our users.

Requirements

• 5-8+ years of experience writing performant Python code following modern best practices
• Minimum 1 year of experience building and deploying products powered by large language models (LLMs) in fast-paced, professional environments
• Proven experience leading technical projects and driving them from concept through production deployment
• Experience making architectural decisions for AI/ML systems and evaluating technical tradeoffs across scalability, reliability, performance, and maintainability
• Hands-on experience with statistical machine learning techniques as well as hybrid approaches combining LLMs, retrieval-augmented generation (RAG), and embeddings-based models, including vector search and similarity measures
• Proven ability to build and integrate API services within service-oriented or microservice architectures
• Strong skills in evaluating and interpreting LLM outputs and AI model predictions, with a focus on aligning model behavior with real-world business and user outcomes
• Expertise in prompt engineering and fine-tuning of large language models for domain-specific applications
• Strong communication and collaboration skills, with the ability to influence technical direction and work effectively with Product, Engineering, SMEs, and other stakeholders

Nice To Haves

• Experience translating state-of-the-art AI/ML research into production code
• Comfortable collaborating with data labelers and subject matter experts to improve training data and evaluation processes
• Experience building agentic or autonomous AI systems in production
• Background working with multimodal data (e.g., images, audio)
• Experience mentoring engineers or providing technical leadership across projects or teams

Responsibilities

• Lead AI/ML projects end-to-end, taking ownership from initial ideation and requirements gathering through architecture, development, deployment, and ongoing optimization
• Make high-level architectural and technical decisions for AI/ML systems, balancing scalability, performance, reliability, maintainability, and business impact
• Design, build, and deploy AI-powered and LLM-driven features for our claim synthesis product, including robust extraction of key information from complex medical documents and human-in-the-loop summarization workflows
• Develop and implement hybrid machine learning solutions that leverage statistical models, LLMs, and embeddings-based retrieval techniques such as RAG to improve system accuracy, scalability, and robustness
• Write clean, scalable, and efficient code while optimizing the performance of existing AI/ML systems in production
• Collaborate closely with data labelers and subject matter experts (SMEs) to rigorously evaluate AI system outputs and continuously improve model performance
• Partner closely with Product, Engineering, and other cross-functional teams to gather requirements, define technical approaches, prioritize work, and rapidly iterate on feedback
• Provide technical leadership and guidance to other engineers, helping establish best practices and driving consistency across AI/ML solutions
• Break down complex, ambiguous problems into well-defined technical solutions and drive projects forward while balancing short-term delivery with long-term architectural considerations
• Translate cutting-edge AI/ML research and novel techniques into production-grade, reliable, and maintainable solutions that operate seamlessly in live customer environments

Benefits

• Medical, dental, vision, short & long-term disability, life insurance and AD&D, and 401k matching
• Additional family, wellness, and pet benefits
• Paid time off and sick leave
• 100% paid parental leave (16 weeks for primary caregivers and 12 weeks for secondary caregivers)
• Flexible schedule for new parents returning to work
• Catered lunches, happy hours, pet-friendly spaces, and monthly technology stipend
• $1,000/year for each employee for professional development
• Opportunities for tuition reimbursement

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed