Sr. ML Ops Engineer

Alaffia Health•New York, NY

About The Position

Alaffia is a healthcare AI startup revolutionizing health and data automation. Our AI-driven platform leverages state-of-the-art generative AI and machine learning technologies to enhance accuracy, efficiency, and compliance in medical billing and auditing. As we scale, we are seeking a Senior AI Ops Engineer to build the cutting-edge AI solutions, drive innovation, and shape the future of healthcare automation. At Alaffia, AI is at the core of our mission. We are seeking an experienced engineer who is passionate about deploying scalable, safe, and regulatory-compliant AI-driven systems. Our AI technology powers intelligent automation for medical billing, ensuring accuracy and operational efficiency. We seek someone who thrives on building large-scale AI systems that enhance workflow efficiency, while also prioritizing all the necessary safety guardrails for responsible AI. You will have the opportunity to orchestrate various AI agents with an optimized system design that integrates AI platforms, data storage, and human-in-the-loop feedback. In this role, you’ll be shaping the future of AI-driven healthcare automation while tackling some of the most significant challenges in AI deployment and monitoring.

Requirements

8+ years of technical experience, with at least 4+ years in a dedicated software engineering role
Strong background in data modeling, versioning, and storage for AI data and annotation
Recent development experience of scalable enterprise AI products
Proficient in multiple AI frameworks, for example, MLFLow, LangChain, LangFuse, CrewAI, Weights & Bias
Firm understanding of AI software development and quality assurance procedures
Working knowledge and design skills across a wide array of databases
Experience with AI experiment tracking, monitoring, and comparison
Demonstrated ability to stay up to date with the latest AI methodologies and systems.
Exceptional problem-solving skills and the ability to work in a fast-paced, evolving environment.
Excellent communication and collaboration skills, with the ability to articulate complex technical concepts to non-technical stakeholders.

Responsibilities

Deploy NLP, OCR, and multi-modal AI products on secure cloud environments.
Design AI system, focusing on pipeline architecture and tooling to ensure scalability, observability, performance, latency and fault tolerance requirements
Design data schema and develop ETL processes to integrate data and human annotation with AI model tuning and benchmarking pipelines.
Create best practices for data and AI experiment management
Write highly robust, scalable code that is flexible, reusable, and adaptable to evolving requirements.
Ensure high code quality through rigorous code review processes and foster a collaborative engineering culture.
Build and leverage AI tools to improve developer efficiency and alignment across teams.
Proactively identify, resolve, and mitigate technical risks before deployments and releases.