Senior AI Operations Engineer
About The Position
At Claritev, we pride ourselves on being a dynamic team of innovative professionals. Our purpose is simple - we strive to bend the cost curve in healthcare for all. Our dedication to service excellence extends to all our stakeholders – internal and external - driving us to consistently exceed expectations. We are intentionally bold, we foster innovation, we nurture accountability, we champion diversity, and empower each other to illuminate our collective potential. Be part of our amazing transformational journey as we optimize the opportunity towards becoming a leading technology, data, and innovation voice in healthcare. Onward and Upward!!! As the Senior AI Ops Engineer, you will lead the advancement of our AI capabilities, focusing on engineering excellence and leveraging generative AI to enhance our end-to-end operations from experimentation to deployment. Your role will involve driving research and development in analytical techniques, creating new AI-driven products, and mentoring junior talent. With our infrastructure transitioning to Oracle Cloud Infrastructure (OCI), you will play a pivotal role in architecting, optimizing, and scaling AI workloads within OCI’s ecosystem. Join us in transforming the healthcare landscape! Two Openings!!!
Requirements
- Must have 7+ years in Data Science, 3+ years in R&D, 2+ years mentoring/managing junior engineers.
- Deep expertise in Kubernetes, CI/CD, LLMOps, and cloud-native architecture.
- Strong ML Infra experience with hands-on Terraform/K8s/IaC.
- Deep experience with LLMOps, model versioning, and hybrid GPU deployment.
- Must have fluency in Python, Bash, and container-native toolchains.
- Familiarity with open-weight LLMs (Mistral, Grok, LLaVA, etc.)
- Passion for building AI that’s not just powerful, but secure and compliant.
- Experience in dealing with Peta Bytes of data.
- Strong problem-solving, critical thinking, creativity, organizational, and communication skills.
- Bachelor's in Quantitative Science
Nice To Haves
- Exposure to taking AI agents from concept to compliance-ready production is preferred.
- Preferred Experience: Healthcare and process optimization.
- Master's or PhD preferred.
Responsibilities
- Utilize generative AI to streamline processes and tools, enabling faster and more effective development and deployment.
- Build scalable GenAI infrastructure with Terraform, Docker, Helm, and Kubernetes (OKE, AKS, and OCI-native services such as OCI Data Science, OCI AI Infrastructure, and OCI Streaming).
- Architect hybrid AI systems across OCI, Azure, and on-prem GPU clusters, ensuring seamless data and model orchestration.
- Automate model pipelines (training → fine-tuning → inference) using Jenkins, GitHub Actions, and MLflow integrated with OCI Object Storage and OCI DevOps.
- Serve multimodal LLMs with vLLM, Triton, and Streamlit dashboards deployed on OCI Container Engine for Kubernetes (OKE) and optimized for OCI GPUs.
- Deploy secure RAG-based microservices backed by Vector DBs, Databricks, and OCI AI Services (e.g., Data Labeling, Generative AI APIs) and private LLM gateways.
- Drive research and development using generative AI to create reusable code components and establish best practices for OCI-based MLOps and AI infrastructure.
- Partner with stakeholders to identify opportunities for new AI-driven products through data insights, leveraging OCI’s data and analytics stack (Autonomous Data Warehouse, Data Flow, Data Integration).
- Lead initiatives focused on the initial development of AI-powered products that utilize OCI-native AI and ML services for scalability and compliance.
- Ensure AI models are transparent, relevant, and ethically used across all environments, maintaining consistency between OCI and multi-cloud systems.
- Mentor and develop junior data scientists and engineers, fostering a culture of continuous learning and innovation in OCI and multi-cloud AI engineering.
- Ensure adherence to HIPAA regulations and data privacy standards: HIPAA, SOC2, BAA enforcement, and PHI-safe model routing within OCI’s secure architecture.
Benefits
- health insurance
- 401k
- bonus opportunity
- Medical, dental and vision coverage with low deductible & copay
- Life insurance
- Short and long-term disability
- Paid Parental Leave
- 401(k) + match
- Employee Stock Purchase Plan
- Generous Paid Time Off – accrued based on years of service
- 10 paid company holidays
- Tuition reimbursement
- Flexible Spending Account
- Employee Assistance Program
- Sick time benefits – for eligible employees, one hour of sick time for every 30 hours worked, up to a maximum accrual of 40 hours per calendar year, unless the laws of the state in which the employee is located provide for more generous sick time benefits.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
