Principal ML Ops Engineer

Johnson & Johnson Innovative Medicine • Jacksonville, FL

20h • Hybrid

About The Position

We are seeking an experienced ML Ops Engineer to oversee and enhance our machine learning operations and AI platform ecosystem. This key leadership role will drive best practices for ML lifecycle management, govern the use of LLM APIs for GenAI solutions, and manage the growth and adoption of our enterprise AI & analytics platform for Vision, Dataiku, supporting over 70 (and growing) active practitioners. The ideal candidate will have both deep technical expertise in MLOps and AI systems architecture, and strong leadership skills to guide a cross-functional AI & analytics community.

Requirements

• Master’s Degree / PhD + 4 years’ experience, OR Bachelor’s Degree + 6 years’ experience.
• Educational degree in quantitative field, such as Statistics, Mathematics, Computer Science, Data Science, Engineering, Economics, and/or related quantitative
• Proven track record deploying and managing machine learning models at scale, preferably in production enterprise environments.
• Proficiency in Python and familiarity with ML frameworks
• Strong understanding of cloud platforms (Azure, AWS, or GCP) and containerization (Docker, Kubernetes).
• Hands-on experience with end-to-end model registry and lifecycle tools (e.g., MLflow or Kubernetes).
• Ability to implement monitoring for both system metrics (CPU/GPU) and model metrics (Drift detection, F1 score, Bias monitoring).
• Advanced knowledge of building automated pipeline (GitHub Actions, Jenkins) specifically for ML workflows.
• Hands-on experience administering Dataiku or similar AI/analytics platforms such as Databricks, SageMaker, or Vertex AI.
• Experience interpreting and communicating analytic results to analytical and non-analytical business partners
• Ability to travel both domestically and internationally may be required (~5-10%).
• Ability to flex hours to accommodate multiple time zones when necessary.

Nice To Haves

• Experience with LLM APIs, Retrieval-Augmented Generation (RAG) pipelines, and GenAI solution deployment.
• Familiarity with AI ethics, responsible AI frameworks, and compliance standards.

Responsibilities

• Define and implement MLOps strategies, workflows, and tooling to streamline model development, deployment, monitoring, and retraining.
• Build robust CI/CD pipelines for machine learning projects.
• Establish model governance and compliance standards, including documentation, monitoring, and auditability.
• Collaborate with data scientists, engineers, and IT to ensure scalable, secure, and resilient ML infrastructure.
• Oversee the integration, optimization, and cost management of enterprise-approved LLM APIs
• Serve as the platform leader and administrator for Vision’s Dataiku instance, scaling adoption and ensuring optimal performance.
• Develop and maintain governance frameworks, role-based access controls, and project management conventions for platform users.
• Organize training programs, office hours, and enablement sessions for new and advanced users.
• Partner with the Dataiku vendor and internal stakeholders to align platform roadmaps with organizational priorities.
• Perform other related tasks as assigned by management

Benefits

• Vacation –120 hours per calendar year
• Sick time - 40 hours per calendar year; for employees who reside in the State of Colorado –48 hours per calendar year; for employees who reside in the State of Washington –56 hours per calendar year
• Holiday pay, including Floating Holidays –13 days per calendar year
• Work, Personal and Family Time - up to 40 hours per calendar year
• Parental Leave – 480 hours within one year of the birth/adoption/foster care of a child
• Bereavement Leave – 240 hours for an immediate family member: 40 hours for an extended family member per calendar year
• Caregiver Leave – 80 hours in a 52-week rolling period
• 10 days Volunteer Leave – 32 hours per calendar year
• Military Spouse Time-Off – 80 hours per calendar year

What This Job Offers

• Job Type: Full-time
• Career Level: Principal
• Number of Employees: 5,001-10,000 employees