Informa Group Plc.-posted about 4 hours ago
$110,000 - $140,000/Yr
Full-time • Mid Level
Hybrid • New York, NY
5,001-10,000 employees

We are looking for a Senior Machine Learning Engineer to support our Databricks-native (i.e., Databricks Workflows, Delta Live Tables, Databricks Asset Bundles, Unity Catalog, etc.) machine learning and AI platform. In this role you will operationalize production-grade machine learning and AI models, manage deployments, and ensure robust monitoring and governance. In addition to solid technical skills, this role requires strong communication across functions, including data scientists, data engineers, and product managers; ability to drive clarity from requirements; and active participation and sense of ownership of end-to-end design, implementation, and testing of complex ML and AI workflows in a collaborative team environment.

  • Manage and support ML and AI model lifecycle using Databricks and MLflow: training, tracking, packaging, deployment, monitoring, agentic AI safety and generative AI guardrails.
  • Automate and optimize model deployment pipelines for batch and real-time use cases.
  • Collaborate with data scientists to productionize models, ensuring scalability, reproducibility, and reliability.
  • Implement CI/CD pipelines for ML and AI workflows, including testing, version control, and rollback strategies.
  • Monitor deployed models for performance drift, data quality, and SLA adherence.
  • Support governance and compliance requirements: model registry usage, auditability, reproducibility).
  • Troubleshoot and resolve issues related to model training, deployment, and integration with downstream systems.
  • Provide operational support for Databricks Workflows, Jobs, and Delta Lake integration.
  • Document processes, automation frameworks, and operational runbooks.
  • Bring best practices to bear on the team’s products and educate the team members.
  • Strong hands-on experience with Databricks (Workflows, Delta Lake, MLflow).
  • Proficiency with MLflow for experiment tracking, model registry, and deployments.
  • Experience deploying models to Databricks Model Serving, REST APIs, or external endpoints.
  • Familiarity with Python, Spark, and SQL for data and ML workflows.
  • Solid understanding of CI/CD tools (e.g., Databricks Asset Bundles, Jenkins, etc.).
  • Exposure to contemporary big data and AI stacks and technologies. Typical examples include things such as Yarn, AWS, Spark, Databricks, distributed computing, chatGPT, Claude, Copilot. but this is not an exclusive list. Our platform of choice is Databricks.
  • Solid understanding of data structures and algorithms
  • Self–discipline and willingness to learn
  • Solid verbal and written communication skills
  • Team player and ability to work well with others in an intellectually challenging environment.
  • Competency with shell scripting in a Linux environment nice to have
  • Some experience with real-time processing nice to have
  • Some experience with production support
  • Experience with 3rd party marketing clouds (such as Salesforce) nice to have
  • Competitive benefits, including a range of Financial, Health and Lifestyle benefits to choose from
  • Flexible working options, including home working, flexible hours and part time options, depending on the role requirements – please ask!
  • Competitive annual leave, floating holidays, volunteering days and a day off for your birthday!
  • Learning and development tools to assist with your career development
  • Work with industry leading Subject Matter Experts and specialist products
  • Regular social events and networking opportunities
  • Collaborative, supportive culture, including an active DE&I program
  • Employee Assistance Program which provides expert third-party advice on wellbeing, relationships, legal and financial matters, as well as access to counselling services
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service