Machine Learning Engineering Manager, Model Delivery

AutodeskSan Francisco, CA
1dHybrid

About The Position

The work we do at Autodesk touches nearly every person on the planet. By creating software tools for making buildings, machines, and even the latest movies, we influence and empower some of the most creative people in the world. As a Machine Learning Engineering Manager on the Model Delivery team within Autodesk Research, you will lead production ML engineering across deployment, monitoring, evaluation, reliability, and operational excellence for ML-powered features. This is a hands-on leadership role, combining people leadership with hands-on technical work. You’ll help deliver and operate ML systems that include 2D/3D generative models and other AI capabilities used across Autodesk products. We are a global team located in London, San Francisco, Toronto, Vancouver, and remotely, supporting in-person, hybrid, and remote work.

Requirements

  • BS/MS in CS/Engineering or equivalent experience
  • Experience building and operating software systems, including production ML systems
  • People leadership experience, or strong technical leadership experience (mentoring, setting direction, driving delivery)
  • Experience with cloud infrastructure and production observability (AWS, Azure, or GCP)
  • Experience with CI/CD, reproducible deployments, and operating services in production
  • Strong written communication and documentation skills

Nice To Haves

  • Owned an end-to-end production ML service (releases, monitoring, incidents, and improvements)
  • Experience with model evaluation, quality metrics, and continuous testing in CI/production
  • Experience optimizing inference latency and cost
  • Experience deploying large or foundation models in production (performance, scaling, and efficiency tradeoffs)
  • Experience with 3D data (geometry/CAD/BIM) and/or generative AI systems is a plus”
  • Familiarity with CAD, BIM, manufacturing, AEC, or media workflow
  • If you’re excited about this role but don’t meet every qualification, we encourage you to apply.

Responsibilities

  • Lead and grow a team of ML engineers focused on production ML systems
  • Lead model improvements in response to production issues, product feedback, and new research or platform advancements
  • Lead production release processes for ML services, including release planning, CI/CD, staged rollouts, and rollback procedures
  • Build and operate observability and on-call practices for ML features, including monitoring, alerting, dashboards, incident response, and post-incident reviews
  • Develop and maintain scalable evaluation frameworks, datasets, and automated regression tests to prevent quality regressions
  • Lead reliability, performance, and cost improvements for inference and serving, including capacity planning and meeting SLAs (latency, throughput, availability)
  • Partner with researchers, product, and platform teams to define quality bars and production readiness, including Trusted AI requirements
  • Establish and evolve production standards and governance across ML features (testing, evaluation methodology, release gates, model versioning and lineage)
  • Partner with platform and product teams to integrate ML capabilities into products

Benefits

  • From health and financial benefits to time away and everyday wellness, we give Autodeskers the best, so they can do their best work.
  • Learn more about our benefits in the U.S. by visiting https://benefits.autodesk.com/
  • Salary is one part of Autodesk’s competitive compensation package.
  • For U.S.-based roles, we expect a starting base salary between $148,500 and $266,200.
  • Offers are based on the candidate’s experience and geographic location, and may exceed this range.
  • In addition to base salaries, our compensation package may include annual cash bonuses, commissions for sales roles, stock grants, and a comprehensive benefits package.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service