Machine Learning Infrastructure Engineer, Technology

Point72•New York, NY
•$180,000 - $300,000

About The Position

Point72’s Technology team builds and evolves the firm’s IT infrastructure and engineering capabilities, using open-source solutions, modern cloud architectures, and AI to support its global investment business. The Machine Learning Infrastructure Engineer designs and operates high-performance infrastructure and distributed systems for large-scale generative AI and machine learning workloads. The role supports end-to-end workflows for model training, tuning, inference, and data preprocessing, and collaborates with researchers and engineers to optimize compute utilization, throughput, and latency. It also develops deployment, orchestration, and CI/CD pipelines; manages observability, security, and costs for GPU and accelerator environments; evaluates emerging technologies across cloud and on-premises environments; and documents operational practices while mentoring engineers.

Requirements

  • Bachelor's or master's degree in computer science, electrical engineering, or a related technical field.
  • 3–7 years of experience building and maintaining scalable compute or machine learning infrastructure systems.
  • Deep understanding of distributed systems, Kubernetes, and public cloud platforms such as AWS, Google Cloud Platform, or Azure.
  • Hands-on experience with machine learning operations and infrastructure tools such as MLflow, Ray, Airflow, Kubeflow, and Terraform.
  • Strong understanding of reinforcement learning concepts and their infrastructure implications.
  • Proficiency in Python and systems-level programming in one or more of Go, C++, or Rust.
  • Strong debugging, performance profiling, and optimization skills across GPU and CPU compute stacks.
  • Experience implementing monitoring, observability, and cost optimization for GPU- or accelerator-based compute environments.
  • Excellent collaboration and communication skills with a systems-thinking mindset.
  • Commitment to the highest ethical standards.

Responsibilities

  • Design and implement high-performance infrastructure for large-scale generative AI and machine learning workloads.
  • Design and operate distributed systems for model training, hyperparameter tuning, inference, and data preprocessing pipelines.
  • Collaborate with machine learning researchers and engineers to optimize compute utilization, training throughput, and inference latency.
  • Develop and automate model and data workflow deployment, orchestration, and CI/CD pipelines using container orchestration and infrastructure-as-code.
  • Implement observability, monitoring, and cost-management strategies for GPU and accelerator compute environments.
  • Evaluate, integrate, and benchmark emerging hardware and software technologies across cloud and on-premises environments.
  • Drive security, compliance, and operational runbooks for generative AI infrastructure, including access controls, secrets management, and incident response procedures.
  • Troubleshoot, profile, and optimize performance across GPU and CPU compute stacks.
  • Document architecture and operational practices, and mentor engineers.

Benefits

  • Fully paid health care benefits.
  • Generous parental and family leave policies.
  • Mental and physical wellness programs.
  • Volunteer opportunities.
  • Non-profit matching gift program.
  • Support for employee-led affinity groups representing women, minorities, and the LGBT+ community.
  • Tuition assistance.
  • 401(k) savings program with an employer match.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service