About The Position

Bloomberg’s CTO Office is seeking a Technical Product Manager to define and execute foundational AI Infrastructure capabilities, including the cloud, compute, data, networking, and runtime foundations behind Bloomberg’s AI platforms and AI-powered products. The role will help shape how teams experiment with, access, deploy, serve, and operate AI models across infrastructure environments, and turn evolving model, cloud, and compute capabilities into reliable, reusable platform services. The role is focused on establishing common platform abstractions and paved paths that provide product teams consistent access to AI infrastructure while allowing models, hardware, and cloud environments to evolve. It sits at the intersection of AI platforms, agentic systems, cloud infrastructure, and distributed systems, and works across engineering and product teams to improve scalability, reliability, performance, and efficiency while preserving flexibility. The Technical Product Manager will identify shared infrastructure needs, establish platform direction, and drive alignment across product and organizational boundaries. The work addresses challenges arising from heterogeneous AI infrastructure, including model and provider choices, cloud placement, accelerator technologies, serving and training patterns, data locality, network topology, regulatory constraints, capacity, availability, security, and cost.

Requirements

  • 5+ years of experience in technical product management, ideally in AI, platform, cloud, compute, or infrastructure domains.
  • Experience building, operating, or product-managing large-scale platform infrastructure used by internal or external developers.
  • Experience with public cloud platforms such as AWS, GCP, or Azure, and familiarity with hybrid or multi-cloud architecture.
  • Strong understanding of distributed systems, service-to-service communication, API Gateways, Kubernetes, cloud-native architectures, and service reliability.
  • Technical fluency in tradeoffs involved in operating AI workloads, including latency, throughput, availability, scalability, accelerator utilization, and cost.
  • Familiarity working with AI or GenAI systems, including LLMs, generative AI, and their production requirements.
  • Proven ability to work cross-functionally with engineering, security, product, and platform organizations.
  • Excellent communication and storytelling skills, with the ability to translate between user needs, business priorities, and technical architecture, and influence diverse teams.

Nice To Haves

  • A degree in Computer Science, Engineering, or a related technical discipline, or equivalent practical experience.
  • Experience with GPU or accelerator infrastructure, HPC workloads, capacity planning, scheduling, or multi-tenant resource management.
  • Experience with AI infrastructure platforms, MLOps, inference or training platforms, model gateways, inference techniques, model-as-a-service offerings, or model optimization.
  • Contributions to open-source infrastructure, AI, or developer ecosystems.
  • Familiarity with financial services or other large-scale, regulated enterprise environments.

Responsibilities

  • Define and drive the vision for Bloomberg’s AI Infrastructure, focused on infrastructure across models, compute, and cloud.
  • Work with AI product and engineering teams to understand requirements for model quality, performance, scale, reliability, and cost, and translate common needs into reusable platform capabilities.
  • Partner with engineering to deliver scalable, resilient system architecture.
  • Partner with cloud and infrastructure teams to advance hybrid and multi-cloud capabilities, including portability, resilience, scalability, and integration with model and cloud providers.
  • Evaluate advances in cloud platforms, model providers, infrastructure services, model-serving technologies, accelerators, and emerging AI infrastructure capabilities, translating them into platform opportunities and roadmap decisions.
  • Establish product metrics and strategies to improve latency, throughput, availability, utilization, capacity, and cost efficiency across AI workloads.
  • Align priorities, dependencies, and investments with Engineering and stakeholders across AI Platforms, Cloud, Security, and other infrastructure organizations.
  • Anticipate how AI workloads and infrastructure requirements will evolve, balancing standardization and paved paths with flexibility and choice.

Benefits

  • Merit increases
  • Incentive compensation (exempt roles only)
  • Paid holidays
  • Paid time off
  • Medical benefits
  • Dental benefits
  • Vision benefits
  • Short- and long-term disability benefits
  • 401(k) with company match
  • Life insurance
  • Wellness programs
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service