AWS Neuron-posted about 16 hours ago
Full-time • Manager
Seattle, WA
5,001-10,000 employees

AWS Neuron is the complete software stack for the AWS Inferentia and Trainium cloud-scale machine learning accelerators and the EC2 servers that use them. As the Software Development Manager for the Neuron Testing Infrastructure Team, you will be responsible for leading a talented team of engineers to develop and maintain the critical testing service that enables continuous integration and validation across the entire Neuron SDK Development organization. You will oversee the design, development, and operation of our large-scale EKS-based test execution platform that manages thousands of test runs daily across pre-release hardware, multiple EC2 instance types, and diverse software configurations. In this role, you will manage the full lifecycle of a high-demand, business-critical service that directly impacts the velocity and quality of AWS Neuron releases. You will ensure the platform maintains strict availability goals while scaling to meet growing demand from development teams. Your team will be responsible for integrating new EC2 instance types and pre-released hardware, implementing advanced queue management algorithms, optimizing resource utilization across large EKS clusters, and maintaining operational excellence. You will collaborate with cross-functional teams including compiler, runtime, and framework teams to ensure their testing needs are met efficiently and reliably. A successful candidate will have an established background in building and operating large-scale distributed systems on AWS. Experience managing production EKS clusters at scale (500+ nodes) is essential, along with proven expertise in service reliability, queue management systems, and high-availability architecture. Direct customer-facing experience supporting internal development teams and a strong motivation to achieve results through operational excellence are critical for success.

  • Leading a talented team of engineers to develop and maintain the critical testing service
  • Overseeing the design, development, and operation of our large-scale EKS-based test execution platform
  • Managing the full lifecycle of a high-demand, business-critical service
  • Ensuring the platform maintains strict availability goals while scaling to meet growing demand
  • Integrating new EC2 instance types and pre-released hardware
  • Implementing advanced queue management algorithms
  • Optimizing resource utilization across large EKS clusters
  • Maintaining operational excellence
  • Collaborating with cross-functional teams to ensure their testing needs are met efficiently and reliably
  • 3+ years of engineering team management experience
  • 7+ years of working directly within engineering teams experience
  • 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
  • 8+ years of leading the definition and development of multi tier web services experience
  • Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
  • Experience partnering with product or program management teams
  • Hands-on experience managing large-scale EKS clusters (500+ nodes) in production environments
  • Experience with queue management systems and resource scheduling
  • Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy
  • Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers
  • Experience with logging and monitoring tools, such as: AWS CloudWatch, Datadog, New Relic and Splunk
  • Experience with Kubernetes at scale, including autoscaling, resource optimization, and multi-tenant architectures
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service