Software Development Manager, Open Data Analytics Engines
About The Position
Amazon EMR is a web service that enables customers to run massive clusters with open-source data processing frameworks like Apache Spark, Hive, Presto, Hadoop, HBase and more, with the ability to scale up and down as needed. EMR runs across multiple deployment modes (EC2, EKS, and Serverless), serving millions of clusters across all AWS regions. The ODA Fundamentals team owns the end-to-end lifecycle of releases across Amazon EMR (EC2, EKS, Serverless), AWS Glue, and Amazon Athena. We build, validate, register, and distribute AMIs and Docker images that power every cluster. We own the Kamino pipeline, the automated system that takes open-source frameworks and packages them into production-ready releases. We also own patching (in-place and OS-level), region builds (launching services in new AWS regions), and release automation tooling. Our pipeline directly impacts every EMR, Glue, and Athena customer. We are looking for a Software Development Manager to lead a team of 13-15 engineers building the next generation of release automation for Open Data Analytics. You will own reducing operational toil, improving release velocity, and scaling our pipeline to new services and regions. Your team will design and implement services that automate the build, validation, and distribution of releases across all deployment modes. You will drive the architecture and delivery of distributed systems that must be reliable, scalable, and secure, because failures in our pipeline block releases for the entire ODA organization. As a manager on this team, you will set the technical direction for release infrastructure, define the roadmap for automating manual operational work, and ensure our services are available in every AWS region. You will balance investing in new automation capabilities against maintaining the reliability of existing pipelines. You will hire, develop, and retain strong engineers, and create an environment where the team delivers high-quality software at increasing velocity.
Requirements
- 3+ years of engineering team management experience
- 7+ years of working directly within engineering teams experience
- 3+ years of designing or architecting (design patterns, reliability and scaling) of new and existing systems experience
- Knowledge of engineering practices and patterns for the full software/hardware/networks development life cycle, including coding standards, code reviews, source control management, build processes, testing, certification, and livesite operations
- Experience partnering with product or program management teams
Nice To Haves
- Experience in communicating with users, other technical teams, and senior leadership to collect requirements, describe software product features, technical designs, and product strategy
- Experience in recruiting, hiring, mentoring/coaching and managing teams of Software Engineers to improve their skills, and make them more effective, product software engineers
- Experience with release engineering, infrastructure-as-code, container image pipelines, or AMI build systems
Responsibilities
- Lead a team of 13-15 engineers building the next generation of release automation for Open Data Analytics.
- Own reducing operational toil, improving release velocity, and scaling our pipeline to new services and regions.
- Design and implement services that automate the build, validation, and distribution of releases across all deployment modes.
- Drive the architecture and delivery of distributed systems that must be reliable, scalable, and secure.
- Set the technical direction for release infrastructure.
- Define the roadmap for automating manual operational work.
- Ensure our services are available in every AWS region.
- Balance investing in new automation capabilities against maintaining the reliability of existing pipelines.
- Hire, develop, and retain strong engineers.
- Create an environment where the team delivers high-quality software at increasing velocity.
Benefits
- health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
- 401(k) matching
- paid time off
- parental leave
- sign-on payments
- restricted stock units (RSUs)
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Manager
Education Level
No Education Listed
