Sr. Software Engineer, Open Data Analytics - Engines

Amazon • Arlington, VA

1d

About The Position

AWS Utility Computing (UC) provides product innovations — from foundational
services such as Amazon’s Simple Storage Service (S3) and Amazon Elastic Compute
Cloud (EC2), to consistently released new product innovations that continue to
set AWS’s services and features apart in the industry. As a member of the UC
organization, you’ll support the development and management of Compute,
Database, Storage, Internet of Things (Iot), Platform, and Productivity Apps
services in AWS, including support for customers who require specialized
security solutions for their cloud services.

Amazon EMR is a web service which enables customers to run massive clusters with
open-source data processing frameworks like Spark, Trino, Flink, Hive, Hadoop,
HBase and more, with the ability to effortlessly scale up and down as needed. We
run large number of customer clusters, enabling a variety of customer use cases
including analytics and web-scale machine learning. Our team is committed to
building and operating the most secure, easy and cost-effective services to run
analytics. Security, compliance, service availability, performance, accurate
tracking of resource usage and billing is a shared responsibility across the
team and their components, audited and governed by our weekly operational and
business review mechanisms. We are doing innovative work on the open source data
processing frameworks with the goal of making the EMR the best place to run big
data workloads.

We're looking for an engineering technical leader who is both passionate and
thrilled by the opportunity to dive deep in the space of analytics engine,
engine reliability and performance and scaling analytics applications. You will
have a chance to work with the open source community and contribute to open
source projects including Spark, Trino, Flink, Hive, Hadoop and HBase. You will
work backwards from the customer needs and you will get to do everything from
designing and building large scale systems and features for the savviest
customers in the business. You'll help shape the technology, product and
business by building enhancements that impact some of the largest AWS customers.
A successful candidate will bring deep technical and software expertise, strong
skills in building and refining mechanisms to drive goals/initiatives, and
passion for helping team members grow. You need to not only be a top software
developer with excellent programming skills, an understanding of distributed
systems and parallel data processing, and a stellar record of delivery but also
excel at leadership and customer obsession and have a real passion for
massive-scale computing. You should be a self-starter with a bias towards
independent problem solving. Clear communication and prioritization will be
important as you partner with Product Management to plan, and deliver
experiences for Data processing. You have a passion for managing complex
technology projects and helping the team make strong business judgments.

How do you know if you are a good fit for us? You are fascinated by the
challenge of building innovative, global-scale software systems. You value the
purposefulness and connect to customers in every action, decision and code
delivered. You are inspired by difficult problems and by quickly finding
solutions that will stand the test of time. You relish the opportunity to take
active ownership for building and operating a service that delights customers.
You have a passion for open-source software and relish the opportunity to engage
and build software together.

By joining our team, you will get to work with a minimum of technical
supervision, while playing a variety of roles as needed to respond efficiently
to multiple program priorities. You will get to collaborate with some of the
best and brightest minds in the industry. You'll enjoy a competitive salary,
great benefits, a creative and agile work environment, and the exciting
opportunity to be part of a fast-paced and growing team and one of the most
innovative technology companies - but most of all, you will get the satisfaction
of making products that millions use everyday to great effect!
To learn more about EMR:

AWS EMR: https://aws.amazon.com/emr/
AWS Big Data Blog: https://aws.amazon.com/blogs/big-data/

Requirements

• 5+ years of non-internship professional software development experience
• 5+ years of programming with at least one software programming language experience
• 5+ years of leading design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• Experience as a mentor, tech lead or leading an engineering team
• Very strong Computer Science fundamentals in algorithm design, data structures, problem solving, and complexity analysis
• Strong proficiency in developing objected-oriented software, with deep experience in one or more relevant languages (Java, C, C++, C#)

Nice To Haves

• 5+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Experience in query processing, query engines, and/or query optimization.
• Thorough understanding of parallel algorithms, concurrency, asynchronous architectures
• Experience designing and building highly-scaled distributed systems and web services
• Experience working in an agile software development organization
• Proficiency in high-performance, multi-threaded programming
• Knowledge of and contribution to Hadoop ecosystem
• Experience with distributed systems architecture
• Proven ability to effectively drive cross-team solutions that may have complex dependencies
• Masters in Computer Science with emphasis on distributed systems and Big Data architectures is a plus.

Responsibilities

• Own system architecture, scalability, reliability, and performance
• Translate functional and technical requirements into detailed architecture, design and extensible code
• Participate in architecture, design and code reviews to maintain our high development standards
• Technically lead and mentor a team of smart engineers on distributed systems and query engines, defining our challenging technical culture, and helping to build a fast-growing team
• Be an advocate of industry best-practices to produce reliable, fault-tolerant and dependable code
• Code and test complex system modules; develop and leverage frameworks to be effective and efficient
• Collaborate and influence other teams to deliver and operate large scale, distributed services in the cloud

Benefits

• competitive salary
• great benefits
• creative and agile work environment
• opportunity to be part of a fast-paced and growing team and one of the most innovative technology companies
• full range of medical, financial, and/or other benefits

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed