Software Development Engineer, Open Data Analytics - Engines

Amazon • Arlington, VA

21h

About The Position

Want to change the world with Big Data and Analytics? Come join us on the Amazon
Analytics team in Amazon Web Services!

Amazon Athena is an analytics service that makes it easy to get insights from
Amazon S3 based data lakes using open standards like SQL, Parquet, Apache
Iceberg and others. Athena is serverless, so there is no infrastructure to set
up or manage as the service scales automatically based on data volume and query
complexity. Creating a simple, rich and performant experience for customers
requires solving challenging engineering problems.

We are working on our own scaling infrastructure (virtualization, tenant
isolation, forecasting, scheduling, containers, admission control,
infrastructure deployment) and making significant performance and reliability
improvements to our Open Source based engine (memory management,
micro-optimizations, CBO, vectorization, etc.) We’re looking for top engineers
to design and build features that bridge the gap between OSS query engines and
hyper-scaler performance.

We value highly technical, hands-on, data driven leaders who know multiple query
engine internals and are willing to learn new areas. A successful engineer is
hardwired towards engineering excellence and understands what it takes to run a
production service. We look for individuals who will set aside meaningful time
to develop themselves as we continually learn from customers.

You will work backwards from the customer needs and you will get to do
everything from designing and building large scale systems and features for the
savviest customers in the business.

By joining our team, you will get to work with a minimum of technical
supervision, while playing a variety of roles as needed to respond efficiently
to multiple program priorities. You will get to collaborate with some of the
best and brightest minds in the industry. You'll enjoy a competitive salary,
great benefits, a creative and agile work environment, and the exciting
opportunity to be part of a fast-paced and growing team and one of the most
innovative technology companies - but most of all, you will get the satisfaction
of making products that millions use everyday to great effect!
To learn more about Athena and EMR:

Amazon Athena: https://aws.amazon.com/athena/
AWS Big Data Blog: https://aws.amazon.com/blogs/big-data/

Requirements

• - Experience programming with at least one software programming language
• - 1+ years of contributing to new and current systems architecture and design (architecture, design patterns, reliability and scaling) experience
• - 2+ years of non-internship professional software development experience
• - 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• - 3+ years of experience with Master's degree in Computer Science or equivalent OR 5+ years experience with Bachelor's Degree in Computer Science or equivalent, in: software development, including design, implementation, debugging, and support
• - Very strong Computer Science fundamentals in algorithm design, data structures, problem solving, and complexity analysis
• - Strong proficiency in developing objected-oriented software, with deep experience in one or more relevant languages (Java, C, C++, C#)

Nice To Haves

• - 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• - Experience in query processing, query engines, and/or query optimization.
• - Thorough understanding of parallel algorithms, concurrency, asynchronous architectures
• - Proficiency in high-performance, multi-threaded programming
• - Knowledge of and contribution to Hadoop ecosystem

Responsibilities

• - Designing and building the next-generation technologies that will make Athena SQL the best environment to run analytic SQL at any scale
• - Working on complex problems in distributed systems and query engines.
• - Translation of complex functional and technical requirements into detailed architecture and design.
• - Deliver systems and features with top-notch quality, on time.
• - Own the software development process end-to-end, including: working with engineers and product managers to develop requirements; designing, architecting, planning, implementing, and testing new systems and features; deploying, and operating the production Athena systems.

Benefits

• health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• paid time off
• parental leave

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level