Software Development Engineer II, Amazon Security Data Engineering

Amazon • Herndon, VA

9d • $143,700 - $194,400 • Onsite

About The Position

If you thrive in a fast-paced, innovative environment and are interested in pushing the boundaries of what's possible with big data, cloud computing, and security analytics, Amazon Security Platform Engineering is the place for you. We support a suite of services and products to ingest, optimize and query petabyte scale datasets efficiently, and enable critical security use cases such as incident response, security analytics, threat-hunting, and low-latency detection.

Requirements

• Strong software engineering fundamentals, including expertise in object-oriented design, algorithms, and data structures
• Experience building and operating scalable, fault-tolerant, distributed systems
• Proficiency in Java, Scala or Python with a solid understanding of multi-threading and memory management
• Knowledge of big data compute engines such as open table formats like Apache Iceberg, and Apache Spark, Trino, Flink.
• Excellent verbal and written communication skills
• Self-motivation and the ability to deliver high-quality results in a fast-paced environment.
• 3+ years of non-internship professional software development experience
• 3+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 3+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
• 3+ years of Object Oriented Design experience
• Bachelor's degree or foreign equivalent in Computer Science, Engineering, Mathematics, or a related field

Nice To Haves

• 3+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience

Responsibilities

• Build and support Amazon Security's Data Lake, consisting of services for data cataloging, optimization, compaction, re-organization, and indexing at petabyte scale.
• Drive technical vision and contribute to the roadmap for systems that manage petabyte-scale data catalogs supporting Apache Iceberg, AWS Glue, Parquet, and other formats.
• Design and implement distributed systems for data optimization that balance multiple latency scenarios from minute-level batch detections to month-spanning threat hunting queries.
• Modernize security intelligence platform's data catalog and governance services to provide customers with rule-based access controls and fine-grained data access.
• Build and support query platform services for query scheduling, routing, auditing, and engine built on Apache Spark.
• Optimize data ingestion and cataloging systems that handle petabytes of data.
• Partner with data engineers and security teams across AWS, Amazon Stores, Digital, and other business units to understand requirements and deliver platform capabilities.
• Uphold software engineering best practices, code quality standards, and operational excellence.
• Explore and build AI driven data discovery capabilities using catalog metadata to help security analysts find relevant datasets faster.
• Work with AI/ML powered developer tools across the full SDLC, from AI assisted code reviews and design to agentic operational response

Benefits

• health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• paid time off
• parental leave
• sign-on payments
• restricted stock units (RSUs)

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level