Software Development Engineer, AI Core Infra - AI Analytics and Insights

Amazon • Seattle, WA

1d • Onsite

About The Position

Amazon Advertising is a rapidly growing and profitable sector of Amazon, responsible for advertising solutions that enhance product discovery and sales. We deliver billions of ad impressions daily and generate vast amounts of data throughout the advertising lifecycle. We are developing a conversational AI assistant, SpektrBot, to enable data engineers, analysts, and business stakeholders to interact with our extensive advertising data lake using natural language. This AI assistant leverages state-of-the-art generative AI to translate natural language queries into accurate data retrievals, thereby accelerating insight generation and reducing the time between asking questions and receiving answers.

As a Software Development Engineer II (SDE II) on this team, you will be instrumental in designing, building, and scaling the systems that support this conversational AI experience. Your responsibilities will include architecting robust backend services, establishing reliable integrations with large language models (LLMs), developing retrieval-augmented generation (RAG) pipelines, and engineering feedback mechanisms for continuous system evaluation and improvement. You will collaborate with applied scientists, product managers, and fellow engineers in a dynamic, high-ownership environment, where your contributions will directly shape the product and influence how thousands of internal customers engage with data. This is a unique opportunity to build a novel product at Amazon's scale, situated at the convergence of generative AI, data engineering, and conversational interfaces. We are seeking individuals passionate about building production-grade AI systems, comfortable with ambiguity, and eager to see their work utilized daily across Amazon Advertising.

Requirements

• 3+ years of non-internship professional software development experience
• 2+ years of non-internship design or architecture (design patterns, reliability and scaling) of new and existing systems experience
• 1+ years of designing and developing large-scale, multi-tiered, multi-threaded, embedded or distributed software applications, tools, systems, and services using: C#, C++, Java, or Perl experience
• 1+ years of Object Oriented Design experience
• Experience programming with at least one software programming language

Nice To Haves

• 4+ years of full software development life cycle, including coding standards, code reviews, source control management, build processes, testing, and operations experience
• Bachelor's degree in computer science or equivalent

Responsibilities

• Design and build scalable services that power SpektrBot's conversational AI platform, including query orchestration, context management, session handling, and response generation pipelines
• Engineer RAG architectures — build and optimize retrievers, vector stores, embedding pipelines, and metadata indexing systems to ensure accurate and contextually relevant data retrieval from our advertising data lake
• Integrate and operationalize LLMs — build the infrastructure for prompt management, model routing, multi-agent orchestration, and chain-of-thought workflows that enable natural, multi-turn conversations
• Build automated evaluation and feedback loops — design systems that continuously measure response accuracy, detect regressions, and feed corrections back into the system to drive improvement over time
• Develop SQL generation and validation pipelines — engineer the end-to-end flow from natural language intent to generated SQL, including guardrails, query validation, and result verification to ensure trusted outputs
• Build tooling for metadata auto-curation — create LLM-powered tools that automatically enrich, classify, and maintain the metadata catalog that underpins accurate data retrieval
• Collaborate with applied scientists to productionize NLP/NLU models and integrate them into the bot's overall architecture
• Own systems end-to-end — from design through deployment, monitoring, alarming, and operational excellence in a production environment serving internal customers at scale

Benefits

• Sign-on payments
• Restricted stock units (RSUs)
• Health insurance (medical, dental, vision, prescription, Basic Life & AD&D insurance and option for Supplemental life plans, EAP, Mental Health Support, Medical Advice Line, Flexible Spending Accounts, Adoption and Surrogacy Reimbursement coverage)
• 401(k) matching
• Paid time off
• Parental leave

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: Associate degree