(USA) Staff, Software Engineer - AI-RAG Expert

Walmart

118d • $143,000 - $286,000

About The Position

Walmart Global Tech is at the forefront of AI innovation, leveraging cutting-edge technologies to redefine customer experiences. We are seeking a Staff, Software Engineer with deep expertise in Generative AI, Agentic AI, LLMs, and RAG frameworks to lead the design, development, and deployment of advanced AI systems. This role involves architecting scalable solutions, integrating agentic frameworks, and mentoring engineering teams to push the boundaries of AI-driven innovation.

Requirements

• Overall 4+ years of experience in machine learning / software engineering, with 2+ years in Generative AI or LLMs.
• Strong experience with RAG frameworks, vector search technologies and knowledge grounding techniques.
• Expertise in Python, ML frameworks (PyTorch, TensorFlow), and libraries like Hugging Face Transformers.
• Proficiency in distributed computing, cloud platforms (GCP, Azure), and scalable architectures.
• Familiarity with disaster recovery principles and building resilient, fault-tolerant systems.
• Experience with multi-modal models (text, image, video) and advanced optimization techniques (e.g., quantization, distillation).
• Experience with Generative AI models (e.g., GPT, Gemini) and their fine-tuning.
• Strong understanding of system design, non-functional requirements, and design patterns.

Nice To Haves

• Master’s degree in Computer Science, Computer Engineering, Computer Information Systems, Software Engineering, or related area and 2 years' experience in software engineering or related area.
• Background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly.

Responsibilities

• Design, fine-tune, and deploy Generative AI models with a focus on RAG frameworks to enhance information retrieval and generation.
• Develop and optimize LLM-based agents for tasks like knowledge grounding, multi-step reasoning, and decision-making.
• Integrate external data sources (e.g., vector databases) with LLMs to build dynamic, context-aware systems.
• Assist in architecting scalable, distributed AI systems with a focus on performance, fault tolerance, and disaster recovery.
• Develop detailed design specifications, including modular, extensible, and functional components.
• Build MVPs to validate requirements and refine designs iteratively.
• Partner with architects to design AI for platform consumption.
• Work cross-functionally to design solutions that address both functional and non-functional requirements.
• Assist in establishing best practices for building and maintaining AI-driven systems.
• Act as a mentor, fostering technical growth within the team and contributing to a culture of continuous learning and innovation.

Benefits

• Competitive pay and performance-based bonus awards.
• Health benefits including medical, vision and dental coverage.
• Financial benefits including 401(k), stock purchase and company-paid life insurance.
• Paid time off benefits including PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting.
• Short-term and long-term disability.
• Company discounts.
• Military Leave Pay.
• Adoption and surrogacy expense reimbursement.
• Live Better U education benefit program for full-time and part-time associates.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: Bachelor's degree
• Number of Employees: 11-50 employees