Staff, Software Engineer - Backend

Walmart • Bentonville, AR

1d • $110,000 - $220,000

About The Position

Walmart's Enterprise Business Services (EBS) is a powerhouse of seven exceptional teams delivering world-class technology solutions and services making a profound impact at every level of Walmart. As a key part of Walmart Global Tech, our teams set the bar for operational excellence and leverage emerging technology to support millions of customers, associates, and stakeholders worldwide. Joining EBS means embarking on a journey of limitless growth, relentless innovation, and the chance to set new industry standards that shape the future of Walmart. About Team: The Enterprise People Technology team supports the successful deployment and adoption of new People technology across the enterprise. As a Fortune #1 company, our work impacts millions of associates globally. We strive to continuously improve people technology and products to help managers and associates so they can focus on what matters most—supporting our customers and members. People Technology is one of the major segments of Walmart Global Tech’s Enterprise Business Services, which is invested in building a compact, robust organization that includes service operations and technology solutions for Finance, People, and the Associate Digital Experience. Walmart’s Associate Experience Platform team is seeking an exceptional Staff Software Engineer to strengthen our GenAI experience platform. You will be hands-on developing critical platform capabilities with cutting-edge GenAI technologies, building reusable and extensible platform services, and ultimately bringing GenAI to the day-to-day of 2.2M Walmart associates worldwide.

Requirements

• Python guru with a proven track record of writing high-performing, production-quality code.
• Hands-on experience designing and building Python-based web services in a production setting (FastAPI experience preferred).
• Deep familiarity with version control using Git in collaborative team environments.
• Comfortable working with Linux environments and containerization technologies such as Docker.
• 4+ years of industry experience with demonstrated ownership and delivery of software products.
• Option 1: Bachelor's degree in computer science, computer engineering, computer information systems, software engineering, or related area and 4 years’ experience in software engineering or related area.
• Option 2: 6 years’ experience in software engineering or related area.

Nice To Haves

• Hands-on experience developing or deploying GenAI-based applications (e.g., large language models, generative AI frameworks).
• Experience working with or integrating open-source and/or commercial GenAI libraries/frameworks such as Hugging Face Transformers, LangChain, OpenAI API, or similar.
• Ability to productionize and evaluate GenAI models.
• Familiarity with prompt engineering, vector databases (e.g., Pinecone, FAISS, Weaviate), and orchestration tools for GenAI workflows.
• Experience with semantic routing, including designing systems that direct user queries or tasks to the appropriate AI agents or models based on content, intent, or context.
• Ability to analyze, test, and improve semantic routing algorithms and evaluate their effectiveness using data-driven approaches.
• Awareness of responsible AI principles, including model evaluation, bias mitigation, and production monitoring.
• Experience developing large-scale data pipelines in contexts such as e-commerce, recommender systems, or similar domains.
• Exposure to MLOps practices and tools (e.g., MLflow, Kubeflow, Airflow) for managing model lifecycle and deployment.
• Experience with observability and monitoring tools for production AI systems.
• Master’s degree in Computer Science, Computer Engineering, Computer Information Systems, Software Engineering, or related area and 2 years' experience in software engineering or related area
• We value candidates with a background in creating inclusive digital experiences, demonstrating knowledge in implementing Web Content Accessibility Guidelines (WCAG) 2.2 AA standards, assistive technologies, and integrating digital accessibility seamlessly.
• The ideal candidate would have knowledge of accessibility best practices and join us as we continue to create accessible products and services following Walmart’s accessibility standards and guidelines for supporting an inclusive culture.

Responsibilities

• Design and develop platform features enabling advanced semantic routing for GenAI-powered services, ensuring requests are intelligently directed to the most appropriate models or agents based on context and intent.
• Build and maintain evaluation pipelines for semantic router data, including the development of metrics, dashboards, and automated tests to assess routing accuracy, system performance, and user satisfaction.
• Collaborate with applied researchers and data scientists to continuously improve semantic routing algorithms and integrate the latest advancements in natural language understanding.
• Develop and implement agent-to-agent (A2A) communication protocols to enable seamless orchestration and collaboration between multiple GenAI agents and services within the platform.
• Contribute to the design and development of platform features using microservices (FastAPI) and event-driven architecture (Kafka, SSE, WebSocket)—all in Python.
• Uphold engineering and operational excellence standards, embracing automation and the DRY (Don’t Repeat Yourself) principle.
• Support operational excellence for semantic routing and agent communication systems, including monitoring, troubleshooting, and participating in on-call rotations for production support.
• Stay current with GenAI and multi-agent system best practices, adopting new solutions to enhance platform intelligence, reliability, and scalability.
• Be an active member of a dynamic team, contributing to code reviews, design discussions, and collaborative problem-solving.
• Support production operations by participating in on-call rotations

Benefits

• Beyond our great compensation package, you can receive incentive awards for your performance.
• Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.
• Health benefits include medical, vision and dental coverage.
• Financial benefits include 401(k), stock purchase and company-paid life insurance.
• Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting.
• Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.
• Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities. Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates. Tuition, books, and fees are completely paid for by Walmart.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level