Senior, Software Engineer (Machine Learning)

Wal-Mart•Sunnyvale, CA

41d•$117,000 - $234,000•Hybrid

About The Position

As a Senior Software Engineer - Machine Learning, you are a technical leader working at the intersection of machine learning and software engineering. You have expertise in both areas and are responsible for the full lifecycle of complex machine learning systems - from initial ideas and design to deployment, monitoring, and updates. This role requires strong technical skills, strategic planning, system design ability, and mentorship. Senior Engineers don't just implement existing plans; they define the technical approach and architecture for systems. You will be important in setting and promoting best practices, guiding technical direction in your area, and possibly contributing to the overall engineering strategy. While your specific focus might align with roles like a Tech Lead guiding a team, an Architect defining a critical technical area, or a Solver tackling high-risk problems, the core elements are technical leadership, system-level thinking, and broad impact. You will balance hands-on work with system design and technical guidance. About Team: Our eCommerce Search team is an integral part of Walmart International, which encompasses over 5,200 retail units across 23 countries, including Canada, Central America, Chile, Mexico, and South Africa. We are dedicated to building a cutting-edge machine learning platform that addresses the diverse needs of customers, associates, and the business. Our mission is to enhance the shopping experience for millions of customers worldwide by leveraging advanced technologies and innovative solutions. What you'll do:

Requirements

7+ years of software engineering experience, with 3+ years in ML serving/infrastructure
Strong expertise in container orchestration (Kubernetes) and cloud platforms
Experience with model serving technologies (TensorFlow Serving, Triton, KServe)
Deep knowledge of distributed systems and microservices architecture
Proficiency in Python and experience with high-performance serving
Strong background in monitoring and observability tools
Experience with CI/CD pipelines and GitOps workflows

Nice To Haves

Experience with model serving frameworks: <li>TorchServe for PyTorch models TensorFlow Serving for TF models Triton Inference Server for multi-framework support BentoML for unified model serving
Expertise in model runtime optimizations: <li>Model quantization (INT8, FP16) Model pruning and compression Kernel optimizations Batching strategies Hardware-specific optimizations (CPU/GPU)
Experience with model inference workflows: <li>Pre/post-processing pipeline optimization Feature transformation at serving time Caching strategies for inference Multi-model inference orchestration Dynamic batching and request routing
Experience with GPU infrastructure management
Knowledge of low-latency serving architectures
Familiarity with ML-specific security requirements
Background in performance profiling and optimization
Experience with model serving metrics collection and analysis

Responsibilities

Design and implement scalable model serving platforms for both batch and real-time inference
Build model deployment pipelines with automated testing and validation
Develop monitoring, logging, and alerting systems for ML services
Create infrastructure for A/B testing and model experimentation
Implement model versioning and rollback capabilities
Design efficient scaling and load balancing strategies for ML workloads
Collaborate with data scientists to optimize model serving performance

Benefits

Beyond our great compensation package, you can receive incentive awards for your performance.
Other great perks include 401(k) match, stock purchase plan, paid maternity and parental leave, PTO, multiple health plans, and much more.
Health benefits include medical, vision and dental coverage.
Financial benefits include 401(k), stock purchase and company-paid life insurance.
Paid time off benefits include PTO (including sick leave), parental leave, family care leave, bereavement, jury duty, and voting.
Other benefits include short-term and long-term disability, company discounts, Military Leave Pay, adoption and surrogacy expense reimbursement, and more.
You will also receive PTO and/or PPTO that can be used for vacation, sick leave, holidays, or other purposes.
Live Better U is a Walmart-paid education benefit program for full-time and part-time associates in Walmart and Sam's Club facilities.
Programs range from high school completion to bachelor's degrees, including English Language Learning and short-form certificates.
Tuition, books, and fees are completely paid for by Walmart.