Senior Software Engineer – AI/ML Infrastructure

Cisco • Milpitas, CA

3d • Hybrid

About The Position

In the Data Center Business Unit at Cisco, we are dedicated to driving innovation in networking technologies. Our focus is on developing groundbreaking Ethernet Switching products that address the evolving needs of modern network infrastructures, including those in AI, cloud computing, and enterprise environments. The team is comprised of passionate engineers and collaborators who thrive in a fast-paced, innovative environment. You’ll be part of a diverse group that values cross-functional collaboration and exposure to all facets of the software development cycle—from ideation and marketing requirements to product delivery. What’s exciting about this team is the opportunity to learn and shape core Ethernet Technologies, contributing to the evolution of world-class Nexus switches and transformative cloud infrastructure solutions.
Your Impact
Design and architect AI/ML platform infrastructure to support critical SDLC use cases, including planning, coding, testing, CI/CD, release, operation, and support.
Build scalable services for model integration, inference, embeddings, retrieval (RAG), telemetry, and feedback loops, enabling robust AI adoption across engineering teams.
Develop developer-facing platforms, SDKs, APIs, and workflows to streamline AI integration and accelerate innovation at scale.
Integrate AI systems with code repositories, CI/CD pipelines, observability tools, and security/compliance frameworks to enhance reliability and performance.
Drive best practices, design reviews, and technical direction, ensuring data governance, security, and operational excellence in production environments.

Requirements

• Bachelor’s degree in STEM with 6+ years of experience in distributed systems, platform engineering, or infrastructure development.
• Experience in Python, APIs, and cloud-native systems.
• Experience with ML platforms, LLMs, vector databases, or data pipelines.
• Experience building scalable, secure, production-grade services.

Nice To Haves

• Experience with AI-assisted development, LLMOps/DevSecOps, or SDLC automation.
• Familiarity with RAG systems, model orchestration, telemetry, and feedback-driven learning loops.
• Prior work on internal developer platforms or large-scale AI systems.

Responsibilities

• Design and architect AI/ML platform infrastructure to support critical SDLC use cases, including planning, coding, testing, CI/CD, release, operation, and support.
• Build scalable services for model integration, inference, embeddings, retrieval (RAG), telemetry, and feedback loops, enabling robust AI adoption across engineering teams.
• Develop developer-facing platforms, SDKs, APIs, and workflows to streamline AI integration and accelerate innovation at scale.
• Integrate AI systems with code repositories, CI/CD pipelines, observability tools, and security/compliance frameworks to enhance reliability and performance.
• Drive best practices, design reviews, and technical direction, ensuring data governance, security, and operational excellence in production environments.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Number of Employees: 5,001-10,000 employees