Senior Software Engineer, Solution Validation, Benchmarking & Release Engineering
About The Position
Cisco Validated Infrastructure Services (CVIS) establishes and proves the performance of large AI clusters before they are handed over to customers. We deploy each cluster, validate it against performance baselines, and deliver the evidence that it is ready for service. The platform behind that work is full stack. It combines workflow and API services, network and infrastructure automation, and the UI used to run validation across labs and customer environments. As a Senior Software Engineer, you will own CVIS/NVIS, AI Cluster Validation, end-to-end solution testing, RA certification, GPU debugging, performance profiling, bottleneck analysis, acceptance criteria, test plan and automation, release qualification, and readiness across AI cluster and Cisco network-switch solutions.
Requirements
- Bachelors + 7 years of related experience, or Masters + 4 years of related experience, or PHD +1 year of related experience, or equivalent related work experience.
- Experience building and executing end-to-end validation for GPU or distributed AI systems.
- Experience with test strategy, automation, Python, Linux, performance analysis, and defect-triage skills.
- Prior experience translating system requirements into measurable tests, acceptance criteria, and release gates.
- Experience with technical writing and cross-functional communication.
Nice To Haves
- NVIS, NVIDIA GPU platforms, NCCL, Kubernetes, Slurm, network testing, and storage validation.
- Benchmark engineering, workload modeling, CI-based testing, observability, and release management.
- Experience with Cisco networking and AI cluster reference architectures.
Responsibilities
- Develop test plans, validation matrices, automation, and exit criteria for AI cluster solutions.
- Execute CVIS/NVIS, AI Cluster Validation, GPU burn, NCCL, workload, resilience, and interoperability test suites.
- Model workloads, profile end-to-end performance, analyze bottlenecks, and produce benchmark reports.
- Validate Cisco network-switch, multi-plane, ToR, compute, storage, and software integrations.
- Drive defect triage, evidence collection, release qualification, RA certification, and acceptance-report packaging.
Benefits
- medical, dental and vision insurance
- a 401(k) plan with a Cisco matching contribution
- paid parental leave
- short and long-term disability coverage
- basic life insurance
- 10 paid holidays per full calendar year
- 1 floating holiday for non-exempt employees
- 1 paid day off for employee’s birthday
- paid year-end holiday shutdown
- 4 paid days off for personal wellness
- 16 days of paid vacation time per full calendar year (non-exempt)
- flexible vacation time off program (exempt)
- 80 hours of sick time off provided on hire date and each January 1st thereafter
- up to 80 hours of unused sick time carried forward
- Additional paid time away may be requested to deal with critical or emergency issues for family members
- Optional 10 paid days per full calendar year to volunteer
- annual bonuses (for non-sales roles)
- performance-based incentive pay (for sales roles)
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
