11 - Senior Staff Engineer, Software

Celestica International LP•Bothell, WA

3d•Remote

About The Position

We are seeking a visionary Team Lead to spearhead the design and deployment of a next-generation, network device automation infrastructure. This is not a traditional "scripting" role; you will be building a full-stack, SDLC-integrated ecosystem centered around products running SONiC (Software for Open Networking in the Cloud) and OpenBMC. Your mission is to bridge the gap between cloud-native software development and physical on-prem hardware. You will lead a team in building a platform that automates everything from the moment a developer submits a Pull Request to the final Regression Validation on physical test beds using high-performance IXIA traffic generators. You will use your knowledge of AI agents to integrate intelligent workflows that can select the best automation test cases to run to analyze test failures for rapid resolution. Infrastructure & SDLC Integration Architect a CI/CD Pipeline: Design the integration between Git-based workflows and physical hardware labs, ensuring code changes trigger automated builds and deployments to SONiC-based switches. Cloud-to-On-Prem Connectivity: Lead the development of a cloud-hosted GUI and backend services that securely manage and command on-premise physical test beds. Hardware Abstraction: Oversee the management of physical test beds, ensuring consistent state and availability for automated testing. Test Engineering & Validation Framework Leadership: Standardize automated testing using SPyTest, ensuring robust coverage for NOS (Network Operating System) features. Traffic Emulation: Integrate IXIA traffic generators into the automated suite to perform high-scale performance, stress, and regression testing. Regression Management: Own the final validation gate, ensuring that no code reaches production without passing a rigorous, automated physical battery. AI-Driven Operations (The Future) Failure Analysis Agents: Build and deploy AI/LLM-based agents to parse complex log files and SPyTest results to identify the "root cause" of test failures automatically. Self-Healing Test Beds: Develop agents capable of test bed failure recovery (e.g., automatically power-cycling hung PDUs, re-flashing corrupted ONIE images, or re-seating virtual links). Quality Insights: Leverage AI to analyze long-term software quality trends and predict potential regressions before they occur. Leadership & Mentorship Lead a cross-functional team of Network, Software, and DevOps engineers. Define the technical roadmap and drive the adoption of Platform Engineering Ops culture across the organization.

Requirements

Networking: Deep expertise in SONiC, SAI (Switch Abstraction Interface), and standard protocols (BGP, EVPN, VXLAN).
Automation Frameworks: Expert-level knowledge of SPyTest and Python-based automation.
Hardware: Experience with IXIA (IxNetwork/IxLoad) and physical switch hardware (Mellanox/NVIDIA, Broadcom-based whitebox).
Software Development: Strong proficiency in Python, C/C++, Rust, or Java; experience building RESTful APIs and cloud-native backends (GCP/Azure).
AI/ML: Familiarity with integrating LLM APIs (like Google Gemini) for text/log analysis.
DevOps: Advanced experience with GitHub Actions, Azure DevOps or Jenkins, and containerization (Docker/Kubernetes).

Responsibilities

Architect a CI/CD Pipeline: Design the integration between Git-based workflows and physical hardware labs, ensuring code changes trigger automated builds and deployments to SONiC-based switches.
Cloud-to-On-Prem Connectivity: Lead the development of a cloud-hosted GUI and backend services that securely manage and command on-premise physical test beds.
Hardware Abstraction: Oversee the management of physical test beds, ensuring consistent state and availability for automated testing.
Framework Leadership: Standardize automated testing using SPyTest, ensuring robust coverage for NOS (Network Operating System) features.
Traffic Emulation: Integrate IXIA traffic generators into the automated suite to perform high-scale performance, stress, and regression testing.
Regression Management: Own the final validation gate, ensuring that no code reaches production without passing a rigorous, automated physical battery.
Failure Analysis Agents: Build and deploy AI/LLM-based agents to parse complex log files and SPyTest results to identify the "root cause" of test failures automatically.
Self-Healing Test Beds: Develop agents capable of test bed failure recovery (e.g., automatically power-cycling hung PDUs, re-flashing corrupted ONIE images, or re-seating virtual links).
Quality Insights: Leverage AI to analyze long-term software quality trends and predict potential regressions before they occur.
Lead a cross-functional team of Network, Software, and DevOps engineers.
Define the technical roadmap and drive the adoption of Platform Engineering Ops culture across the organization.