R&D Distinguished Software Engineer

Broadcom•San Diego, CA

5d•$200,000 - $320,000•Onsite

About The Position

Join the Avi Engineering team as a Distinguished Engineer to deliver Load balancing and Security solutions for the AI Era. The team has a storied history of innovation and an extensive patent portfolio. We foster a culture of intellectual curiosity turning creative ideas into tangible solutions. You’ll fit right in if you're someone who adopts a first-principles approach to problem-solving, love deep-diving into distributed systems to optimize scale and performance, and enjoy the challenge of making data flow seamlessly at a massive scale. This on-site position is based in Palo Alto, California. You will join a global, cross-border team of talented engineers operating across India, Germany, and the USA.

Requirements

BS/MS/PhD in Engineering Computer Science or a related technical field.
Bachelors with 20+ years; Masters with 18+ years; PhD with 15+ years of related experience
Proven experience building complex highly distributed systems
Proven experience leading the end-to-end lifecycle of a product, from initial design to production deployment and maintenance.
Expert Level (GoLang & Python): Deep mastery of Go (concurrency, profiling, and performance tuning) and Python (data manipulation and backend services).
Moderate Level (C++): Ability to maintain and optimize performance-critical components or interface with lower-level system libraries.
Proven experience designing and delivering production-grade microservices for high-throughput, cloud-scale environments.
Proficiency in gRPC, Google Protocol Buffers (Protobuf), and RESTful API design, with a deep understanding of the HTTP/S stack.
Hands-on experience with one or more of the following: OpenSearch/Elasticsearch, PostgreSQL, Redis, or Neo4j (or their equivalents).

Nice To Haves

Strong understanding of L4–L7 networking, TCP/IP, HTTP/S protocols, and load-balancing principles.
Background in building data pipelines specifically for security and intelligence platforms (e.g., threat detection, anomaly detection, or predictive analytics).
Familiarity with time-series data, stream processing, and large-scale data visualization backend logic.

Responsibilities

Architecting and building high-performance, cloud-scale load balancing and security solutions.
Envisioning and delivering highly resilient, microservices-based solutions in the emerging world of AI based workloads.
Lead the design and implementation of Load balancing and Security solutions for AI workloads, including but not limited to AI agents, LLMs, and Gateways.
Build and optimize data pipelines capable of handling millions of records, ensuring the platform scales elastically in AI environments.
Leverage a sophisticated stack to build durable, stateful workflows to manage complex backend processes.
Design schemas and optimize queries across a polyglot persistence layer (OpenSearch, PostgreSQL, Redis, and Neo4j) to provide time sensitive insights to customers.
Act as a key technical leader by conducting deep-dive code reviews, driving engineering best practices, and mentoring junior engineers.