Full-stack Software Engineer III/Senior, AI Gateway
About The Position
ngrok is hiring a Full-stack Software Engineer at the Software Engineer III or Senior level for its AI Gateway team. The team builds the systems that identify, control, and explain AI traffic passing through ngrok, including the AI-specific control plane, policies, usage tracking, and enforcement on live customer traffic. The role involves building and evolving AI-aware gateway components that classify and handle AI traffic in the request path, where performance, safety, and predictability are important. The engineer will design AI Gateway Traffic Policy Objects such as rate limits, usage caps, and access rules; measure AI requests, tokens, and related metadata; and expose clear signals explaining what was allowed or blocked, which policies applied, and how usage accumulated. The engineer will work with product and design on AI-specific gateway primitives that hide provider and infrastructure complexity from customers. They will collaborate with Gateway, Customer Data, and Platform teams to align usage data, policy enforcement, and billing signals so customers can use these features confidently in production. ngrok runs on AWS. Engineers use remote development tools and/or SSH to connect to remote EC2 environments running a Kubernetes cluster that mirrors production. The codebase is primarily Go and TypeScript, with Postgres, Kafka, Protobuf, Kubernetes, Terraform, Helm, Buildkite, React, and GitHub among the tools and technologies used. The position is remote for candidates outside the Bay Area and hybrid for candidates within commuting distance of San Francisco. Bay Area employees commute to the office Tuesdays and Wednesdays. Candidates must be based in the United States and authorized to work there permanently without current or future visa sponsorship.
Requirements
- Comfort working in a statically typed, compiled language such as Go, Rust, C++, or Java; Go is a bonus.
- Frontend engineering experience, including expertise in TypeScript, React, HTML, and CSS.
- Experience working with AI or large language models and their edge cases.
- Care about developer experience and thoughtful abstractions.
- Enjoy defining system behavior, not only implementing plumbing.
- Consider retries, limits, and costs when designing systems.
- Prefer systems that move complexity from users into the system.
- Must be based in the United States and legally authorized to work in the United States on an ongoing basis without current or future sponsorship.
Nice To Haves
- Experience with AI platforms or inference infrastructure.
- Experience with API gateways that have product-level opinions.
- Experience with usage limits, quotas, or billing-adjacent systems.
- Experience with customer-facing observability tools.
Responsibilities
- Build and evolve AI-aware gateway components that classify and handle AI traffic in real time.
- Design and implement AI Gateway Traffic Policy Objects, including rate limits, usage caps, and access rules for AI workloads.
- Build and maintain systems that measure AI usage, including requests, tokens, and related metadata.
- Expose clear, trustworthy signals showing what AI traffic was allowed or blocked, which policies applied, and how usage accumulated.
- Work with product and design to create AI-specific gateway primitives that hide provider quirks and infrastructure details from customer workflows.
- Collaborate with Gateway, Customer Data, and Platform teams to align AI usage data, policy enforcement, and billing signals.
- Ship reliable AI Gateway features that customers can trust in production.
Benefits
- Company-paid premiums for the employee's base healthcare, dental, and vision coverage, with half of dependent premiums covered.
- Mental health and well-being support.
- 401(k) matching: 100% match up to 3% of salary and 50% match up to an additional 2%.
- Open, flexible vacation policy.
- Up to 16 weeks of parental leave for employees who give birth and up to 8 weeks for new parents through birth, adoption, or fostering.
- Annual professional development budget.
- Annual home office or desk stipend.
- Co-working space stipend.
- Lunch at least twice per week for employees onsite at the San Francisco office.
- Company-wide offsites twice a year.
- Bi-annual performance reviews and compensation reviews.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
