Software Engineer, Infrastructure

Gray Swan AI•Pittsburgh, PA

5d•$180,000 - $290,000•Hybrid

About The Position

Gray Swan is looking for an Infrastructure Engineer to build and scale the systems that power our AI security platform. You'll design the backend services, distributed infrastructure, and cloud architecture that enable Gray Swan to build AI systems and for customers to safely deploy frontier AI models at scale. This role is ideal for an engineer who enjoys solving infrastructure challenges across reliability, scalability, observability, and performance. You'll work closely with machine learning engineers, product engineers, and security researchers to ensure our platform remains fast, resilient, and secure as we grow. You'll have significant ownership over foundational systems and the opportunity to influence technical direction in a rapidly evolving AI startup.

Requirements

5+ years of experience building backend infrastructure or distributed systems in production environments.
Strong programming skills in C/C++, Go, Python, Rust, or Java.
Experience operating services on Kubernetes and modern cloud platforms such as AWS, GCP, or Azure.
Deep understanding of networking, distributed systems, containers, service orchestration, and scalable architectures.
Experience designing APIs, microservices, asynchronous systems, and event-driven architectures.
Comfortable debugging complex production issues and improving reliability through automation and operational excellence.
Passionate about writing clean, maintainable code and building infrastructure that other engineers love using.
Excited to work in a fast-moving startup with significant ownership and ambiguity.

Nice To Haves

Experience supporting machine learning or LLM infrastructure.
Familiarity with infrastructure-as-code tools.
Experience with Kafka, Redis, PostgreSQL, ClickHouse, or similar distributed data systems.
Experience building internal developer platforms or platform engineering tooling.
Knowledge of cloud security, infrastructure hardening, or zero-trust architectures.
Previous experience at a high-growth startup or building products from zero to one.
Interest in AI safety, cybersecurity, or adversarial machine learning.

Responsibilities

Design, build, and maintain highly available backend services and distributed systems that power Gray Swan's AI security platform.
Own cloud infrastructure across Kubernetes, AWS, networking, storage, and compute to ensure reliable production environments.
Build scalable APIs, internal platform services, and infrastructure tooling that improve developer productivity and system reliability.
Improve system observability through logging, metrics, tracing, dashboards, and automated alerting.
Optimize performance, latency, and infrastructure costs while maintaining reliability and security.
Partner closely with machine learning, security, and product engineering teams to deliver production-ready infrastructure for AI workloads.