Software Engineer - AI Infrastructure
About The Position
Great customer support requires human agents and AI in perfect balance, and Assembled is the only unified platform that orchestrates both at scale. Companies like Canva, Etsy, and Robinhood use Assembled to coordinate their entire support operation — in-house agents, BPOs, and AI — in a single operating system. With AI Agents that resolve cases end-to-end, AI Copilot for agent assistance, and AI-powered workforce management that optimizes both human and AI capacity, Assembled helps teams deliver faster, better service while making smarter decisions about how to staff and automate. Backed by $70M from NEA, Emergence Capital, and Stripe, we're building the platform that makes AI and human collaboration actually work. The Role We’re looking for a software engineer to join our Infrastructure team—building and operating the core systems that power our rapidly growing AI agent platform for customer support. Our AI Agents automates support workflows across email, chat, and voice, and has grown from $0 to $1M in ARR in just 3 months. As adoption accelerates, we’re investing deeply in scaling its infrastructure to meet increasing demand and security expectations from enterprise customers. As part of the AI Infrastructure team, you’ll be responsible for the systems that enable Assist to be fast, reliable, and secure. You’ll work on foundational platform components that power real-time LLM usage at scale, while also exploring how AI can be leveraged internally to make our engineering team more productive. This team is highly cross-functional, working closely with the AI, security, and product engineering teams. This is a high-ownership role for someone who’s excited by 0-to-1 building and shaping the infrastructure backbone of our AI products.
Requirements
- Have 6+ years of engineering experience, with past ownership of high-scale, production-critical infrastructure
- Have experience with distributed systems and container orchestration (especially Kubernetes)
- Have worked with AI/ML platforms or are excited to build foundational infrastructure for LLM-based applications
- Thrive in fast-paced environments with shifting requirements and ambiguous problem spaces
- Are motivated by impact, enjoy deep technical challenges, and want to work cross-functionally across security, AI, and product
- Have strong familiarity with one or more parts of our tech stack: Cloud provider: AWS Orchestration: Kubernetes + Karpenter LLM integration: Experience with OpenAI, Anthropic, or open-source model serving (e.g., vLLM, HuggingFace TGI, Ray Serve) Prompt & embedding infrastructure: Vector databases (e.g., Pinecone, Weaviate, PGVector), semantic search, prompt templating systems Datastores: Postgres + PgBouncer, Snowflake, Redis Languages: Go and Python Monitoring & CI/CD: Datadog, Mezmo, CloudWatch, Buildkite, CircleCI
Benefits
- Generous medical, dental, and vision benefits
- Paid company holidays, sick time, and unlimited time off
- Monthly credits to spend on each: professional development, general wellness, Assembled customers, and commuting
- Paid parental leave
- Hybrid work model with catered lunches everyday (M-F), snacks, and beverages in our SF & NY offices
- 401(k) plan enrollment
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
Number of Employees
101-250 employees
