Software Engineer, AI

Bilt • New York, NY

3d • $170,000 - $300,000

About The Position

Concierge runs in the Bilt app, on the web, and over SMS, iMessage, and email. Members use it for dining, rent, payments, travel, and support. Restaurants and property managers use it to talk with their customers, and their staff use it as an assistant. It handles tens of thousands of conversations a day, with 2–3x spikes at the start of every month, and you'll build and run the backend behind all of it.

Requirements

• 4+ years building and operating backend services in production
• Strength in at least one backend language and experience running services in the cloud. We mostly use Python (FastAPI), Java (Quarkus), and Go on Google Cloud
• Solid distributed systems fundamentals (async processing, pub/sub, idempotency, retries, caching), and you debug across services with logs, traces, and metrics
• Hands-on experience with LLMs, at work or on your own, and curiosity about making them reliable
• Product judgment: you can read a bad conversation and tell whether the cause is the prompt, a tool, the data, or a service
• Daily use of AI coding agents, and good judgment about when to trust their output
• Clear writing. Design docs, PR descriptions, and the prompts you give agents all matter here

Nice To Haves

• Shipped an LLM-powered feature to real users, and can explain what broke and how you measured it
• Agent frameworks (Google ADK, LangGraph, or similar), tool calling, evals, LLM-as-judge
• Model serving and inference: provider routing, open-weight models, latency and cost tuning
• Messaging or realtime infrastructure
• Browser automation or computer-use agents
• Identity and access: OAuth/OIDC, token exchange, fine-grained authorization

Responsibilities

• Agent capabilities end to end: tools, workflows, prompts, and the integrations with Bilt and partner systems behind them
• The agent runtime: multi-agent orchestration, context and memory, prompt caching, and routing across frontier and open-weight models
• Performance: p50 and p99 across the full request path, bursty traffic, and cost per conversation
• Eval harnesses, LLM judges, and conversation replay, so every model and prompt change is measured before it ships
• Assistants for merchants' staff that work from the business's own data, and browser agents that can act where no API exists
• Proactive features that drive engagement with members and merchants' customers: briefings, follow-ups, and outreach that land at the right moment
• The conversation platform: one inbox where the agent, merchant staff, and Bilt support share threads across SMS, iMessage, email, web, and in-app chat
• Messaging: realtime streaming replies, attachments, message ordering and idempotent delivery, carrier and iMessage sending limits, and handing off to a person at the right moment
• Authentication and fine-grained authorization, so the agent only sees and does what it should for members, merchants, and staff

Benefits

• Competitive salary with a meaningful stake in the company via equity and our performance bonus program
• Health insurance for you (& your loved ones) from day one - Enjoy a One Medical Membership, wellness stipends, family programs and more, on us. We’ve got you and your family covered from day one.
• 401k plan with a match
• Commuter FSAs
• UNLIMITED PTO
• Exclusive Employee only Bilt Points
• Team Events

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed