Senior Backend Software Engineer, AI Observability & Evals Platform (NYC)
About The Position
LangChain is seeking a Senior Backend Engineer to join their LangSmith team. This role involves building the backend systems that power LangChain's observability and evals platform, enabling developers to monitor and evaluate AI applications at scale. The position focuses on backend feature development but would benefit from familiarity with fullstack or frontend engineering, performance tuning, and debugging production issues. LangChain is a rapidly growing company with significant funding, focused on making intelligent agents ubiquitous and helping developers move AI agents from prototypes to production.
Requirements
- 5+ years of professional experience in backend engineering working on highly complex products
- Proficiency in one or more backend languages/frameworks, ideally Python or Go
- Strong understanding of API design and building reliable data services.
- Experience with high-throughput or mission-critical systems.
- Demonstrated ability to optimize backend services for performance and reliability.
- Experience with database systems (Postgres, Redis, Clickhouse), and cloud platforms (AWS, GCP, Azure)
- Strong communication skills, with the ability to collaborate cross-functionally
- Customer centricity and ownership mentality
Nice To Haves
- Familiarity with fullstack or frontend engineering
- Performance tuning
- Debugging production issues
Responsibilities
- Design, develop, and maintain backend services and APIs to support LangSmith’s tracing, monitoring, and evaluation workflows.
- Collaborate on architectural decisions to ensure systems are performant and maintainable.
- Optimize storage and query performance for high-volume observability and evaluation data.
- Ensure system reliability through strong testing, monitoring, and alerting practices.
- Troubleshoot and resolve production issues, performing root-cause analysis and implementing long-term fixes.
- Create and maintain technical documentation, including system design and API references.
- Work closely with full-stack engineers, product managers, and product designers on rolling out new features.
Benefits
- medical, dental, and vision coverage
- flexible vacation
- a 401(k) plan
- meals on in-office days in the US
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
