Backend Engineer, Agent Collaboration Platform

Hebbia AI•New York, NY

13h•Onsite

About The Position

The Agent Collaboration platform team at Hebbia builds the interactive scratch-pad, analysis, and content creation tools for Agents. Our flagship product, Matrix, is a generative spreadsheet that leverages our ISD process to coordinate complex agentic workflows across thousands of documents. We pair a simple, elegant interface—where users can kick off complex multistep document workflows—with a real-time, high-throughput LLM execution engine capable of processing the equivalent of 100 Harry Potter novels per second. Together, we turn massive, unstructured document repositories into seamless, actionable intelligence. A backend engineer at Hebbia blends expertise in systems, application layer software, and data modeling to build highly efficient software solutions. You will be responsible for leveraging the latest software and agentic solutions and integrating product experience with powerful distributed systems. You’ll help protect Hebbia’s technical edge via elegant software design, efficient data communication, and sophisticated integrations. We value engineers who move fast, hold themselves accountable to quality, and are detail-oriented.

Requirements

Bachelor's or Master's degree in Computer Science, Data Science, Statistics, or a related field. A strong academic background with coursework in data structures, algorithms, and software development is preferred.
5+ years software development experience at a venture-backed startup or top technology firm, with a focus on backend software engineering.
Proficiency in building backend and API systems using technologies such as Python, Java, or Go.
Extensive experience with cloud platforms (e.g., AWS)
Working experience with one or more of the following: Kafka, ElasticSearch, PostgreSQL, and/or Redis
Ability to analyze complex problems, propose innovative solutions, and effectively communicate technical concepts to both technical and non-technical stakeholders.
Proven experience in leading software development projects and collaborating with cross-functional teams.
Strong interpersonal and communication skills to foster a collaborative and inclusive work environment.
Enthusiasm for continuous learning and professional growth.
A passion for exploring new technologies, frameworks, and software development methodologies.
Embraces rapid prototyping with an emphasis on user feedback
Autonomous and excited about taking ownership over major initiatives

Nice To Haves

Experience building agentic systems or LLM enabled products.
Frequent user of AI products, especially during the development lifecycle (i.e. Cursor, Claude Code, etc).

Responsibilities

Own critical system components: Take complex requirements and turn them into robust, scaled solutions that solve real customer needs.
Unlock O(1) universal indexing: Build and iterate on our high-scale document build system that enables constant time latency for indexing any content in the world, regardless of data volume.
Drive performance optimization: Architect and implement performance-tuning solutions to ensure our systems operate efficiently at scale, minimizing latency and maximizing throughput across millions of documents.
Mentor and guide: Provide technical leadership, mentorship, and guidance to junior engineers, fostering a culture of learning and growth.