Senior / Staff AI Software Engineer

Aegis Ventures

3d•$185,000 - $280,000•Remote

About The Position

As a Senior or Staff AI Software Engineer at Caregentic, you will have end-to-end ownership of key parts of our backend services architecture and our AI-drive applications. You will work on our modern micro-service architecture, built with Python 3.12, FastAPI, Strawberry GraphQL, and event-driven design principles. You will be responsible for building scalable, resilient systems that drive real impact in patient care while also helping shape the technical direction of the platform and mentoring other engineers. Our team operates with the urgency that healthcare demands, and we never lose sight that our work directly impacts patient lives. We’ve been a fully remote team from the start, distributed across the U.S. We believe that great engineering happens wherever people do their best work.

Requirements

7+ years of backend development experience in production environments, specifically strong Python skills, including async programming and type hints.
Experience building and monitoring production-quality ML and AI systems.
Hands-on expertise with RAG frameworks and agentic workflows.
Solid understanding of PostgreSQL database design and optimization.
Familiarity with Docker and containerization.
Strong testing practices using pytest.
Experience with microservice architectures is preferred.
Experience with GraphQL APIs.
Experience with event-driven systems and message queues.
Experience with major cloud providers (e.g., AWS).
Shipped production LLM systems: ideally RAG architectures, agent/tool use, and prompt/system design, with LangChain (tracing/evals via LangSmith), embeddings, and vector databases (Databricks Vector Search preferred). Deep expertise in retrieval quality, including chunking, metadata, hybrid search, reranking, and grounding.

Nice To Haves

Experience with Strawberry GraphQL.
Experience with Kafka, Procrastinate, or similar background job systems.
Experience Apollo Federation or multi-service GraphQL experience.
Healthcare or regulated industry experience (HIPAA, HL7, FHIR).
Experience with Terraform or infrastructure-as-code.
Experience with Kubernetes.
Experience mentoring engineers or leading technical projects.
Experience working with LangSmith tracing, AWS Bedrock, LangChain runnables.
Experience maintaining forked open source repositories.
Experience with managing conversation states in conversational agents - experience with LangGraph or similar.

Responsibilities

Design and develop robust, scalable, event-driven services using Python, FastAPI, Apache Kafka and GraphQL.
Build fundamental LLM agents and integrate them into our product.
Work with DevOps on deployments, monitoring, and reliability improvements.
Maintain and optimize PostgreSQL databases and data models.
Collaborate across product and engineering teams to define requirements and architect features.
Drive engineering best practices through code reviews and mentorship.
Engage with current and prospective clients to drive understanding of the Caregentic AI architecture and capabilities.
Design, build, and operate LLM services, including RAG systems (LangChain), agentic workflows, and evaluation pipelines (LangSmith, deepeval, A/B testing).
Own vector search & embeddings pipelines from schema and metadata design to model benchmarking, cost/latency optimization, and Databricks Vector Search integration.
Lead conversational AI development enhancing NLU policies, safety guardrails, and custom action servers, plus integrating assistants with microservices.