Staff Software Engineer (Applied AI)
About The Position
The Opportunity This is a high-leverage opportunity to serve as a foundational technical leader and full-stack executor, architecting and building the core LLM intelligence layer for the Pearl platform. You will define and implement advanced AI architecture (e.g., RAG or Agentic systems) that scales capabilities across our entire product suite. Your technical vision will ensure our systems are inherently scalable and reliable, directly supporting our mission of driving success in value-based care and transforming primary care delivery. Who We Are Pearl Health is dedicated to empowering primary care providers, health systems, and physician-led networks to succeed in the shift to value-based care. Our platform delivers the technology, financial tools, and expert services that enable practices to provide more proactive, effective care to their Medicare patients, ultimately lowering costs and improving health outcomes. Founded in 2020, we are a team of healthcare and technology innovators backed by premier investors like Andreessen Horowitz, Viking Global Investors, and AlleyCorp. We partner with thousands of providers across 44 states to build a more sustainable future for American healthcare. What You'll Do Applied AI and Full-Stack Excellence Architect and build the foundational LLM architecture (RAG, Agents, Vector DBs) that powers high-impact product features across the organization. Design and deliver high-performance, distributed systems (data pipelines, APIs, microservices) that process healthcare data at scale and securely integrate LLM outputs into the user experience. Drive Proof-of-Concepts (POCs) and technical evaluation of new AI technologies to validate their product viability and scalability. Design and build responsive web applications using modern frontend frameworks to deliver intuitive, user-facing intelligence and analytic features. Ensure observability, monitoring, and operational excellence, championing security and regulatory compliance (HIPAA, SOC2). Strategy & Influence Drive system design and technical planning for all critical projects, including large, complex, and cross-functional initiatives across the organization. Partner strategically with Product, Operations, and Design leadership, translating complex business requirements into technical strategies and influencing roadmap prioritization. Mentor engineers at Software Engineer I, II, and III levels, accelerating their technical growth and leadership development Educate the organization on the capabilities, best practices, and limitations of using LLMs and applied AI within the healthcare domain. Define and implement engineering standards, patterns, and best practices that significantly improve scalability, reliability, and developer productivity across the product. Conduct thorough design and code reviews, raising the bar for technical quality and sharing knowledge generously across teams Delivery & Impact Own and drive multi-quarter technical projects with autonomy and accountability, ensuring successful delivery aligned with business timelines Identify and resolve systemic issues, technical bottlenecks, and cross-team dependencies that impact delivery velocity or system reliability Balance speed and quality, making pragmatic decisions that enable rapid iteration while maintaining engineering excellence Measure and communicate the business impact of technical work, connecting engineering outcomes to customer value and organizational goals What You’ll Bring We are looking for a seasoned technologist who can seamlessly balance deep technical execution with strategic, organizational leadership. Your experience should reflect a proven ability to lead large-scale projects, elevate team performance, and make technology decisions that directly drive business and healthcare outcomes.
Requirements
- 8-12 years of experience in large-scale software engineering, with a proven track record in service-oriented architectures and large data systems.
- Demonstrated architectural experience designing and implementing highly observable, scalable distributed systems, including complex microservices and event-driven architectures.
- Hands-on experience in the full-stack productization of Applied AI/LLM features, specifically working with RAG architectures (chunking strategies, semantic search, vector databases) and Agentic workflows.
- Cloud platform proficiency (preferably AWS), including hands-on experience with infrastructure design, deployment pipelines, and cost optimization.
- Expertise in designing and optimizing data-intensive applications, including deep database expertise (schema design, query optimization) and data consistency patterns.
- A strong leadership track record in driving technical direction for significant, cross-functional projects.
Nice To Haves
- Hands-on experience building and deploying robust, user-facing client applications using modern frameworks (e.g., React, Angular, Vue.js , TypeScript).
- Experience building systems in healthcare technology or other highly regulated industries, with an understanding of compliance requirements (e.g., HIPAA, SOC2).
Responsibilities
- Architect and build the foundational LLM architecture (RAG, Agents, Vector DBs) that powers high-impact product features across the organization.
- Design and deliver high-performance, distributed systems (data pipelines, APIs, microservices) that process healthcare data at scale and securely integrate LLM outputs into the user experience.
- Drive Proof-of-Concepts (POCs) and technical evaluation of new AI technologies to validate their product viability and scalability.
- Design and build responsive web applications using modern frontend frameworks to deliver intuitive, user-facing intelligence and analytic features.
- Ensure observability, monitoring, and operational excellence, championing security and regulatory compliance (HIPAA, SOC2).
- Drive system design and technical planning for all critical projects, including large, complex, and cross-functional initiatives across the organization.
- Partner strategically with Product, Operations, and Design leadership, translating complex business requirements into technical strategies and influencing roadmap prioritization.
- Mentor engineers at Software Engineer I, II, and III levels, accelerating their technical growth and leadership development
- Educate the organization on the capabilities, best practices, and limitations of using LLMs and applied AI within the healthcare domain.
- Define and implement engineering standards, patterns, and best practices that significantly improve scalability, reliability, and developer productivity across the product.
- Conduct thorough design and code reviews, raising the bar for technical quality and sharing knowledge generously across teams
- Own and drive multi-quarter technical projects with autonomy and accountability, ensuring successful delivery aligned with business timelines
- Identify and resolve systemic issues, technical bottlenecks, and cross-team dependencies that impact delivery velocity or system reliability
- Balance speed and quality, making pragmatic decisions that enable rapid iteration while maintaining engineering excellence
- Measure and communicate the business impact of technical work, connecting engineering outcomes to customer value and organizational goals
Benefits
- This role is eligible for a discretionary performance bonus and equity options.
- We offer a competitive benefits package.
- More on our careers page.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
