Principal Software Engineer - Core GenAI Platform

Upstart

80d • $186,100 - $257,500

About The Position

Upstart is the leading AI lending marketplace partnering with banks and credit unions to expand access to affordable credit. By leveraging Upstart's AI marketplace, Upstart-powered banks and credit unions can have higher approval rates and lower loss rates across races, ages, and genders, while simultaneously delivering the exceptional digital-first lending experience their customers demand. More than 80% of borrowers are approved instantly, with zero documentation to upload. Upstart is a digital-first company, which means that most Upstarters live and work anywhere in the United States. However, we also have offices in San Mateo, California; Columbus, Ohio; and Austin, Texas. Most Upstarters join us because they connect with our mission of enabling access to effortless credit based on true risk. If you are energized by the impact you can make at Upstart, we’d love to hear from you!

Requirements

• 10+ years of professional software engineering experience, with at least 3 years leading large-scale, cross-team technical initiatives
• Proven track record of delivering complex, distributed systems and platform infrastructure that span multiple teams
• Deep expertise in backend systems and infrastructure technologies such as Kubernetes, Docker, Terraform, and cloud-native architectures
• Experience designing and operationalizing ML/LLM platforms at scale, including optimization for cost, latency, and reliability
• Demonstrated ability to set long-term technical direction and influence organizational strategy
• Excellent communication skills with a history of driving alignment across engineering and business stakeholders

Nice To Haves

• Full-stack engineering experience (Python, FastAPI, Kotlin, Spring, React/TypeScript, or similar)
• Expertise in LLM-specific infrastructure such as inference optimization (quantization, ONNX, streaming), retrieval-augmented generation, and vector databases
• Hands-on experience with LLM toolchains such as LangChain, LlamaIndex, or OpenAI APIs
• Recognized as a technical leader beyond your immediate team, influencing platform strategy across organizations
• Awareness of industry best practices and risks in GenAI including hallucination mitigation, fairness, explainability, and data privacy
• Experience mentoring senior engineers and shaping organizational standards for operational excellence

Responsibilities

• Define and drive the multi-year technical roadmap for the Core GenAI Platform, influencing adoption and alignment across several engineering teams
• Lead architecture and design of large-scale, mission-critical systems for model inference, orchestration, and compliance
• Identify and solve systemic technical risks that impact multiple teams and business-critical AI initiatives
• Build high-leverage, generalizable platform components that meaningfully accelerate the productivity of engineers across Upstart
• Mentor senior engineers (L5) and shape the growth of future technical leaders, fostering a culture of learning and excellence
• Collaborate with VP-level and above leadership to influence business strategy with technical insight
• Represent Upstart internally and externally as a thought leader in GenAI systems through executive reviews, cross-company forums, and industry venues
• Establish operational standards for GenAI integrations, ensuring security, fairness, and reliability at scale

Benefits

• Competitive Compensation (base + bonus & equity)
• Comprehensive medical, dental, and vision coverage with Health Savings Account contributions from Upstart
• 401(k) with 100% company match up to $4,500 and immediate vesting and after-tax savings
• Employee Stock Purchase Plan (ESPP)
• Life and disability insurance
• Generous holiday, vacation, sick and safety leave
• Supportive parental, family care, and military leave programs
• Annual wellness, technology & ergonomic reimbursement programs
• Social activities including team events and on-sites, all-company updates, employee resource groups (ERGs), and other interest groups such as book clubs, fitness, investing, and volunteering
• Catered lunches + snacks & drinks when working in offices

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Number of Employees: 1,001-5,000 employees