Senior Software Engineer, AI Platform - Prism

SoFi•San Francisco, CA

About The Position

As a Senior Software Engineer (IC3) on SoFi’s Prism team, you’ll help build Prism, SoFi’s internal AI platform for knowledge work. Prism connects employees with AI models, business context, and tools to help them solve important problems more effectively. It captures what works and what doesn’t to continuously improve workflows and help employees deliver better results faster. The role combines hands-on software development with systems thinking. You will take technical ownership of feature delivery and key service components, translating partially defined technical problems into production-grade, highly available microservices. You’ll collaborate with partner teams such as Autonomous Coding, CI/CD, and product squads, practice operational rigor, and use AI-assisted engineering tools responsibly to improve quality and delivery velocity across the engineering community.

Requirements

Bachelor’s degree plus 2–3 years of experience, or a master’s degree plus 2 years of programming experience in software engineering, computer science, or a related field.
Proficiency in at least one modern backend language, such as Java, Kotlin, Python, Go, or Scala.
Experience building and operating distributed backend services in a microservices or cloud environment, with understanding of concurrency, fault tolerance, idempotence, and API design.
Practical experience with relational databases, persistent data stores, and data modeling.
Practical understanding of operational excellence, including logging, metrics, distributed tracing, automated unit and integration testing, and safe production deployment practices such as canarying and feature flags.
Hands-on experience developing with or integrating AI-assisted developer tools, LLM APIs, prompt engineering patterns, or tool-execution frameworks.
Clear written and verbal communication skills, including the ability to write structured technical design documents and provide constructive code review feedback.
Ability to critically inspect and validate AI-generated code and follow data governance and security policies.

Nice To Haves

Experience engineering internal developer platforms (IDP), developer tooling, or CLI workflows.
Familiarity with container orchestration, including Docker and Kubernetes, and modern CI/CD pipeline automation.
Experience in fintech or another highly regulated industry.
Deep understanding of LLM integration, context retrieval architectures (RAG), and AI evaluation frameworks.

Responsibilities

Design, implement, test, deploy, and operate foundational Prism components.
Build and maintain telemetry, usage instrumentation, and reporting pipelines to provide visibility into Prism and its learning feedback loop.
Lead technical execution for assigned platform work streams, break down complex tasks for parallel implementation, and align dependencies with product and engineering managers.
Participate in technical design reviews, evaluate architectural trade-offs such as latency, fault tolerance, concurrency, and security, and document technical specifications.
Follow and refine coding conventions, automated testing patterns, and reusable service templates.
Automate test and deployment workflows, participate in on-call service ownership, resolve incidents, and implement post-incident remediations.
Engage with internal customers to understand workflows, support Prism adoption, and incorporate feedback into system improvements.
Mentor early-career engineers through code reviews, design feedback, and pair programming.
Use AI tools responsibly to prototype, navigate codebases, and accelerate implementation while maintaining security and safety standards.
Inspect and validate AI-generated code and support implementations with comprehensive automated tests.
Comply with data governance and security policies, ensuring sensitive member data and proprietary assets are not exposed to unapproved tools.
Share effective AI engineering harnesses, prompt templates, and operational guardrails.