Senior Software Engineer, AI Developer Experience

Vanta•,

1d•$195,000 - $229,000•Remote

About The Position

Vanta’s AI Developer Experience team builds the foundations for a more autonomous software development experience, including background agents, agent evaluation systems, and tools that help engineers work more effectively with AI. The team combines software engineering, developer experience, AI systems, and product thinking to turn emerging capabilities into reliable workflows used in real engineering work. As a Senior Software Engineer on the team, you will help shape these systems from the ground up. You will work directly with engineers to understand friction in their workflows, build practical solutions, and use evidence from real usage to continuously improve quality, reliability, and adoption. The role involves developing background-agent infrastructure and evaluation systems, improving shared AI tools and code review workflows, and helping establish systems that allow agents to complete bounded engineering tasks safely and effectively. You will also help move ambiguous, dependency-heavy projects from exploration through reliable delivery, while contributing to technical quality, reliability, and security.

Requirements

Substantial industry software engineering experience.
Experience taking technical leadership roles on teams or complex projects.
Experience improving AI systems, creating evaluation sets, and driving quality improvement through measurement and iteration.
Strong software engineering fundamentals and experience designing, building, testing, and operating reliable systems.
Experience with developer tooling, AI-enabled workflows, agentic systems, infrastructure, or related technical domains.
A track record of working through ambiguity, decomposing complex problems, managing dependencies, and helping projects reach completion.
Experience working in rapidly scaling startups or larger companies, particularly in environments with a strong bias for action.
An action-oriented approach and willingness to engage directly with users and contribute hands-on.
Product judgment and curiosity, with strong technical opinions and a focus on building platforms that meet users’ needs.
Strong written and verbal communication skills, including the ability to explain technical concepts clearly and create adoption guidance.
A collaborative approach and demonstrated ability to make meaningful contributions as part of a team.
Uses AI in day-to-day work to amplify skills and strengthen outcomes, experiments to build fluency, and applies sound judgment to ensure AI-assisted work meets a high quality bar.

Responsibilities

Plan, build, and improve background-agent infrastructure for reliable, trackable, and repeatable automated engineering work.
Develop systems to evaluate agent performance using task outcomes, quality measures, human intervention, cost, and other signals.
Create evaluation sets and feedback loops to improve AI systems through regular review, tuning, and correction.
Improve how engineers discover, understand, and use shared AI tools and workflows.
Evaluate AI development tools—including code generation, AI-assisted review, and testing—against real engineering needs and help integrate useful tools.
Develop visibility into which tools and workflows are useful, where they create friction, and how they should evolve.
Create clear guidance and documentation to help engineers adopt AI-enabled development practices.
Improve code review workflows by using feedback from real engineering work to identify and address recurring friction.
Influence the foundations of an autonomous software factory, including systems that help agents complete bounded engineering tasks safely and effectively.
Work directly with engineers and internal users to understand needs, validate solutions, and make thoughtful product tradeoffs.
Help move ambiguous, dependency-heavy projects from early exploration through reliable delivery.
Raise the quality bar through code reviews, technical design discussions, testing, observability, and attention to reliability and security.
Partner with engineers and cross-functional stakeholders and contribute as a dependable, collaborative teammate.

Benefits

Industry-competitive salary and equity.
Comprehensive medical, dental, and vision coverage, with 100% of employee-only benefit premiums covered for most medical plans.
16 weeks of paid parental leave for all new parents.
Health and wellness stipend.
Remote workspace, internet, and cellphone stipend.
Commuter benefits for team members who report to the San Francisco and New York City offices.
Family planning benefits.
Matching 401(k) contribution with immediate vesting.
Flexible PTO policy and 80 hours of sick time.
11 company-paid holidays.
Virtual team-building activities, lunch and learns, and other company-wide events.