Software Engineer, AI (Senior/Staff)

Monarch Money

23h • Remote

About The Position

At Monarch, AI is the engine powering intelligent, personalized financial experiences for our users. We're looking for an AI Engineer to design, build, and own the features that help hundreds of thousands of users understand and manage their money.
You'll work across the full spectrum of AI development, from prompt engineering and API integrations to building multi-agent systems and fine-tuning language models. You will be a force multiplier for Monarch's product, making critical decisions on everything from our conversational AI architecture to how we evaluate and ship AI features with confidence.
You'll collaborate closely with our AI Platform team, who manage the underlying infrastructure, observability, and LLM routing. Your focus will be on the AI application layer: building intelligent features, advancing our ML systems, and ensuring quality through rigorous evaluation.

Requirements

• 5+ years of experience in software engineering, with at least 2 years focused on building and operating production ML/AI systems.
• A proven track record of shipping LLM-powered features, with deep, hands-on expertise in prompt engineering, RAG systems, and evaluation techniques.
• Strong fundamentals in machine learning: embeddings, similarity search, classification, and probabilistic reasoning.
• Demonstrated experience building and using AI evaluation tooling (e.g., golden sets, rubric scoring, LLM-as-judge).
• Excellent Python skills and a history of building production-grade AI features and services.
• Strong collaboration and communication skills with a sharp product sensibility.
• A strategic mindset, comfortable making build-vs-buy decisions and designing features for long-term reliability.

Nice To Haves

• Multi-Agent Systems: Designing and building complex LLM orchestration with frameworks like LangGraph, CrewAI, or AutoGen.
• Fine-Tuning: Hands-on experience with LoRA, RLHF, or full fine-tuning on platforms like Vertex AI.
• Fintech Domain: Background in personal finance, banking, or data-rich consumer financial applications.
• Vector Databases: Hands-on experience with OpenSearch, pgvector, Pinecone, or similar at scale.
• Safety & Evaluation: Experience with red-teaming exercises, adversarial testing, and implementing guardrails.

Responsibilities

• Apply AI to Real Financial Problems: Use GenAI and ML to help users make sense of their money, whether that's understanding spending patterns, surfacing actionable insights, or automating tedious financial tasks. You'll identify where AI can make a meaningful difference and build solutions that users rely on daily.
• Choose the Right Tool for Each Problem: Navigate the AI toolkit thoughtfully. Know when a well-crafted prompt suffices, when retrieval systems add value, and when custom models are worth the investment. You'll balance innovation with pragmatism to ship features that work reliably at scale.
• Ship with Confidence: Leverage and enhance our sophisticated evaluation framework to ensure AI quality. You'll design test datasets, implement new scorers, and use our Braintrust-based eval system to validate changes before they reach users.
• AI feature development, agent design and orchestration, ML model improvements, evaluation datasets and scorers, prompt engineering, and feature-level quality.
• End-to-end feature quality, evaluation frameworks, production incident response, and AI roadmap priorities.

Benefits

• Work wherever you want! As a fully remote company with no central office, we want you to work wherever you are happiest and most productive. Whether that’s out of your home, a co-working space, or elsewhere.
• Competitive cash and equity compensation in a hyper growth, early stage company 🚀.
• Stipend to set-up your ideal working environment.
• Competitive Benefit Plans for employees based on your location (e.g. in the US we offer: Medical, dental and vision benefits and the ability to contribute to a 401k plan).
• Unlimited PTO.
• 3 day weekend every month! We take off the “First Friday” every month to focus on rest, recuperation, or just having fun!
• We are an equal opportunity employer and value diversity. We do not discriminate on the basis of race, religion, color, national origin, gender, sexual orientation, age, marital status, veteran status, or disability status.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed