Senior RAG Engineer

Wipfli Advisory LLC

5h • Remote

About The Position

At Wipfli, people count. At Wipfli, our people are core to everything we do—the catalyst behind our ability to create exceptional impact and extraordinary results. We believe in flexibility. We focus on relationships. We encourage each individual to follow their own path. People truly matter and they feel it. For those looking to make a difference and find a professional home, Wipfli offers a career-defining opportunity.
Job Summary
Wipfli is building the next generation of AI‑powered solutions that transform how our professionals deliver value to clients. As a Senior RAG Engineer, you will play a pivotal role in advancing our AI‑driven functional requirements documentation platform, an enterprise application used across the firm to automate the creation of complex project documentation.
This role blends software engineering, machine learning, and enterprise application development. You’ll work closely with data scientists, engineers, and business teams to build production‑grade retrieval and generation systems that make a measurable impact on hundreds of users.
If you’re passionate about building real AI products, not demos or POCs, and you want to shape the foundation of a growing AI capability, this is your opportunity.

Requirements

• Bachelor's degree in Computer Science, Information Management, Data Science, or AI related field
• 3-5 years of experience in data science and AI roles
• 7-10 years of experience software development roles
• Demonstrated track record of building production-grade AI applications from conception to deployment
• Demonstrated deep understanding of RAG methodologies and practical application. Experience with frameworks such as LangChain, LlamaIndex, or Haystack is considered an additional asset
• Experience with document processing and OCR technologies, including integration and deployment within enterprise environments

Nice To Haves

• Master's degree or advanced certification in Data Science or AI
• 4+ years of full stack development experience with modern frameworks (React, Vue, or Angular; Node.js, Python, or similar; .NET experience

Responsibilities

• Design, develop, and optimize full‑stack applications using RAG for high‑accuracy retrieval and generation
• Build and maintain APIs and microservices with monitoring and logging for reliability and performance
• Implement vector databases and semantic search; fine‑tune retrieval for strong precision and recall
• Optimize chunking, embeddings, and retrieval parameters tailored to professional services content
• Evaluate LLM architectures and maintain prompt‑engineering frameworks to improve response quality
• Build ETL pipelines and integrate with firm platforms such as document management, CRM, and engagement systems
• Ensure data quality, security, and compliance, including role‑based access, encryption, audit logging, and confidentiality
• Partner across teams—engagement, data science, and ML—to deliver capabilities and mentor junior engineers
• Stay current on emerging AI/ML technologies and assess applicability to enterprise use cases

Benefits

• Wipfli values fair, transparent, and competitive compensation, considering each candidate's unique skills and experiences.
• The estimated base pay range for this role is $106,600 to $160,000, with offers typically not made at the maximum, allowing for future salary increases.
• The actual salary at the time of offer depends on business related factors like location, skills, experience, training/education, licensure, certifications, business needs, current associate pay, and relevant employment laws.
• Individuals may be eligible for an annual discretionary bonus, subject to participation rules and based on a variety of factors including, but not limited to, individual and Firm performance.
• Wipfli cares about our associates and offers a variety of benefits to support their well-being.
• Highlights include 8 health plan options (both HMO & PPO plans), dental and vision coverage, opportunity to enroll in HSA with potential Firm contribution and an Employee Assistance Program.
• Other benefits include firm-sponsored basic life and short and long-term disability coverage, a 401(k) savings plan & profit share as well as Firm matching contribution, well-being incentive, education & certification assistance, flexible time off, family care leave, parental leave, family formation benefits, cell phone reimbursement, and travel rewards.
• Voluntary benefit offerings include critical illness & accident insurance, hospital indemnity insurance, legal, long-term care, pet insurance, ID theft protection, and supplemental life/AD&D.
• Eligibility for all benefits programs is dependent on annual hours expectation, position status/level and location.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Number of Employees: 1,001-5,000 employees