Applied AI & Agent Engineering Lead - Vice President
About The Position
As an Applied AI & Agent Engineering Lead, you will spearhead the development of intelligent, autonomous AI systems with a focus on agentic AI. You will define and enforce prompt architecture standards, lead the creation of process miner AI agents and specialized business process agents (e.g., for payment repair). A critical part of your role will be the ownership of agent evaluation frameworks and regression discipline, ensuring the reliability and performance of our multi-agent orchestrations. You will master tool use and function calling, develop LLM evaluation methodologies, and design experiments to continuously improve agent performance, especially within HITL (Human-in-the-Loop) design patterns. This role requires a deep passion for elegant and effective solutions, proactively ensuring designs are not only fit for purpose but also perform flawlessly in production for critical regulatory reporting and analytics .
Requirements
- Proficiency in Python and orchestration frameworks.
- Experience with Google ADK/Vertex AI.
- Expertise in prompt architectures/optimization (e.g., DSPy, Chain of Thought, ReAct, Tree of Thoughts).
- Deep knowledge of multi-agent systems, evaluation metrics, and experiment design.
- Understanding of HITL design patterns.
Nice To Haves
- Proven experience as an early engineer or key contributor to specialized applied AI projects.
- Ability to build AI workflows utilizing multi-modal inputs.
- Experience contributing to major multi-agent frameworks.
Responsibilities
- Define and drive prompt architecture standards across AI agent development.
- Lead the design and implementation of process miner AI agents and business process agents (e.g., for Payment Repair).
- Own and maintain agent evaluation frameworks and agent regression discipline.
- Develop sophisticated multi-agent orchestration, mastering tool use and function calling.
- Establish LLM evaluation methodologies and design experiments to measure and improve agent performance.
- Implement HITL design patterns for AI workflows, ensuring seamless human-AI collaboration.
- Pioneer new applied AI projects, potentially involving multi-modal inputs like computer vision and document OCR with LLM reasoning.
- Contribute code to major multi-agent frameworks (e.g., LangChain, AutoGen, BMAD) and modernize legacy platforms with AI-driven initiatives.
Benefits
- A diverse and inclusive environment that embraces change, innovation, and collaboration
- A hybrid working model, allowing for in-office / work from home flexibility, generous vacation, personal and volunteer days
- Employee Resource Groups support an inclusive workplace for everyone and promote community engagement
- Competitive compensation packages including health and wellbeing benefits, retirement savings plans, parental leave, and family building benefits
- Educational resources, matching gift and volunteer programs
- physical, emotional, and financial wellness benefits
- retirement savings plans
- parental leave
- family building benefits
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
Number of Employees
5,001-10,000 employees
