Principal AI Engineer
About The Position
The Principal AI Engineer provides the highest level of individual-contributor technical leadership for McKesson’s AI platform, operating above the Lead AI Engineer level. The role sets multi-year architecture strategy for agentic and LLM-powered systems across teams building on the platform, including model strategy, retrieval-augmented generation (RAG), tool and connector ecosystems, and evaluation and governance tooling. In a highly regulated healthcare environment, this person resolves the platform’s most difficult and ambiguous technical challenges, advises executive leadership on AI strategy and risk, and shapes safe and effective AI adoption across the engineering organization. Success is measured by the durability and adoption of the technical strategy across multiple teams, the ability to address cross-organizational technical risks before they become delivery or compliance problems, and influence on executive-level AI investment decisions.
Requirements
- Bachelor’s degree or equivalent experience; fewer years of experience may be required with a relevant Master’s or Doctorate.
- Typically 12+ years of software engineering experience, including 6+ years focused on AI/ML, LLM, or NLP systems in production and 3+ years as a senior individual-contributor technical leader; fewer years may be required with a relevant Master’s or Doctorate.
- Demonstrated technical leadership above the Lead AI Engineer level, including setting technical direction and standards across multiple teams.
- Track record of setting technical strategy adopted by multiple teams.
- Hands-on expertise building production LLM applications at scale, including prompt engineering, RAG, agentic workflows, tool use, and evaluation harnesses.
- Experience with commercial LLM APIs such as Anthropic or OpenAI and tool-integration protocols such as Model Context Protocol (MCP), including evaluating emerging alternatives.
- Strong software engineering fundamentals in Python and/or Java, REST APIs, event-driven architecture, microservices, and cloud-native design; Azure is preferred, while AWS or GCP is acceptable.
- Experience with vector and graph retrieval systems, embeddings, and knowledge-base architectures at production scale across multiple products.
- Deep working knowledge of LLMOps/MLOps, including usage attribution, cost and spend monitoring, abuse detection, and model evaluation pipelines, including designing these systems from scratch.
- Demonstrated ability to influence and align senior engineering and executive stakeholders without direct authority.
- Deep familiarity with regulated or healthcare data environments and AI governance frameworks, including model risk review, connector approval tiers, and PHI handling.
- Deep awareness of the GenAI and agentic landscape and ability to distinguish durable technical bets from hype.
- Experience managing strategic relationships with AI infrastructure vendors and model providers at the enterprise level.
- Exceptional written and verbal communication for executive, board-level, and external technical audiences.
Nice To Haves
- Advanced degree (M.S. or Ph.D.) in Computer Science, AI/ML, or a related technical field.
- Prior experience as a Principal, Staff, or Distinguished Engineer setting AI/ML technical strategy across multiple teams in healthcare IT or another highly regulated industry.
- Publications, patents, open-source contributions, or industry speaking on applied AI/LLM systems.
- Experience shaping enterprise-wide AI governance policy with Legal, Compliance, and Privacy leadership.
Responsibilities
- Own the multi-year technical strategy and roadmap for the AI platform across teams, including model strategy, RAG and retrieval architecture, connector ecosystems, and evaluation frameworks.
- Serve as the final technical escalation point for difficult and ambiguous architecture and reliability problems spanning multiple teams and systems.
- Set, audit, and evolve architecture, security, and evaluation standards adopted by multiple Lead AI Engineers and their teams.
- Advise VP- and executive-level leaders on AI platform strategy, model risk, and investment trade-offs.
- Lead architecture and prototyping for the organization’s highest-ambiguity and highest-risk AI initiatives.
- Develop Lead and Senior AI Engineers through design reviews, technical coaching, and structured knowledge-sharing across teams.
- Shape enterprise-wide AI governance policy, including model risk review, connector and tool approval frameworks, and PHI-handling standards, in partnership with Legal, Compliance, and Privacy leadership.
- Own evaluation and long-term strategy for foundation model providers and AI infrastructure vendors across the company.
- Represent McKesson’s AI engineering capability at industry forums, in partner and vendor technical relationships, and in recruiting senior technical talent.
- Influence AI platform direction and investment across the broader enterprise and beyond a single business unit.
Benefits
- Competitive compensation package as part of Total Rewards.
- Annual bonus or long-term incentive opportunities may be offered.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Principal
