Sr Associate AI Full stack Software Engineer
About The Position
McKesson is seeking a skilled and motivated AI Full Stack Software Engineer to join its team at CMM. The role designs, develops, and deploys end-to-end AI-powered solutions for healthcare products and services, working across front-end interfaces, back-end AI model integration, and data pipelines. The engineer develops enterprise-quality AI applications and integrates large language models and other AI capabilities into new and legacy codebases. The position also involves building and evaluating AI systems, communicating AI concepts to non-technical audiences, documenting work, adapting to change, and collaborating with internal staff and external stakeholders. Priority will be given to candidates residing in the Atlanta, Georgia, or Columbus, Ohio, metropolitan areas. McKesson is unable to provide sponsorship for this role presently or in the future.
Requirements
- At least 2 years of software development experience.
- At least 2 years of experience developing AI-enhanced applications using LLMs, voice, image, or speech models.
- B.S. degree in Computer Science or a related engineering discipline, or equivalent experience.
- Proficiency in AI system evaluation metrics, including precision, recall, F1-score, and AUC-ROC, and MLOps for scalable, cost-efficient AI deployment.
- Experience building RAG systems from scratch or using LangChain or LlamaIndex, with vector databases for context-aware LLM applications.
- Expertise managing LLM costs, including token pricing and input/output rates, through prompt caching, batching, and quantization.
- Deep understanding of LLM advancements, including GPT-3.5, GPT-4, and o1/thinking models, to inform model selection and tuning.
- Exceptional analytical skills and ability to extract actionable insights from data.
- Experience using AI coding tools such as GitHub Copilot, Cursor, or Codeium/Windsurf.
- Proficiency in Python and AI-related Python libraries such as OpenAI, TensorFlow, and PyTorch.
- Healthcare domain expertise and ability to translate clinical and business needs into AI solutions.
- Proficiency in creating Node.js web apps, such as with Express.js.
- Experience with cloud platforms such as AWS, GCP, or Azure.
- Effective communication skills for collaboration with technical, DevOps, and product management teams.
- Experience with Git, Docker, and Kubernetes.
Responsibilities
- Develop and deliver AI-driven enterprise-quality software applications.
- Build scalable applications that integrate large language models and tools such as voice recognition, document parsing, image parsing, text-to-speech, and retrieval-augmented generation into new and legacy codebases.
- Design and optimize data pipelines and datasets for AI system development and testing.
- Communicate modern AI concepts, including LLMs and vector databases, to non-technical audiences.
- Iteratively craft prompts to maximize LLM performance and implement prompt-caching strategies.
- Maintain prompt libraries and benchmark performance.
- Fine-tune and serve GPT-family and Llama models.
- Develop AI agents using Semantic Kernel.
- Prototype copilot experiences and autonomous workflows.
- Fully document work at both the code and application levels.
- Collaborate with staff and external stakeholders on large projects.
- Learn and adapt in a changing environment and develop solutions to complex problems.
Benefits
- Competitive compensation package.
- An annual bonus or long-term incentive opportunities may be offered.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
