AI/ML Engineer

Booz Allen Hamilton•McLean, VA

6d•$99,000 - $225,000

About The Position

As an AI/ML Engineer, you’re excited by the rapid evolution of AI and the impact modern LLM technologies can have on real users. You understand that building dependable AI capabilities requires more than clever prompts — it requires thoughtful engineering, clear communication, and the ability to collaborate across diverse technical and mission teams. We’re seeking someone with a strong foundation in IT, systems, software, data, cloud, infrastructure, integration, or related technical disciplines who is eager to apply that experience to scalable AI/ML solutions that support enterprise-level environments and sensitive data workflows. As an AI/ML Engineer on our team, you’ll design and refine prompts, help build LLM-powered workflows, and support the development of retrieval augmented systems that improve decision making and operational efficiency. You’ll work closely with senior technical leaders who will guide AI/ML direction while you contribute hands-on execution and apply your broader IT and technical experience to real mission applications. You’ll collaborate with cross-functional teams and apply modern AI practices in secure, regulated environments. Join us. The world can’t wait.

Requirements

8+ years of experience in IT, systems administration, software development, systems integration, cloud services, data engineering, cybersecurity, infrastructure, enterprise applications, or automation
Experience with AI/ML, LLM-enabled tools, prompt engineering, automation, analytics, data workflows, or emerging technology solutions
Experience in designing, testing, and iterating on prompts for LLM-powered applications
Experience with Retrieval Augmented Generation such as chunking, embeddings, retrieval, and grounding responses in source data
Experience with Python, including writing clean and reusable code
Experience with Git, GitHub, or version control tools
Ability to effectively communicate, confirm requirements, reduce churn, and maintain alignment across teams
Ability to obtain and maintain a Public Trust or Suitability/Fitness determination based on client requirements
Bachelor’s degree in a Computer Science, Information Technology, or STEM field

Nice To Haves

Experience with prompting techniques such as few-shot prompting, structured output formats, ReAct, or similar prompting approaches
Experience building or supporting simple multi-step LLM workflows using tools such as LangChain, LlamaIndex, Semantic Kernel, LangGraph, or similar tools
Knowledge of responsible AI practices including content filtering, guardrails, output validation, or safe handling of model outputs
Experience working with PHI, PII, or within HIPAA, IRB, or ATO environments
Experience with vector databases or semantic search systems
Experience building evaluation sets for prompt testing
Experience with enterprise tools such as Jira, Confluence, or API-driven workflows
Experience in healthcare, research data, or regulated data environments
Experience with Microsoft Azure services, Azure OpenAI, or Azure ML and AI Foundry tooling
Experience applying IT, systems, software, data, cloud, or integration experience to emerging technology initiatives

Responsibilities

Design and refine prompts for LLM-powered applications.
Help build LLM-powered workflows.
Support the development of retrieval augmented systems that improve decision making and operational efficiency.
Collaborate with senior technical leaders on AI/ML direction.
Contribute hands-on execution and apply broader IT and technical experience to real mission applications.
Collaborate with cross-functional teams.
Apply modern AI practices in secure, regulated environments.
Support the assessment, design, integration, documentation, implementation, or troubleshooting of IT or technical solutions.