Principal, AI/ML Engineer

Fidelity Investments•Durham, NC

18h•Hybrid

About The Position

Principal AI Engineer The Role The Workplace Investing AI Delivery Engineering Team is seeking a Principal AI Engineer with deep expertise in Generative AI, Retrieval-Augmented Generation (RAG), prompt engineering, prompt tuning, and model fine tuning. In this role, you will architect, implement, and scale GenAI solutions leveraging AWS cloud services. You will partner closely with data scientists, other AI & ML engineers, and product teams to build enterprise grade GenAI platforms, including vector search, retrieval pipelines, model orchestration, evaluation frameworks, and responsible AI guardrails. This is a hands on technical leadership role involving engineering strategy, solution architecture, mentoring, and end to end implementation. The Expertise and Skills You Bring Required Technical Expertise • Generative AI — designing, building, and deploying solutions using LLMs, embedding models, and multimodal models. • RAG Systems — experience with vector databases, embeddings, chunking strategies, retrieval pipelines, query transformation, and evaluation frameworks. • Prompt Engineering & Prompt Tuning — designing prompt patterns, optimizing LLM interactions, and applying lightweight tuning (e.g., LoRA, PEFT). • Experience working with Intelligent Document Processing systems • Significant experience with AWS Machine Learning Stack — SageMaker, Bedrock, Lambda, AWS Step Functions, EC2/EKS, IAM, API Gateway, S3, RDS • MLOps & GenAIOps — CI/CD pipelines, model hosting, monitoring, evaluation, observability, and automated deployment workflows. • Data Engineering (7+ years) — designing and automating complex pipelines with structured and unstructured data; strong SQL; orchestration via Airflow or similar. • API Development (7+ years) — building scalable microservices in Java/Spring Boot and/or Python; Angular experience is a plus. Leadership & Collaboration • Proven track record as a technical leader, influencing architecture, engineering patterns, and GenAI best practices. • Experience mentoring engineers and driving cross-team alignment on AI/ML delivery. • Strong communication skills with ability to partner with non-technical stakeholders. The Team Fidelity's Workplace Investing business is one of the nation's leading providers of employer-sponsored retirement plans. Behind every retirement account are operations teams navigating complex regulations, processing participant requests, and helping employers maintain compliant plans. Our mission is to transform retirement plan administration through automating document processing, participant inquiries, and plan sponsor support that currently require manual intervention. You'll join an agile squad dedicated to building production GenAI systems that revolutionize how we serve plan participants and sponsors. The team includes AI/ML engineers with a mix of senior and mid-level talent, data scientists focused on model development and business impact, data engineers building pipelines for unstructured data, and product manager partnering on roadmap and delivery. Company Overview At Fidelity, we are passionate about making our financial expertise broadly accessible and effective in helping people live the lives they want! We are a privately held company that places a high degree of value in creating and nurturing a work environment that attracts the best talent and reflects our commitment to our associates. We are proud of our diverse and inclusive workplace where we respect and value our associates for their unique perspectives and experiences. For information about working at Fidelity, visit FidelityCareers.com. Fidelity Investments is an equal opportunity employer. Fidelity will reasonably accommodate applicants with disabilities who need adjustments to complete the application or interview process. Please email us at [email protected] or call 800-835-5099, prompt 2, option 2 if you would like to request an accommodation. Certifications: Category: Information Technology Most roles at Fidelity are Hybrid, requiring associates to work onsite every other week (all business days, M-F) in a Fidelity office. This does not apply to Remote or fully Onsite roles. Some roles may have unique onsite requirements. Please consult with your recruiter for the specific expectations for this position. Please be advised that Fidelity’s business is governed by the provisions of the Securities Exchange Act of 1934, the Investment Advisers Act of 1940, the Investment Company Act of 1940, ERISA, numerous state laws governing securities, investment and retirement-related financial activities and the rules and regulations of numerous self-regulatory organizations, including FINRA, among others. Those laws and regulations may restrict Fidelity from hiring and/or associating with individuals with certain Criminal Histories. At Fidelity, we are passionate about making our financial expertise broadly accessible and effective in helping people live the lives they want! We are a privately held company that places a high degree of value in creating and nurturing a work environment that attracts the best talent and reflects our commitment to our associates. We are proud of our diverse and inclusive workplace where we respect and value our associates for their unique perspectives and experiences. For information about working at Fidelity, visit FidelityCareers.com. Fidelity Investments is an equal opportunity employer. Fidelity will reasonably accommodate applicants with disabilities who need adjustments to participate in the application or interview process. To initiate a request for an accommodation please contact the following: For roles based in the US: Contact the HR Leave of Absence/Accommodation Team by sending an email to [email protected], or by calling 800-835-5099, prompt 2, option 2 For roles based in Ireland: Contact [email protected] For roles based in Germany: Contact [email protected] Fidelity Privacy Policy

Requirements

Generative AI — designing, building, and deploying solutions using LLMs, embedding models, and multimodal models.
RAG Systems — experience with vector databases, embeddings, chunking strategies, retrieval pipelines, query transformation, and evaluation frameworks.
Prompt Engineering & Prompt Tuning — designing prompt patterns, optimizing LLM interactions, and applying lightweight tuning (e.g., LoRA, PEFT).
Experience working with Intelligent Document Processing systems
Significant experience with AWS Machine Learning Stack — SageMaker, Bedrock, Lambda, AWS Step Functions, EC2/EKS, IAM, API Gateway, S3, RDS
MLOps & GenAIOps — CI/CD pipelines, model hosting, monitoring, evaluation, observability, and automated deployment workflows.
Data Engineering (7+ years) — designing and automating complex pipelines with structured and unstructured data; strong SQL; orchestration via Airflow or similar.
API Development (7+ years) — building scalable microservices in Java/Spring Boot and/or Python; Angular experience is a plus.
Proven track record as a technical leader, influencing architecture, engineering patterns, and GenAI best practices.
Experience mentoring engineers and driving cross-team alignment on AI/ML delivery.
Strong communication skills with ability to partner with non-technical stakeholders.