Principal AI Systems Architect - Director
About The Position
Job Title: Principal AI Systems Architect Corporate Title: Director Location: Cary, NC Who we are: In short – an essential part of Deutsche Bank’s technology solution, developing applications for key business areas. Our Technologists drive Cloud, Cyber and business technology strategy while transforming it within a robust, hands-on engineering culture. Learning is a key element of our people strategy, and we have a variety of options for you to develop professionally. Our approach to the future of work champions flexibility and is rooted in the understanding that there have been dramatic shifts in the ways we work. Having first established a presence in the Americas in the 19th century, Deutsche Bank opened its US technology center in Cary, North Carolina in 2009. Learn more about us here. Overview As a Principal AI Systems Architect, you will be a pivotal leader in shaping the future of our AI platforms. You will drive the architectural integrity and long-term technical roadmap, specializing in hands-on RAG (Retrieval-Augmented Generation) architecture, large-scale repository ingestion, and deep LLM system design. Your expertise will be crucial in optimizing retrieval, building robust embeddings pipelines, and integrating knowledge graphs, all while ensuring cost-aware AI architecture and scalability across distributed systems. You will lead the design and implementation of AI Gateway and orchestration, including multimodal system designs. This role demands a very deep understanding of AI/ML/LLM domains and exceptional engineering and systems design capabilities, with a focus on delivering impactful product features and robust MLOps practices. What We Offer You A diverse and inclusive environment that embraces change, innovation, and collaboration A hybrid working model, allowing for in-office / work from home flexibility, generous vacation, personal and volunteer days Employee Resource Groups support an inclusive workplace for everyone and promote community engagement Competitive compensation packages including health and wellbeing benefits, retirement savings plans, parental leave, and family building benefits Educational resources, matching gift and volunteer programs
Requirements
- Very deep AI/ML/LLM domain expertise.
- Deep engineering/systems design knowledge.
- Proven experience in product/feature delivery and ML Ops.
- Proficiency with Vector DB, Graph DB, RDBMS (e.g., PostgreSQL + pgvector, Neo4j), and MCP Architectures.
- Experience with Google ADK/Vertex AI, retrieval optimization, embeddings pipelines, knowledge graph integration, AI Gateway, and orchestration.
- Knowledge of multimodal system design, rapid toolset evaluation, and cost-aware AI architecture.
Nice To Haves
- Understanding of compiler theory/programming languages/AST/parsers and scaling distributed systems.
- Demonstrated achievements such as contributions to foundational AI libraries (e.g., LangChain, LlamaIndex, AutoGen) or significant open-source projects.
Responsibilities
- Drive the architectural integrity and long-term technical roadmap for AI platforms.
- Design and implement Vector DB, Graph DB (e.g., Neo4j), and RDBMS (e.g., PostgreSQL + pgvector) solutions, and MCP Architectures.
- Leverage Google ADK/Vertex AI for AI solutions and ensure retrieval optimization and robust embeddings pipelines.
- Integrate knowledge graphs, and develop AI Gateway and orchestration frameworks.
- Architect multimodal system designs, focusing on rapid toolset evaluation and cost-aware AI architecture.
- Apply principles from the theory of compilers/programming languages/AST/parsers to scale distributed AI systems effectively.
- Lead hands-on RAG architecture, large-scale repository ingestion, and deep LLM system design.
- Contribute to major AI frameworks, demonstrate deep expertise in agentic frameworks, and potentially publish viral GitHub repositories or achieve top-tier competitor status in data challenges.
Benefits
- A diverse and inclusive environment that embraces change, innovation, and collaboration
- A hybrid working model, allowing for in-office / work from home flexibility, generous vacation, personal and volunteer days
- Employee Resource Groups support an inclusive workplace for everyone and promote community engagement
- Competitive compensation packages including health and wellbeing benefits, retirement savings plans, parental leave, and family building benefits
- Educational resources, matching gift and volunteer programs
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Director
Education Level
No Education Listed
