BCG Platinion | Senior IT Architect - AI Platforms

Boston Consulting Group•Durham, NC

4d•Onsite

About The Position

BCG Platinion is seeking a Senior IT Architect specializing in AI Platforms. This role involves designing and implementing intelligent, agentic AI platforms, integrating large language models (LLMs), data pipelines, and enterprise systems. The position is ideal for individuals who enjoy hands-on development while also growing their architectural skills. The architect will work closely with Lead and Principal Architects, contributing to AI platform implementations.

Requirements

Bachelor’s degree in information technology, computer science, engineering, or a related field.
4+ years of experience in software engineering, data engineering, or AI development.
Solid foundation in software development and distributed systems concepts.
Hands-on experience building or integrating AI/ML or LLM-based components.
Hands-on experience using AI-assisted coding tools (e.g., Cursor, Claude Code, Replit, Lovable) to support development, debugging, and rapid iteration of AI platform components.
Familiarity with modern AI frameworks and libraries (e.g., LangChain, LlamaIndex, Semantic Kernel, or similar).
Working understanding of agentic AI concepts such as RAG, prompt orchestration, vector databases, and basic multi-agent patterns.
Basic understanding of cloud platforms and AI services, with experience in at least one hyperscaler environment.
Exposure to deploying AI workloads on cloud platforms.
Experience integrating AI components with APIs and data sources.
Familiarity with containerization concepts (Docker; Kubernetes exposure is a plus).
Strong problem-solving skills and attention to code quality.
Ability to explain technical concepts clearly within a project team.
Willingness to learn and grow in fast-paced, ambiguous environments.
Agile mindset with a focus on iterative delivery and continuous improvement.
Willingness to travel to work with clients and BCG teams as needed.
Gen AI fluency (e.g., proven usage of GenAI such as ChatGPT, Claude) and validation of response.

Nice To Haves

Master’s degree is a plus.
Proficiency in one or more programming language such as Python or JavaScript is nice to have.
Kubernetes exposure is a plus.

Responsibilities

Collaborate with engineers, data scientists, and architects to deliver AI platform components.
Contribute to the design and implementation of AI platform and agentic system components.
Apply AI and software engineering skills to build, test, and improve AI platform capabilities.
Operate effectively when requirements are evolving, adapting technical approach as solutions take shape.
Support teams in adopting new AI capabilities by assisting with implementation, integration, and operational readiness.
Work within agile teams, iterating on designs and implementations.
Explore and apply modern AI platform and agentic patterns to improve solution quality and scalability.
Grow architectural skills by combining hands-on implementation with exposure to broader system design decisions.
Support senior architects and technical leads by executing assigned workstreams and contributing to AI platform solutions.
Contribute to the design of AI and LLM-based system architectures with guidance from senior architects.
Implement agentic AI components that support intelligent workflow automation and task execution.
Build and extend RAG-based solutions for context retrieval, prompt workflows, and system integration.
Follow established architectural standards and contribute feedback to improve design patterns and practices.
Support implementation of batch and real-time inference pipelines with attention to performance and reliability.
Develop prototypes and technical proofs-of-concept to validate AI platform components and workflows.
Implement solutions using modern AI frameworks and libraries under architectural guidance.
Test and iterate on agentic workflows, prompts, and retrieval strategies to improve solution behavior.
Support implementation and deployment of AI platform components into development and production environments.
Assist with monitoring, troubleshooting, and improving system performance and reliability.
Follow defined standards for versioning, testing, and monitoring of AI services and models.
Communicate technical concepts clearly within the project team and with immediate stakeholders.
Support preparation of technical documentation and presentations.
Collaborate closely with engineers, data scientists, and product team members to deliver agreed solutions.
Participate in technical working sessions and design discussions, contributing ideas and implementation insights.
Seek and incorporate feedback from senior team members to improve technical output.
Support junior team members through knowledge sharing and day-to-day collaboration.
Contribute positively to team culture and ways of working.
Seek feedback on work quality and incorporate guidance from senior architects.
Demonstrate professionalism and alignment with BCG’s culture and values.
Experiment with new tools and techniques under guidance to expand technical skill sets.
Build depth in AI platform engineering through hands-on delivery experience.
Actively pursue learning opportunities to grow toward broader architectural responsibilities.
Contribute technical input to proposals or internal initiatives when needed.

Benefits

An opportunity to work organically across disciplines and across BCG, combining strategic thinking with hands-on applications.
A unique experience to work alongside a team of passionate and driven problem-solvers with a mission to deliver innovative and valuable digital solutions in a supportive environment.
Annual discretionary performance bonus.
BCG's Profit Sharing and Retirement Fund (PSRF) contribution.
Market leading benefits package.
Full cost of medical, dental, and vision coverage for employees and their eligible family members.
$10 (USD) copays for trips to the doctor, urgent care visits and prescriptions for generic drugs.
Dental coverage, including up to $5,000 (USD) in orthodontia benefits.
Vision insurance with coverage for both glasses and contact lenses annually.
Reimbursement for gym memberships and other fitness activities.
Fully vested retirement contributions made annually.
Generous paid time off including vacation, holidays, and annual office closure between Christmas and New Years.
Paid Parental Leave and other family benefits such as elective egg freezing, surrogacy, and adoption reimbursement.