BCG Platinion | Senior IT Architect - AI Platforms

Boston Consulting Group•Toronto, ON

1d•Hybrid

About The Position

BCG Platinion is seeking a Senior IT Architect specializing in AI Platforms to join their team. This role focuses on designing and implementing intelligent, agentic AI platforms, integrating large language models (LLMs), data pipelines, and enterprise systems. The ideal candidate will have a strong foundation in software engineering and AI development, with hands-on experience in building and extending AI components. This position offers an opportunity to grow architectural skills while working collaboratively in an agile environment, contributing to innovative digital solutions for clients.

Requirements

Bachelor’s degree in information technology, computer science, engineering, or a related field (Master’s degree is a plus).
4+ years of experience in software engineering, data engineering, or AI development.
Solid foundation in software development and distributed systems concepts.
Hands-on experience building or integrating AI/ML or LLM-based components.
Hands-on experience using AI-assisted coding tools (e.g., Cursor, Claude Code, Replit, Lovable) to support development, debugging, and rapid iteration of AI platform components.
Familiarity with modern AI frameworks and libraries (e.g., LangChain, LlamaIndex, Semantic Kernel, or similar).
Working understanding of agentic AI concepts such as RAG, prompt orchestration, vector databases, and basic multi-agent patterns.
Basic understanding of cloud platforms and AI services, with experience in at least one hyperscaler environment.
Exposure to deploying AI workloads on cloud platforms.
Experience integrating AI components with APIs and data sources.
Familiarity with containerization concepts (Docker; Kubernetes exposure is a plus).
Strong problem-solving skills and attention to code quality.
Ability to explain technical concepts clearly within a project team.
Willingness to learn and grow in fast-paced, ambiguous environments.
Agile mindset with a focus on iterative delivery and continuous improvement.
Willingness to travel to work with clients and BCG teams as needed.
Gen AI fluency (e.g., proven usage of GenAI such as ChatGPT, Claude) and validation of response.

Nice To Haves

Proficiency in one or more programming language such as Python or JavaScript is nice to have.

Responsibilities

Contribute to the design of AI and LLM-based system architectures with guidance from senior architects.
Implement agentic AI components that support intelligent workflow automation and task execution.
Build and extend RAG-based solutions for context retrieval, prompt workflows, and system integration.
Follow established architectural standards and contribute feedback to improve design patterns and practices.
Support implementation of batch and real-time inference pipelines with attention to performance and reliability.
Develop prototypes and technical proofs-of-concept to validate AI platform components and workflows.
Implement solutions using modern AI frameworks and libraries under architectural guidance.
Test and iterate on agentic workflows, prompts, and retrieval strategies to improve solution behavior.
Support implementation and deployment of AI platform components into development and production environments.
Assist with monitoring, troubleshooting, and improving system performance and reliability.
Follow defined standards for versioning, testing, and monitoring of AI services and models.
Communicate technical concepts clearly within the project team and with immediate stakeholders.
Support preparation of technical documentation and presentations.
Collaborate closely with engineers, data scientists, and product team members to deliver agreed solutions.
Participate in technical working sessions and design discussions, contributing ideas and implementation insights.
Seek and incorporate feedback from senior team members to improve technical output.
Support junior team members through knowledge sharing and day-to-day collaboration.
Contribute positively to team culture and ways of working.
Seek feedback on work quality and incorporate guidance from senior architects.
Demonstrate professionalism and alignment with BCG’s culture and values.
Stay current on emerging concepts in agentic AI, RAG, and AI platform tooling.
Experiment with new tools and techniques under guidance to expand technical skill sets.
Build depth in AI platform engineering through hands-on delivery experience.
Actively pursue learning opportunities to grow toward broader architectural responsibilities.
Contribute technical input to proposals or internal initiatives when needed.

Benefits

An opportunity to work organically across disciplines and across BCG, offering a unified and unrivaled opportunity that combines strategic thinking with hands-on applications.
A unique experience to work alongside a team of passionate and driven problem-solvers with a mission to deliver innovative and valuable digital solutions in a supportive environment.
First year base compensation for this role is $160,000 CAD.
Eligible for an annual discretionary performance bonus.
Retirement contribution.
Market leading benefits package.
Zero dollar ($0) health insurance premiums for BCG employees, spouses, and children.
100% coverage for prescription drugs, with no dispensing fee maximum.
Access to Telemedicine – virtual care when you need it.
Substantial mental health support, including mental health practitioner coverage and access to meditation and well-being apps.
Dental coverage, including orthodontia benefits for children and adults.
Robust vision coverage.
Flexible Spending Account for additional medical and wellbeing activities.
Retirement contributions made annually (whether you contribute or not), plus the option for employees to make personal contributions to an RRSP Plan.
Premier Family programs including, paid parental and family care leaves, and reimbursement for fertility, surrogacy, and adoption expenses.
Generous paid time off, including 10 public holidays and 2 floater days, office closure between Christmas and New Year’s, and 15 vacation days (earned at 1.25 days per month) annually.
Paid sick time on an as needed basis.