Senior Manager, AI Architecture

Johnson & Johnson Innovative Medicineβ€’Raritan, NJ
β€’$140,000 - $241,500

About The Position

The Senior Manager, AI Architecture & Innovation will lead enterprise AI strategy and architecture, the AI Innovation Lab, and a distributed team of AI architects and engineers, including the GCC Innovation Squad in Bengaluru. Reporting to the Sr. Director, Architecture & Platforms, this role will define the AI technology roadmap, establish reference architectures and engineering patterns, evaluate emerging capabilities, and translate business priorities into practical enterprise solutions. The position may also lead delivery of strategic AI platforms, accelerators, and applications when architectural continuity and technical depth are critical from concept through production. The role serves as a senior technical counterpart to portfolio, product, platform, and business leaders, advising on what to build, how to architect it, and when capabilities are ready for enterprise adoption and scale. The manager will guide AI initiatives from exploration and architecture through prototype, pilot, and production, with explicit transitions to long-term platform, product, or application owners. The position also has responsibility for building a technically strong team and leading the AI Innovation Lab and its innovation portfolio across Commercial, R&D, Supply Chain, and Global Functions. The role is based in Raritan, New Jersey. Travel is up to 10%, and English proficiency is required. Johnson & Johnson has announced plans to separate its Orthopaedics business as DePuy Synthes; if the separation is completed, the employee is anticipated to become a DePuy Synthes employee, subject to the stated conditions and processes.

Requirements

  • Bachelor's degree in Computer Science, Engineering, or a related technical field.
  • 15 or more years of experience across software, data, and AI engineering, including enterprise-scale platforms and distributed systems.
  • 5 or more years in architecture or senior technical leadership roles responsible for platform strategy, target-state architecture, and major technology decisions.
  • 3 or more years of people leadership or direct accountability for leading multidisciplinary architecture and engineering teams.
  • 2 or more years designing, building, or leading generative and agentic AI capabilities in production.
  • Hands-on technical foundation in LLM integration, multi-agent orchestration, RAG and Graph RAG, tool calling, MCP/A2A, AI gateways, evaluation, and vector databases.
  • Strong data platform background, including Databricks, lakehouse architectures, Spark, Kafka or streaming, data products, and governed data access.
  • Cloud architecture experience on AWS preferred, or Azure/GCP, together with Kubernetes, containers, CI/CD, and Infrastructure-as-Code.
  • Working proficiency in Python, SQL, and APIs, with the technical depth to inspect code, evaluate prototypes, and guide architecture and engineering decisions.
  • Track record of taking AI platforms, accelerators, or strategic applications from 0 to 1 and establishing a path to enterprise scale with measurable outcomes.
  • Experience managing distributed or offshore teams and influencing across architecture, product, platform, security, and business organizations.
  • English proficiency.
  • Ability to travel up to 10%.

Nice To Haves

  • Master's degree or PhD in Computer Science, Machine Learning, or a related field.
  • Experience in medical device, life sciences, or another regulated industry, including familiarity with GxP, data privacy, and validated systems.
  • Experience building enterprise agent platforms, AI-enabled SDLC capabilities, and reusable AI product or platform services.
  • Relevant AWS, Databricks, AI architecture, or cloud certifications.
  • External thought leadership through conference speaking, publications, standards participation, or AI community leadership.

Responsibilities

  • Define and evolve enterprise AI strategy, architecture, and roadmap across Databricks Mosaic AI, Amazon Bedrock, AgentCore, the enterprise model gateway, and related services.
  • Architect agentic runtime capabilities, including agent orchestration and mesh, MCP tool and skill registries, Agent-to-Agent interoperability, agent identity, entitlements, and secure tool execution.
  • Design reusable context and knowledge services, including RAG and Graph RAG, vector stores, knowledge graphs such as Amazon Neptune, shared memory, and context assembly.
  • Establish patterns for LLMOps and MLOps, observability, evaluation, Responsible AI, security, and AI cost management in partnership with platform and governance teams.
  • Create a discoverable catalog of AI services, models, agents, tools, skills, and reference patterns for enterprise reuse.
  • Guide architecture decisions across strategic AI applications, balancing speed, reuse, interoperability, regulatory requirements, and long-term operability.
  • Lead the AI Innovation Lab and maintain an actionable innovation portfolio aligned to business strategy across Commercial, R&D, Supply Chain, and Global Functions.
  • Scout, evaluate, and prototype emerging models, agent frameworks, protocols, and development approaches, distinguishing durable enterprise capabilities from short-lived trends.
  • Lead AI capabilities through explore, prototype, pilot, and scale stage gates, with explicit investment, production-readiness, adoption, or termination criteria.
  • Own or direct delivery of selected strategic AI platforms, accelerators, and applications when sustained technical leadership is required.
  • Graduate successful prototypes into reusable platform capabilities or supported applications with clear ownership, service expectations, documentation, and operational handoff.
  • Drive AI-enabled software development lifecycle automation, including coding assistants such as Claude, Microsoft Copilot, and Codex, and persona-based agent workflows.
  • Demonstrate working capabilities to senior leadership and translate technical outcomes into measurable business value and investment decisions.
  • Build, lead, and develop a high-performing team of AI architects and engineers across US and GCC locations.
  • Set priorities, technical direction, engineering standards, and quality expectations for the AI Innovation Lab and GCC Innovation Squad.
  • Review critical designs, challenge architecture and engineering decisions, and guide teams through complex implementation trade-offs.
  • Develop talent through coaching, mentoring, technical reviews, and challenging assignments while building succession and critical skill depth.
  • Align team capacity to strategic priorities and balance research, architecture, prototyping, and production delivery.
  • Lead distributed teams and influence partner organizations, vendors, and stakeholders.
  • Serve as a core member of the Architecture Review Board and ensure AI solutions follow enterprise architecture standards, cybersecurity requirements, and Responsible AI guardrails.
  • Partner with Architecture Standards & Responsible AI, Data & AI Platforms, Cybersecurity, Product, and domain architecture teams to convert priority use cases into reusable solutions.
  • Define decision rights and transition points among innovation, platform, and product teams to avoid unclear ownership or unsupported production solutions.
  • Contribute to vendor strategy, technical due diligence, and partnerships with AI providers, startups, academia, and the broader technology ecosystem.

Benefits

  • Participation in the company's consolidated retirement pension plan, subject to plan terms.
  • Participation in the company's 401(k) savings plan, subject to plan terms.
  • 120 hours of vacation per calendar year, subject to policy and date of hire.
  • 40 hours of sick time per calendar year, with different amounts for residents of Colorado and Washington.
  • 13 days of holiday pay, including Floating Holidays, per calendar year.
  • Up to 40 hours of Work, Personal and Family Time per calendar year.
  • 480 hours of parental leave within one year of the birth, adoption, or foster care of a child.
  • Bereavement leave of 240 hours for an immediate family member and 40 hours for an extended family member per calendar year.
  • 80 hours of caregiver leave in a 52-week rolling period.
  • 32 hours of volunteer leave per calendar year.
  • 80 hours of military spouse time-off per calendar year.
Β© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service