Senior Manager, Intelligence Systems Lab

Bristol Myers Squibb • Princeton, NJ

1d • Hybrid

About The Position

In support of enterprise AI strategy, the Senior Manager of Intelligence Systems Lab conducts research into the principles of intelligence and develops agentic AI systems grounded in rigorous evaluation science. This hands-on technical role focuses on understanding and implementing reasoning, planning, memory, and generalization capabilities for AI agents, while building benchmarking methodologies to assess agent performance. The position supports cross-functional stakeholders in Commercial, Manufacturing, Clinical Development, and Research functions.

Requirements

• Educational Background: BA/BS required (quantitative area of study such as Computer Science, Data Science, Statistics, Mathematics, Cognitive Science, or Engineering preferred).
• MS or other graduate degree preferred.
• Technical Proficiency: Proficiency in Python (R or Julia), with hands-on experience with ML frameworks (Scikit-Learn, TensorFlow, PyTorch, etc.)
• Experience with agentic AI frameworks (Strands, LangGraph, AutoGen, DSPy, CrewAI, or similar).
• Experience with LLMs, prompt engineering, and RAG architectures.
• Familiarity with benchmarking and evaluation methodologies for AI systems.
• Proficiency in SQL and experience with cloud-based environments (AWS, Azure, GCP).
• Experience with Git and software version control.
• Experience with experimental design and statistical analysis preferred
• Communication Skills: Excellent communication and presentation skills, with a proven ability to explain complex research and analyses to both technical and non-technical stakeholders.
• Experience presenting at conferences or publishing research preferred.
• Experience: A minimum of 3 years of hands-on experience in data science, machine learning, AI development, or AI research.
• Relevant advanced degrees contribute to required years of experience.
• Cross-Functional Collaboration: Proven experience in working on complex research or development projects with multi-functional team members.

Nice To Haves

• Experience with pharmaceutical or life sciences industry preferred.
• MS or other graduate degree preferred.
• Experience with experimental design and statistical analysis preferred
• Experience presenting at conferences or publishing research preferred.

Responsibilities

• Research and Framework Development: Conduct research on reasoning, planning, memory, and generalization architectures for AI agents and multi-agent systems.
• Develop and test frameworks for agent cognition, including abstraction, goal decomposition, and adaptive planning.
• Contribute to the lab's understanding of foundational principles underlying intelligent behavior in artificial systems.
• Stay current with academic literature and industry advances in AI reasoning, cognitive architectures, and agent design.
• Benchmarking and Evaluation Science: Design and execute benchmarking experiments to evaluate agent reasoning, reliability, and generalization capabilities.
• Develop evaluation methodologies for assessing AI agent performance across diverse tasks and domains.
• Build test harnesses, evaluation datasets, and measurement frameworks for multi-agent systems.
• Apply rigorous experimental design and statistical analysis to benchmark results.
• Agentic AI Development: Serve as a hands-on AI engineer, designing, developing, and deploying advanced agentic solutions.
• Build multi-agent AI systems using frameworks such as Strands, LangGraph, DSPy, and similar agentic architectures.
• Develop RAG (Retrieval Augmented Generation) applications, knowledge graphs, and conversational AI solutions.
• Implement autonomous workflows that demonstrate advances in reasoning and planning capabilities.
• Rapid Prototyping and Innovation: Turn research concepts into working prototypes that demonstrate advances in agent intelligence.
• Conduct proof-of-concept development to assess feasibility of new reasoning and planning approaches.
• Seek opportunities to translate research findings into production-ready capabilities.
• Contribute to documenting research findings, experimental results, and technical methodologies.
• Cross-Functional Collaboration: Work cross-functionally with analytics and business stakeholders to pilot AI solutions grounded in research insights.
• Translate complex AI research concepts into business language to drive understanding and adoption.
• Partner with the broader Applied Intelligence organization to advance agentic AI capabilities.
• Engage with Commercial, GPS/Manufacturing, Clinical Development, and Research teams in presenting research-informed solutions.
• Mentorship and Best Practices: Contribute to implementing best practices in agent evaluation, benchmarking science, and research methodology.
• Provide guidance to junior team members on AI/ML techniques, research methods, and development approaches.
• Support knowledge sharing through internal presentations, documentation, and collaborative research.

Benefits

• Medical, pharmacy, dental, and vision care.
• Programs such as BMS Well-Being Account, BMS Living Life Better, and Employee Assistance Programs (EAP).
• 401(k) plan, short- and long-term disability, life insurance, accident insurance, supplemental health insurance, business travel protection, personal liability protection, identity theft benefit, legal support, and survivor support.
• Paid Time Off US Exempt Employees: flexible time off (unlimited, with manager approval, 11 paid national holidays (not applicable to employees in Phoenix, AZ, Puerto Rico or Rayzebio employees)
• Phoenix, AZ, Puerto Rico and Rayzebio Exempt, Non-Exempt, Hourly Employees: 160 hours annual paid vacation for new hires with manager approval, 11 national holidays, and 3 optional holidays
• Based on eligibility, additional time off for employees may include unlimited paid sick time, up to 2 paid volunteer days per year, summer hours flexibility, leaves of absence for medical, personal, parental, caregiver, bereavement, and military needs and an annual Global Shutdown between Christmas and New Years Day.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level