About The Position

The Technical Program Manager - AI Safety Enforcement works within Microsoft CoreAI’s Responsible AI Operations team, the operational arm responsible for monitoring AI misuse, investigating abuse signals, reviewing high-risk content, managing customer notifications and appeals, supporting data-labeling and quality programs, and helping ensure Microsoft AI systems are deployed safely and responsibly. The team combines human review, policy enforcement, incident response, analytics, and operational tooling to identify emerging AI risks, protect customers, improve model safeguards, and scale Responsible AI governance across Microsoft AI products. In this role, you will investigate flagged AI safety threats, including cybersecurity or CBRN risks and malicious use of AI, and turn evidence into decisions that strengthen safeguards and protect customers. You will review and assess potential misuse across different content modalities, document findings, contribute to investigation guidelines and taxonomies, and recommend improvements to detection, safeguards, enforcement, policy, and products. Work must follow applicable Microsoft policies, including requirements for safely handling sensitive or potentially disturbing content.

Requirements

  • Bachelor's degree and 2+ years of experience in engineering, product/technical program management, data analysis, or product development, or equivalent experience.
  • At least 1 year of experience managing cross-functional and/or cross-team projects.
  • Ability to meet Microsoft, customer, and/or government security screening requirements, including passing the Microsoft Cloud Background Check upon hire or transfer and every two years thereafter.

Nice To Haves

  • Bachelor’s degree in an applicable field such as cybersecurity, chemical or biological sciences, computer science, information security, data analytics, business, or a related field; or 2+ years of experience in cybersecurity, security operations, threat intelligence, incident response, trust and safety, fraud, risk analysis, abuse investigations, or related operations; or equivalent professional experience.
  • Experience conducting evidence-based security, CBRN abuse, or threat investigations, assessing available signals, and making decisions using structured policies, investigative frameworks, or enforcement guidelines.
  • Ability to handle sensitive or potentially disturbing content while following company policies.
  • Understanding of generative AI and large language model capabilities, limitations, and failure modes, especially potential cyber or bio misuse and attempts to circumvent safeguards.
  • Familiarity with cyber threat frameworks, taxonomies, indicators of compromise, and threat-intelligence platforms or standards such as MITRE ATT&CK, MITRE ATLAS, and OWASP.
  • Written and verbal communication skills, including documenting investigative evidence and explaining cyber risks, findings, and mitigation recommendations to technical and non-technical audiences.
  • Experience reviewing or investigating text, image, audio, video, or multimodal content using structured policies, taxonomies, or evaluation frameworks.
  • Experience partnering with security, threat intelligence, engineering, data science, policy, legal, compliance, or customer-support teams on sensitive cyber investigations or escalations.
  • Experience with Microsoft Azure, Power BI, Kusto Query Language, SQL, Python, incident-management systems, or comparable investigative and analytical tools.

Responsibilities

  • Review potential cases of misuse of Microsoft AI products, identifying threats, adversarial behaviors, and abuse patterns using company guidelines for the relevant risk types.
  • Analyze user prompts, model outputs, account activity, and other available evidence to assess risk, policy applicability, and appropriate enforcement or mitigation outcomes using AI Safety guidance and Responsible AI frameworks.
  • Grade user prompts and model outputs according to policy.
  • Apply investigative expertise to text, code, image, audio, video, and multimodal abuse scenarios.
  • Analyze available data to connect abuse signals, scope potential impact, and support evidence-based enforcement and mitigation decisions using existing processes and tools.
  • Document abusive behaviors, indicators, tactics, techniques, and patterns involving generative AI to support repeatable investigations and improved detection.
  • Develop, refine, and validate AI Safety taxonomies, investigative guidelines, classifier definitions, reviewer instructions, escalation criteria, and evaluation datasets.
  • Translate investigation findings into actionable recommendations for detections, classifiers, model safeguards, enforcement strategies, policies, and product mitigations.
  • Lead or contribute to priority AI misuse investigations, incidents, high-risk submissions, customer appeals, and complex escalations involving potential AI abuse.
  • Perform all work in accordance with applicable Microsoft policies, including the safe handling of sensitive or potentially disturbing content.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service