Senior Principal AI Engineer

Rapid7•San Francisco, CA
•$255,900 - $346,200

About The Position

Rapid7 is scaling its AI Engineering capabilities and seeks Senior Principal AI Engineers to define and influence the technical direction of LLM and agentic AI systems across the organization. The role addresses complex technical challenges, establishes architectural principles and engineering standards, and drives greenfield innovation for global customers. Through technical leadership and mentoring, the engineer shapes strategic product and platform investments and influences how Rapid7 builds and scales AI. Rapid7’s AI Engineering team builds AI for its security platform, taking models from research to production. The team combines open-source and frontier LLMs, AI agents, predictive models, and Rapid7’s security expertise. Its work supports Detection and Response use cases such as alert triage, threat investigation, and automated response, as well as Exposure and Remediation use cases such as vulnerability prioritization, attack surface risk assessment, and guided remediation. The Senior Principal AI Engineer will set the technical direction for building, tuning, and serving LLMs and agentic systems across Rapid7’s security products. The role requires deep understanding of LLMs, from transformer internals and training through fine-tuning and inference optimization, while remaining hands-on with challenging technical problems. The engineer will select among LLMs, predictive AI, and classical ML according to the needs of each problem. The position sets AI technical vision, architecture, and a multi-year roadmap across Detection and Response and Exposure and Remediation; defines company-wide model strategy; leads complex, high-risk initiatives across teams; establishes standards for context engineering, inference optimization, and evaluation; and leads inference optimization at scale. It also includes leading design reviews, prototyping and building critical model, training, and inference code, mentoring senior technical staff, and representing AI Engineering to executives, customers, and the external community.

Requirements

  • 14+ years of software or ML engineering experience, including 2+ years building production LLM or agentic AI systems.
  • Track record of building scalable, production-grade AI systems and shared platforms adopted across multiple products, with company-wide impact through technical leadership, mentoring, and standards.
  • Leading-edge expertise in LLMs, including transformer architecture, attention, tokenization, positional encodings, and how models are trained and served.
  • Advanced PyTorch skills, including custom model code, mixed precision, and distributed training such as FSDP or DeepSpeed.
  • Hands-on experience fine-tuning and post-training open-weight LLMs, including full and parameter-efficient methods such as LoRA and QLoRA, distillation, and preference- or RL-based methods such as DPO and GRPO.
  • Deep experience with context engineering, including retrieval, memory, and context management for long-running agent workflows, and defining evaluation strategy and benchmarks for LLM and agent systems.
  • Deep knowledge of inference optimization, including prefill and decode, KV-cache management, continuous batching, speculative decoding, and quantization.
  • Experience serving models at scale with vLLM, SGLang, or TensorRT-LLM.
  • Strong predictive AI, classical ML, distributed systems, and Python fundamentals, with judgment to choose approaches based on accuracy, latency, and cost.
  • Ability to take accountability for organization-wide technical outcomes, address systemic risks, and align technical decisions with strategic priorities.
  • Ability to communicate complex architectural trade-offs, build consensus, and influence technical and product decisions across the organization.
  • Ability to build alignment across Engineering, Product, and other functions on technical direction and product and platform investments.
  • Ability to anticipate customer needs and make informed trade-offs among capability, performance, cost, and scalability.
  • Ability to thrive in ambiguity at the leading edge of AI and drive change as technology and the threat landscape evolve.
  • Recognition as an AI expert, evidenced by publications, patents, open-source contributions, or industry engagement.
  • Ability to embody Rapid7’s core values and foster a culture of excellence, meaningful impact, and collective success.

Nice To Haves

  • PhD in Computer Science, Machine Learning, AI, or a related field; equivalent depth of expertise demonstrated through industry experience and technical contributions is also accepted.
  • Experience training LLMs from scratch.
  • Inference optimization experience on AWS.
  • GPU kernel experience using CUDA or Triton.

Responsibilities

  • Set the AI technical vision, architecture, and multi-year roadmap for LLM and agentic systems across Detection and Response and Exposure and Remediation.
  • Define company-wide model strategy, including choices among frontier and open-source models, fine-tuning, distillation, post-training, and investment in new capabilities.
  • Lead complex, high-risk technical initiatives across multiple teams, including fine-tuning, distillation, and post-training open-source LLMs on security data.
  • Establish company-wide standards for context engineering, inference optimization, and evaluation, with evaluations serving as release gates for AI systems.
  • Lead optimization of LLM inference at scale while balancing quality, latency, and cost.
  • Lead design reviews, resolve complex technical trade-offs, and prototype and build critical model, training, and inference code.
  • Mentor and develop Principal, Staff, and Senior engineers and strengthen AI engineering capabilities across Rapid7.
  • Represent Rapid7’s AI Engineering to executives, customers, and the external community, influencing product, platform, and business strategy.
  • Take accountability for organization-wide technical outcomes, address systemic risks, and remove barriers to delivery while aligning technical decisions with strategic priorities.
  • Build alignment across Engineering, Product, and other functions on technical direction and decisions shaping product and platform investments.
  • Anticipate customer needs and shape AI architecture and technical strategy to maximize customer value, making informed capability, performance, cost, and scalability trade-offs.
  • Drive change and maintain a forward-looking approach as AI technology and the threat landscape evolve.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service