Staff AI Engineer

Rapid7•San Francisco, CA
•$186,500 - $252,300

About The Position

Rapid7 is expanding its AI Engineering capabilities to build sophisticated LLM and agentic AI systems for its security products. Staff AI Engineers shape technical direction across teams, solve complex cross-functional challenges, establish engineering practices, guide architecture, and mentor engineers while translating customer needs into scalable AI solutions. The AI Engineering team takes models from research to production, combining open-source and frontier LLMs, AI agents, predictive models, and Rapid7’s security expertise. Its work supports Detection and Response use cases such as alert triage, threat investigation, and automated response, as well as Exposure and Remediation use cases such as vulnerability prioritization, attack surface risk assessment, and guided remediation. The role owns technical solutions end to end, from choosing model strategies and training approaches to inference, evaluation, and deployment. The engineer remains hands-on with complex model, training, and inference work, while leading design decisions and partnering with Product and platform teams to deliver solutions that balance customer value, performance, and cost.

Requirements

  • 8+ years of software or ML engineering experience, including 2+ years building production LLM or agentic AI systems.
  • Track record of leading delivery of scalable, production-grade AI systems used by multiple teams or products, with organizational impact through technical leadership and mentoring.
  • Deep understanding of LLMs, including transformer architecture, attention, tokenization, positional encodings, and model training and serving.
  • Advanced PyTorch skills, including custom model code, training loops, mixed precision, and distributed training such as FSDP or DeepSpeed.
  • Hands-on experience fine-tuning and post-training open-weight LLMs, including full and parameter-efficient methods such as LoRA and QLoRA, distillation, and preference- or RL-based methods such as DPO and GRPO.
  • Experience with context engineering, including retrieval, memory, and context management for long-running agent workflows, and defining evaluation strategies and benchmarks for LLM and agent systems.
  • Strong knowledge of inference optimization, including prefill and decode, KV-cache management, continuous batching, speculative decoding, quantization, and serving at scale with vLLM, SGLang, or TensorRT-LLM.
  • Strong predictive AI, classical ML, distributed systems, and Python fundamentals, with sound judgment when choosing among approaches based on accuracy, latency, and cost.
  • Ability to lead AI projects or programs of moderate scope and risk, contribute to execution strategy, break goals into milestones, and hold self and others to clear expectations and commitments.
  • Ability to take ownership of complex technical outcomes across teams, proactively manage risks and dependencies, and drive issues to resolution.
  • Strong communication skills and ability to build alignment around engineering decisions with technical and non-technical audiences.
  • Ability to build cross-functional partnerships across Engineering, Product, and other teams.
  • Ability to translate customer needs into scalable AI solutions while balancing customer value, performance, and cost.
  • Commitment to embodying Rapid7’s core values and fostering a culture of excellence, meaningful impact, and collective success.

Nice To Haves

  • A Master’s degree in Computer Science, Machine Learning, AI, or a related field; equivalent practical experience is also accepted.

Responsibilities

  • Lead the design and architecture of LLM and agentic AI systems across Detection and Response and Exposure and Remediation, contributing to the technical roadmap.
  • Recommend model strategies, including whether to use frontier or open-source models and whether to fine-tune, distill, or post-train them.
  • Fine-tune, distill, and post-train open-source LLMs on security data, from data curation through training, evaluation, and deployment.
  • Apply and improve practices for context engineering, inference optimization, and evaluation, balancing model quality, latency, and cost.
  • Establish evaluations as release gates for AI systems being shipped.
  • Lead design reviews and work through complex technical trade-offs.
  • Prototype and build critical model, training, and inference code.
  • Mentor engineers and partner with Product and platform teams to align technical solutions with customer needs.
  • Lead AI projects or programs of moderate scope and risk, contributing to execution strategy, breaking goals into milestones, and establishing clear expectations and commitments.
  • Own complex technical outcomes across teams, manage risks and dependencies, follow through on commitments, and drive issues to resolution.
  • Build cross-functional partnerships to resolve dependencies, align technical approaches, and deliver shared outcomes.
  • Translate customer needs into scalable, commercially viable AI solutions that balance customer value, performance, and development and operating costs.
  • Communicate complex technical concepts and trade-offs to technical and non-technical audiences and build alignment around engineering decisions.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service