Principal AI Engineer

Rapid7•San Francisco, CA

About The Position

Rapid7 is expanding its AI Engineering capabilities to build the next generation of AI for its cybersecurity platform. The Principal AI Engineer will define and influence the technical direction of LLM and agentic AI systems, raise engineering standards, and build greenfield solutions for global customers. The role combines technical leadership and hands-on engineering, shaping product and platform investments and influencing how AI is built and scaled across the organization. Rapid7’s AI Engineering team includes AI engineers and applied scientists who take models from research into production. The team combines open-source and frontier LLMs, AI agents, predictive models, and Rapid7’s security expertise to support Detection and Response use cases such as alert triage, threat investigation, and automated response, as well as Exposure and Remediation use cases such as vulnerability prioritization, attack surface risk assessment, and guided remediation. The Principal AI Engineer will set technical direction for building, tuning, and serving LLMs and agentic systems across security products. The role requires deep knowledge of LLMs, from transformer internals and training through fine-tuning and inference optimization, while applying predictive AI and classical machine learning where they are the best fit. The position is expected to remain hands-on with challenging model, training, and inference problems, lead technical reviews, establish evaluation practices, mentor engineers, and guide technical investment.

Requirements

  • 12 or more years of software or machine learning engineering experience, including at least 2 years building production LLM or agentic AI systems.
  • Track record of building scalable, production-grade AI systems used across multiple teams or products.
  • Strong history of organization-wide impact through technical leadership, mentoring, and shared platforms and standards.
  • Deep understanding of transformer architecture, attention, tokenization, positional encodings, and model training and serving, with the ability to implement core components from scratch.
  • Expert-level PyTorch skills, including custom model code, training loops, mixed precision, and distributed training such as FSDP or DeepSpeed.
  • Hands-on experience with full and parameter-efficient fine-tuning of open-weight LLMs, including LoRA and QLoRA, as well as distillation and preference- or reinforcement-learning-based methods such as DPO and GRPO.
  • Knowledge of context engineering, including retrieval, memory, and context management for long-running agent workflows.
  • Deep knowledge of inference optimization, including prefill and decode, KV-cache management, continuous batching, speculative decoding, FlashAttention, quantization, and serving at scale with tools such as vLLM, SGLang, or TensorRT-LLM.
  • Experience defining evaluation strategies and benchmarks for LLM and agent systems.
  • Strong predictive AI and classical machine learning fundamentals, with judgment to select approaches based on accuracy, latency, and cost.
  • Strong distributed systems and Python fundamentals.
  • Strong communication skills and ability to explain technical trade-offs to engineering, product, and leadership audiences.
  • Ability to build cross-functional partnerships and align stakeholders on technical direction and shared outcomes.
  • Ability to connect customer needs and business priorities to technical decisions and measurable outcomes.
  • Commitment to Rapid7’s core values and to fostering a culture of excellence, meaningful impact, and collective success.

Nice To Haves

  • PhD in Computer Science, Machine Learning, AI, or a related field, or equivalent depth of expertise demonstrated through industry experience and technical contributions.
  • Experience pre-training or training LLMs from scratch.
  • Experience writing GPU kernels in CUDA or Triton and profiling GPU workloads.
  • Security domain experience, such as detection engineering, SOC/MDR, or vulnerability management.
  • Experience running AI workloads on AWS at scale.
  • Publications, patents, or open-source contributions in AI.

Responsibilities

  • Define architecture and the technical roadmap for LLM and agentic AI systems across Detection and Response and Exposure and Remediation.
  • Lead model strategy, including decisions about frontier versus open-source models and when to fine-tune, distill, or post-train.
  • Fine-tune, distill, and post-train open-source LLMs on security data, from data curation through training, evaluation, and deployment.
  • Set engineering standards for context engineering, inference optimization, and evaluation across teams.
  • Optimize LLM inference at scale using techniques such as speculative decoding, KV-cache management, continuous batching, quantization, and custom kernels, balancing quality, latency, and cost.
  • Establish evaluations as the release gate for every AI system shipped.
  • Lead design reviews and resolve the most challenging technical trade-offs.
  • Prototype and build critical model, training, and inference code hands-on.
  • Mentor Staff and Senior engineers and shape product and platform investment.
  • Own significant technical outcomes across multiple teams, identify and address risks, resolve complex challenges, and ensure solutions meet agreed technical and customer objectives.
  • Explain technical trade-offs to engineering, product, and leadership audiences.
  • Build cross-functional partnerships across Engineering, Product, and other teams to align on technical direction and shared outcomes.
  • Connect customer needs and business priorities to technical decisions and assess the value, cost, and trade-offs of AI solutions.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service