Principal AI Engineer

Rapid7•Remote - California, CA
•$221,000 - $299,000•Remote

About The Position

Rapid7 is expanding its AI Engineering capabilities and is seeking a Principal AI Engineer to define and influence the technical direction of LLM and agentic AI systems. The role combines hands-on engineering with technical leadership, mentoring, and influence over product and platform investments. The engineer will build greenfield solutions and help scale AI across the organization to deliver impact for global customers. Rapid7's AI Engineering team takes models from research to production, combining open-source and frontier LLMs, AI agents, predictive models, and the company's security expertise. Its work supports Detection and Response use cases such as alert triage, threat investigation, and automated response, as well as Exposure and Remediation use cases such as vulnerability prioritization, attack surface risk assessment, and guided remediation. The Principal AI Engineer will set technical direction for building, tuning, and serving LLMs and agentic systems across security products. The role requires deep understanding of LLMs from transformer internals and training through fine-tuning and inference optimization, along with sound judgment about when to use LLMs, predictive AI, or classical machine learning. The engineer will lead architecture and model strategy, develop and optimize models and inference systems, establish evaluation and engineering standards, resolve complex technical trade-offs, and mentor Staff and Senior engineers.

Requirements

  • 12+ years of software or ML engineering experience, including 2+ years building production LLM or agentic AI systems.
  • A track record of building scalable, production-grade AI systems used across multiple teams or products, with organization-wide impact through technical leadership, mentoring, and shared platforms and standards.
  • Deep understanding of transformer architecture, attention, tokenization, positional encodings, and model training and serving, with the ability to implement core components from scratch.
  • Expert-level PyTorch skills, including custom model code, training loops, mixed precision, and distributed training such as FSDP or DeepSpeed.
  • Hands-on experience with full and parameter-efficient fine-tuning (LoRA, QLoRA) of open-weight LLMs, distillation, and preference- or RL-based methods such as DPO or GRPO.
  • Knowledge of retrieval, memory, and context management for long-running agent workflows.
  • Deep knowledge of inference optimization, including prefill and decode, KV-cache management, continuous batching, speculative decoding, FlashAttention, quantization, and serving at scale with vLLM, SGLang, or TensorRT-LLM.
  • Experience defining evaluation strategies and benchmarks for LLM and agent systems.
  • Strong predictive AI and classical ML fundamentals, with judgment to select approaches based on accuracy, latency, and cost.
  • Strong distributed systems and Python fundamentals.
  • Ability to take ownership of significant technical outcomes across multiple teams, identify and address risks, drive complex challenges to resolution, and deliver against agreed technical and customer objectives.
  • Strong communication skills, including the ability to explain technical trade-offs to engineering, product, and leadership audiences.
  • Ability to build cross-functional partnerships across Engineering, Product, and other teams to align technical direction and deliver shared outcomes.
  • Ability to connect customer needs and business priorities to technical decisions and evaluate the value, cost, and trade-offs of AI solutions.
  • Commitment to embodying Rapid7's core values and fostering a culture of excellence, impact, and collective success.

Nice To Haves

  • A PhD in Computer Science, Machine Learning, AI, or a related field, or equivalent depth of expertise demonstrated through industry experience and technical contributions.
  • Experience pre-training or training LLMs from scratch.
  • Experience writing GPU kernels using CUDA or Triton and profiling GPU workloads.
  • Security domain experience, such as detection engineering, SOC/MDR, or vulnerability management.
  • Experience running AI workloads on AWS at scale.
  • Publications, patents, or open-source contributions in AI.

Responsibilities

  • Define architecture and the technical roadmap for LLM and agentic AI systems across Detection and Response and Exposure and Remediation.
  • Lead model strategy, including decisions about frontier and open-source models and when to fine-tune, distill, or post-train.
  • Fine-tune, distill, and post-train open-source LLMs on security data, from data curation through training, evaluation, and deployment.
  • Set engineering standards for context engineering, inference optimization, and evaluation across teams.
  • Optimize LLM inference at scale, balancing quality, latency, and cost using techniques such as speculative decoding, KV-cache management, continuous batching, quantization, and custom kernels.
  • Establish evaluations as the release gate for every AI system shipped.
  • Lead design reviews and resolve the hardest technical trade-offs.
  • Remain hands-on by prototyping and building critical model, training, and inference code.
  • Mentor Staff and Senior engineers and shape product and platform investment.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service