About The Position

CoreWeave is hiring a Senior Deployment Engineer focused on LLM inference and optimization. The role combines hands-on AI engineering, model optimization, and customer-facing technical work. You will work directly with customers to bring AI models and applications into production, improve performance, and integrate solutions with enterprise systems. You will own technical delivery from discovery and benchmarking through deployment and adoption, collaborating with customer stakeholders and CoreWeave product and engineering teams. The work includes coding, model experimentation, performance troubleshooting, and helping customers improve model quality, latency, throughput, and cost. Success means deploying AI solutions that meet agreed quality and performance targets, delivering measurable gains in latency, throughput, GPU utilization, and cost while maintaining model quality. Customers should understand the tradeoffs, trust your technical guidance, and be able to operate the delivered solutions. Your findings and tools should also make future deployments faster and more effective.

Requirements

  • At least 5 years of experience in software engineering, ML engineering, AI infrastructure, or a related hands-on technical role.
  • Strong Python programming skills and experience with PyTorch, Hugging Face Transformers, or comparable tools.
  • Hands-on experience deploying and optimizing AI models in production, particularly large language models.
  • Experience with model-serving frameworks such as vLLM, SGLang, TensorRT-LLM, or similar technologies.
  • Understanding of GPU memory constraints, numerical precision, batching, caching, and parallelism, including their effects on inference performance.
  • Experience building evaluations and benchmarks to measure model quality, latency, throughput, and resource efficiency.
  • Experience developing APIs and integrating model endpoints with production applications and customer data systems.
  • Familiarity with GPU-based cloud environments, containers, and monitoring tools used to operate model deployments.
  • Ability to work directly with customers, communicate technical tradeoffs clearly, and translate business requirements into measurable engineering targets.
  • Strong ownership and troubleshooting skills, including the ability to turn an ambiguous problem into a tested solution.

Nice To Haves

  • Experience with parameter-efficient fine-tuning techniques such as LoRA or QLoRA.
  • Experience with speculative decoding, multi-GPU inference, or distributed model serving.
  • Experience profiling GPU workloads using CUDA, NVIDIA Nsight, or related tools.
  • Experience optimizing embedding models, rerankers, vision models, or multimodal systems.
  • Experience improving retrieval quality and evaluating end-to-end RAG applications.
  • Contributions to open-source model-serving, optimization, or evaluation projects.
  • Experience delivering enterprise AI implementations or customer-facing technical engagements.

Responsibilities

  • Lead technical discovery to define customer use cases, workloads, infrastructure constraints, and targets for model quality, latency, throughput, and cost.
  • Optimize inference using techniques such as quantization, batching, prefix caching, KV-cache optimization, and parallelism while preserving output quality.
  • Adapt models to customer needs using prompt optimization, retrieval-augmented generation, and fine-tuning where appropriate, and evaluate the impact of each approach.
  • Troubleshoot issues across model execution, GPU utilization, memory consumption, serving infrastructure, and application behavior.
  • Lead technical customer engagements, including workshops, benchmark presentations, explanations of tradeoffs, and guidance on deployment and optimization decisions.
  • Create reusable evaluation tools, benchmark harnesses, deployment configurations, and runbooks.
  • Share recurring customer needs and performance findings with product and engineering teams.

Benefits

  • Medical, dental, and vision insurance, 100% paid for by CoreWeave for US-based full-time employees.
  • Company-paid life insurance.
  • Voluntary supplemental life insurance.
  • Short- and long-term disability insurance.
  • Flexible Spending Account.
  • Health Savings Account.
  • Tuition reimbursement.
  • Ability to participate in the Employee Stock Purchase Program (ESPP).
  • Mental wellness benefits through Spring Health.
  • Family-forming support through Carrot.
  • Paid parental leave.
  • Flexible, full-service childcare support with Kinside.
  • 401(k) with a generous employer match.
  • Flexible PTO.
  • Catered lunch each day at office and data center locations.
  • Casual work environment.
  • Work culture focused on innovative disruption.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service