About The Position

The LLM as a Service team is looking for a Lead AI/DevOps Engineer to drive our customer experience strategy forward by consistently innovating and problem-solving. The ideal candidate is passionate about the customer experience journey, highly motivated, intellectually curious, analytical, and possesses an entrepreneurial mindset.

Requirements

  • Proficient in DevOps tools such as Splunk, Dynatrace, Grafana, Prometheus, OpenShift Kubernetes, Docker, and Helm.
  • Strong hands-on experience with Python; GoLang is a plus.
  • Customer-focused mindset with a commitment to delivering simple, valuable solutions.
  • Driven by a clear mission to prioritize customer needs.
  • Continuously monitor market trends and competitors to inform strategy.
  • Proactively engage with customers to understand their challenges and identify impactful solutions.
  • Seek complementary products or services to enhance customer outcomes.
  • Identify resource gaps and propose sustainable, team-benefiting solutions.
  • Communicate technical concepts clearly and concisely.
  • Confident and precise communicator, capable of articulating vision and strategy to diverse stakeholders.
  • Solution-oriented approach to problem-solving.

Responsibilities

  • Lead DevOps initiatives in on-prem environments.
  • Design, deploy, and manage scalable AI infrastructure using Kubernetes for reliable orchestration of large language models and related services.
  • Develop proof-of-concept solutions for advanced AI use cases, including model context protocols (MCPs), LLMs, retrieval-augmented generation (RAG), and agentic workflows.
  • Partner with security and governance teams to ensure AI solutions comply with enterprise policies, regulatory standards, and privacy best practices.
  • Collaborate with infrastructure and platform teams to optimize cloud resources for scalable, efficient, and cost-effective AI workloads.
  • Work directly with customer teams to gather requirements, deliver innovative solutions, and provide ongoing technical support throughout the AI product lifecycle.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service