Software Engineer- AI

Cloudflare • San Francisco, CA

8d

About The Position

We are seeking a highly experienced LLM Developer to join our team. In this role, you will lead the development of our internal AI initiatives, starting with taking ownership of the Cloudflare IT support chatbot. You will be responsible for designing and executing new AI use cases that directly improve employee experience and productivity across the organization. You will leverage Cloudflare’s own ecosystem, including AI Gateway, to build scalable, production-ready AI applications.

Requirements

• 5+ years of experience in software development, with a strong focus on AI, Machine Learning, or Agentic applications.
• Proven experience in the development and deployment of AI applications at scale in a production environment with focus on strong authorization and data privacy.
• Familiarity with Cloudflare AI Gateway and experience managing API traffic for LLMs.
• Strong proficiency in TypeScript and experience with relevant AI/ML libraries and frameworks (e.g., PyTorch, TensorFlow, LangChain).
• Experience with observability and configuration management, Infrastructure as Code (Terraform), and CI/CD pipelines (GitLab/GitHub), Grafana, OTEL, K8s etc.
• Experience and expertise in Agile methodology.
• Excellent interpersonal and communication skills in written and spoken English.

Nice To Haves

• Prior experience working on enterprise engineering teams or building internal developer tools is a plus.

Responsibilities

• Take ownership of the development and maintenance of the internally built Cloudflare IT support chatbot, ensuring high availability and continuous improvement of response quality.
• Identify, design, and build new AI-driven use cases and tools to enhance employee productivity and streamline internal workflows.
• Develop and deploy AI applications at scale, ensuring reliability, performance, and security.
• Integrate and optimize AI applications using Cloudflare’s AI Gateway to manage and monitor model usage effectively.
• Partner closely with internal teams to understand their pain points and translate them into technical AI solutions.
• Stay up-to-date with the latest advancements in LLMs and Generative AI to continuously innovate our internal toolset.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed