Staff Software Engineer, Managed AI - AI Platform

Crusoe•San Francisco, CA

3d•Onsite

About The Position

Crusoe's mission is to accelerate the abundance of energy and intelligence. We’re crafting the engine that powers a world where people can create ambitiously with AI — without sacrificing scale, speed, or sustainability. Be a part of the AI revolution with sustainable technology at Crusoe. Here, you'll drive meaningful innovation, make a tangible impact, and join a team that’s setting the pace for responsible, transformative cloud infrastructure. About This Role: The Crusoe Cloud Managed AI team seeks an ambitious and experienced Staff Software Engineer to join their team. You'll have a pivotal role in shaping the architecture and scalability of our next-generation managed AI services. You will lead the design and implementation of core systems for our AI offerings, including resilient fault-tolerant queues, model catalogs, and scheduling mechanisms optimized for cost and performance. This role offers the opportunity to build and scale critical infrastructure capable of handling millions of API requests per second across thousands of customers. The team is working on building the next chapter of products to accelerate the process of adding intelligence into software. This is an on-site role based in San Francisco, CA, or Sunnyvale, CA, requiring in-office presence.

Requirements

Strong Engineering Fundamentals: Advanced degree in Computer Science/Engineering
8-10+ years of industry experience with demonstrated history of consistent success leading a varied portfolio of initiatives across your function
Experience with distributed systems, cloud services (compute, storage, networking, database), and delivering early-stage projects quickly.
AI/ML Expertise: Experience with Generative AI (LLMs, Multimodal) and familiar with AI infrastructure (training, inference, ETL pipelines).
Software Engineering: Proficient with container runtimes (e.g., Kubernetes), microservices, REST APIs, gRPC, and the full software development lifecycle including CI/CD.

Nice To Haves

Proficiency in Golang, Python or Rust for production services.
Contributions to open-source AI projects (e.g., VLLM).
Experience with performance optimizations on GPU systems and inference frameworks.
Personal Attributes:
Proactive, collaborative, and capable of working autonomously.
Excellent communication and interpersonal skills.
Passion for building cutting-edge AI products and solving complex technical problems

Responsibilities

Design and Development:
Lead the design and implementation of core AI services, including:
Resilient fault-tolerant queues for efficient task distribution.
Model catalogs for managing and versioning AI models.
Scheduling mechanisms optimized for cost and performance.
Scalability and Reliability:
Deep understanding of Kubernetes or other distributed cluster orchestration systems.
Architect and scale infrastructure to handle millions of API requests per second.
Implement robust monitoring and alerting to ensure system health and 24/7 availability.
Collaboration and Innovation:
Collaborate closely with product management, business strategy, and other engineering teams to define the AI platform roadmap.
Influence the long-term vision and architectural decisions of the platform.
Contribute to open-source AI frameworks and actively participate in the AI community.
Prototype and rapidly iterate on emerging technologies and new features.

Benefits

Industry competitive pay
Restricted Stock Units in a fast growing, well-funded technology company
Health insurance package options that include HDHP and PPO, vision, and dental for you and your dependents
Employer contributions to HSA accounts
Paid Parental Leave
Paid life insurance, short-term and long-term disability
Teladoc
401(k) with a 100% match up to 4% of salary
Generous paid time off and holiday schedule
Cell phone reimbursement
Tuition reimbursement
Subscription to the Calm app
MetLife Legal
Company paid commuter benefit; $300/month