AI Systems Engineer

Glia-Ai • Boston, MA

3d

About The Position

Glia AI is developing Glia, an AI-based systems engineer designed to assist human experts in the design and optimization of next-generation infrastructure. Glia functions as a multi-agent system that emulates the R&D processes of top engineers, enabling faster and more efficient results in system design and optimization. The company was founded by MIT Professors and PhDs, leveraging a decade of research from MIT CSAIL. With $13.5M in funding, Glia AI is expanding its engineering team to meet the demands of the AI era. This role is for an AI Systems Engineer who possesses strong systems knowledge and a passion for AI, viewing AI as a collaborative tool to drive innovation in computer and networked systems. The objective is to fundamentally transform computer systems design and optimization through AI. The successful candidate will contribute to the design, development, and deployment of Glia's initial product versions, working closely with the founders and engineering team to transition deep research into production-ready systems.

Requirements

• Great systems intuition
• Intellectual curiosity
• Strong desire to embrace AI-driven engineering
• Experience with AI inference, distributed serving, model optimization, and related topics.
• Hands-on with vLLM, PyTorch, Triton inference server, Ray Serve, or other inference frameworks
• Experience with GPU optimization, kernel design, CUDA programming, and low-level systems performance engineering
• Strong Python and PyTorch fundamentals
• Comfort in building large-scale, high-performance distributed systems
• PhD or equivalent experience (PhD or equivalent + ~5 years is a good sweet spot)
• Dislike for rigid bureaucratic engineering processes, but appreciation for disciplined engineering rigor.

Responsibilities

• Design, build, and deploy core components of Glia’s AI-driven optimization stack.
• Collaborate with the founders to translate research insights into real, usable systems.
• Own critical pieces of the platform: routing, scheduling, autoscaling, hardware selection, inference engine integrations, and more.
• Build prototypes quickly, validate them, and iterate based on user and customer feedback.
• Help establish technical architecture, coding standards, and best practices for a high-velocity engineering culture.
• Set up development workflows, infrastructure, tooling, and deployment pipelines.
• Evaluate third-party tools/services and make key build vs. buy decisions.
• Document design and development work and help establish the foundation for future engineering hires.

Benefits

• Seed round ($13.5M) closed in September 2025
• Backed by top-tier VC firms (Pillar, E14, and Neotribe)
• Supported by luminaries like Jeff Dean, Ion Stoica, Aparna Chennapragada, Nick McKeown, Srinivas Narayanan, and more.
• Multiple paid PoCs with marquee customers.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Ph.D. or professional degree