Member of Technical Staff — Product

RadixArk•Palo Alto, CA

12h

About The Position

RadixArk is seeking experienced product-focused engineers to build developer-facing products for its inference and training infrastructure. The role partners closely with Product Managers, research scientists, and systems engineers to turn AI infrastructure into performant, reliable, and approachable products for developers and enterprises. The position owns end-to-end product experiences across APIs, SDKs, dashboards, playgrounds, and developer tooling built on SGLang, Miles, and RadixArk’s broader inference and training stack. It combines systems engineering with product craft to help developers discover, evaluate, and integrate RadixArk’s capabilities into their AI workloads. RadixArk is an infrastructure-first company founded by AI infrastructure veterans from xAI and NVIDIA. Its work includes SGLang, an open LLM serving engine, and Miles, a large-scale RL framework. The company’s stated mission is to democratize frontier-level AI infrastructure by building open systems for inference and training.

Requirements

Bachelor’s degree in Computer Science, Computer Engineering, or a relevant technical field, or equivalent practical experience.
At least 5 years of software engineering experience building production systems, or at least 3 years with a PhD in a relevant field.
Strong programming skills in at least one of Python, TypeScript/JavaScript, Go, C++, or Rust.
Demonstrated experience shipping developer-facing or product-facing software end to end, including APIs, SDKs, web applications, or developer tools.
Experience using data and analysis to explain technical problems, prioritize work, and inform design decisions.
Excellent collaboration and communication skills, with a track record of driving complex technical projects across teams.

Nice To Haves

Experience building products on AI/ML infrastructure, model serving systems, or large-scale distributed systems.
Familiarity with LLM inference and training stacks such as SGLang, vLLM, TensorRT-LLM, PyTorch, Megatron, DeepSpeed, or Ray, and the trade-offs involved in serving and training large models.
Experience contributing to or maintaining open-source projects, especially in AI/ML or infrastructure.
Hands-on experience designing developer experiences such as public APIs, SDKs, CLIs, or dashboards where developer ergonomics drive adoption.
Strong product sensibility and comfort making thoughtful UX and API design decisions.
Experience improving quality through code reviews, testing, careful rollout, monitoring, and proactive iteration.
Demonstrated ability to integrate AI tools into engineering workflows to drive measurable efficiency gains or quality improvements.
Experience in B2B, developer-facing, or infrastructure product environments.

Responsibilities

Collaborate with Product, Design, Research, Infrastructure, and Developer Relations to design and ship developer-facing products on RadixArk’s inference and training platforms.
Build and maintain customer-facing APIs, SDKs, CLIs, dashboards, and playgrounds that expose SGLang, Miles, and serving infrastructure through intuitive, well-documented interfaces.
Implement custom user interfaces and developer experiences with modern frontend and backend technologies, emphasizing performance, accessibility, and quality.
Architect efficient, scalable systems that connect low-level infrastructure—including GPU scheduling, model serving, and distributed training—to product surfaces.
Analyze and optimize code for quality, efficiency, and performance, and provide feedback to peers during code reviews.
Own components, features, or systems end to end, from design through rollout, monitoring, and iteration.
Set direction and goals for product engineering initiatives, lead major launches, and provide technical guidance and mentorship to peers and new team members.
Identify and resolve performance, reliability, and scalability issues across the product stack, and drive efforts to reduce technical debt.
Participate in design reviews and technical discussions, evaluating trade-offs among system complexity, developer experience, and time to ship.
Work with Product Managers to translate roadmap priorities into scoped technical deliverables, surface trade-offs, and resolve ambiguity early.
Engage with early adopters, design partners, and the open-source community to understand pain points and iterate on product experiences.
Contribute documentation, code samples, blog posts, and demos to help developers use RadixArk products.
Use data, telemetry, and user feedback to validate hypotheses, measure launch impact, and inform product priorities.