Inco AI is seeking founding members to build systems that serve frontier models at scale, including kernels, runtimes, batching, KV cache, load balancing, and scheduling. The role focuses on improving inference latency, throughput, and cost per token across the serving stack, with deeper work in runtimes, kernels, quantization, or speculative decoding when that offers the highest leverage. As a founding engineer, you will own outcomes end to end and take work from first principles and prototype through production serving. The team is flat, and the role offers the opportunity to help establish the next standard in AI inference infrastructure. Inco AI builds an agent-native inference platform intended to make advanced AI fast enough for real workflows and affordable to use at scale. The company describes its team as researchers and engineers behind AWQ, DFlash, and TensorRT-LLM. Its platform ranked first in output speed on Artificial Analysis for every model it launched with, and its DFlash models have surpassed 10 million downloads on Hugging Face. The company serves customers across serverless, dedicated, and local AI deployments and is backed by B Capital, E14 Fund, and Tectonic Ventures.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Entry Level
Education Level
No Education Listed