Staff Rust Developer

dottxt•New York, NY

3d•Remote

About The Position

The Role .txt builds structured generation: we make language models produce output that follows a given format, by deciding at every decoding step which tokens are allowed. We compile a JSON Schema, a regex, a grammar, a list of function definitions or a policy into that decision, fast enough to run inside the decoding loop. This is how .txt builds reliable and safe agents. We're looking for a Rust developer to own the part of it that has to be fast: the automata, indexes and parsers that run at every decoding step. You'd turn what the rest of the team writes into production-ready Rust, with the Python bindings and C++/CUDA glue to put it inside an inference engine, and the benchmarks to prove it stays fast.

Requirements

Proven Rust Experience: Demonstrated ability to lead and contribute to sophisticated, collaborative Rust projects.
Professional Development Skills: A track record of developing well-tested, high-performance software.
Tooling Expertise: Expertise with code profiling and debugging. Experience with automated workflows in CI.
Multi-language Proficiency: Ability to learn and/or work with the following technologies: CUDA, C/C++, Rust/Python bindings.
A Collaborative Mindset: Excellent communication skills and a proactive approach, ideally suited for an early-stage startup culture.

Responsibilities

Initiate and drive the development of mission-critical Rust projects from conception through deployment.
Write and optimize parsing code with a strong emphasis on performance, supported by automated benchmarking.
Design, implement, and readily debug formal grammars, efficient parsers, standard and non-standard automata, and general text-based indexing/search.
Work with other teams to integration their work into production-ready Rust.
Utilize advanced profiling, debugging, and continuous integration tools to maintain and enhance code quality in non-trivial and consistent ways.