Staff Rust Developer

dottxt•New York, NY

4d•$160,000 - $210,000•Remote

About The Position

We are seeking a Rust developer to own the performance-critical components of our structured generation technology. This involves developing and optimizing automata, indexes, and parsers that operate at every decoding step. You will translate designs into production-ready Rust code, create Python bindings and C++/CUDA glue for integration into inference engines, and establish benchmarks to ensure high performance. Our technology enables language models to produce output that adheres to specific formats by controlling token selection during decoding, ensuring reliability and safety in agents.

Requirements

Proven Rust Experience: Demonstrated ability to lead and contribute to sophisticated, collaborative Rust projects.
Professional Development Skills: A track record of developing well-tested, high-performance software.
Tooling Expertise: Expertise with code profiling and debugging. Experience with automated workflows in CI.
Multi-language Proficiency: Ability to learn and/or work with CUDA, C/C++, Rust/Python bindings.
A Collaborative Mindset: Excellent communication skills and a proactive approach, ideally suited for an early-stage startup culture.

Responsibilities

Initiate and drive the development of mission-critical Rust projects from conception through deployment.
Write and optimize parsing code with a strong emphasis on performance, supported by automated benchmarking.
Design, implement, and debug formal grammars, efficient parsers, standard and non-standard automata, and general text-based indexing/search.
Work with other teams to integrate their work into production-ready Rust.
Utilize advanced profiling, debugging, and continuous integration tools to maintain and enhance code quality.