Staff Parser/Compiler Research Engineer

dottxt•New York, NY

44d•Remote

About The Position

We are looking for a developer to work on the parsers and compilers at the center of .txt's structured generation technology. .txt builds structured generation by making language models produce output that follows a given format, by deciding at every decoding step which tokens are allowed. This is achieved by compiling a JSON Schema, a regex, a grammar, a list of function definitions, or a policy into that decision, fast enough to run inside the decoding loop. This technology enables .txt to build reliable and safe agents.

Requirements

Professional-level Python proficiency.
Practical experience with lower-level languages (e.g., C/C++, Rust).
Direct experience with parsers (e.g., Earley, LALR(1)), formal grammars, and finite-state machines.
Implementation of efficient data structures.
Capability for research and development in parser and compiler technologies.
Familiarity with the company's relevant technical report and open-source project.
Demonstrated value for simplicity, testing, and automation.
Clear, concise, and consistent written communication skills.

Responsibilities

Design and Develop: Craft high-performance parsers and data structures that integrate with LLMs.
Problem Solving: Research advanced parser and compiler technology and symbolic methods.
Writing Quality Code: Ensure the reliability and efficiency of our methods through rigorous testing and optimization.
Stay Ahead: Learn the latest, relevant LLM advancements.