Staff / Principal Engineer, Technical Mitigations Research

Lila Sciences•Cambridge, MA

2d•$224,000 - $336,000

About The Position

We're building a talent-dense, high-agency AI safety team at Lila that will engage all core teams within the organization (science, model training, lab integration, etc.), to prepare for risks from scientific superintelligence. The initial focus of this team will be to build and implement a bespoke safety strategy for Lila, tailored to its specific goals and deployment strategies. This will involve technical safety strategy development, broader ecosystem engagement, safety-focused evaluations, safety systems to mitigate risks, and a safety research agenda that explores longer-term needs such as oversight of superintelligent scientific systems. We’re seeking a Technical Mitigations Lead, to lead the build out of safety systems at Lila for the safe deployment of our scientific capabilities to the world. Given the novelty of Lila’s workflows, integrating frontier-class language models with narrow scientific tools and lab-based automation, this role will require the design and deployment of technical safeguards beyond the current state-of-the-art. We expect the person in this role to start off the initial mitigations build-out, and then slowly build a team to support this function.

Requirements

Track record of building safety systems, classifiers, or conducting post-training for frontier-class problems - science, reasoning, programming, etc.
4-6+ years working in technically engineering with ML systems.
Experience building scalable, production systems, not just prototypes.
Demonstrated ability to set research directions for open problems in post-training, classifier buildouts, and other relevant systems.
Ability to communicate complex technical concepts and concerns to non-expert audiences effectively.

Nice To Haves

Experience in developing or applying ML to biological or physical sciences
Experience in building safeguards for scientific risks for frontier models / narrow scientific tools.
Demonstrated ability to lead teams towards engineering goals

Responsibilities

Set the build and research strategy for Lila’s safety systems, across scientific data analysis and generation pipelines, safety post-training, refusal classifiers, automated safety-testing / red-teaming systems, and monitoring systems.
Conduct initial safeguards experimentation and buildout for Lila’s specific scientific needs, and subsequently lead a small team to execute on the build and research agenda
Lead safety systems research to iterate Lila’s systems beyond the state of the art, given the needs of technical safeguards for both in silico and lab-based scientific workflows.
Partner closely with Other members of the safety team, such as domain-specific experts (bio, chem, materials) and eval buildout teams, and Non-safety teams, such as core AI, lab automation, and product teams,
Contributing to broader, high-quality research efforts - as and when needed - for scientific capability evaluation and restriction.
Contribute to external communications on Lila’s safety efforts.