AI Research Engineer - NLP

UL Research Institutes•Evanston, IL

5d•Remote

About The Position

We have an exciting opportunity for a n AI Research Engineer at UL Research Institutes , within our Digital Safety Research Institute (DSRI) . Th is is a REMOTE opportunity The AI Research Engineer advances Digital Safety mission by designing, developing, and evaluating advanced artificial intelligence (AI) safety assessment systems, with a focus on large language models (LLMs), natural language processing (NLP) safety. This role contributes to the development of rigorous evaluation methodologies, scalable assessment capabilities, and research-driven insights that improve the safety assessments of frontier AI systems. UL Research Institutes: At UL Research Institutes (ULRI) , we expand the boundaries of safety science to create a more secure and sustainable world. For more than a century, we have studied the unintended consequences of innovation, designed solutions to mitigate risk and shared our findings with academia, scientists, manufacturers, and policymakers across industries. We identify critical safety and sustainability issues, asking tough questions because we believe a safer world begins with knowledge. Build a safer, more secure, and sustainable future with us. Join us and work with our Fire Safety team s who conduct the research to produce that knowledge and put it into practice. Digital Safety Research Institute: The Digital Safety Research Institute (DSRI) addresses unresolved safety risks and emerging dangers in the world’s digital ecosystem. We aim to help protect people from unwanted access to personal devices and privacy, algorithms , and disinformation threats by working to create a new digital safety ecosystem. DSRI is committed to sharing digital safety insights, collaborating with key stakeholders, and offering extensive outreach and education to help support safer digital environments for people everywhere.

Requirements

Ph.D. in computer science or related field, focused on NLP or LLMs.
3 years of relevant experience, post Ph.D.

Nice To Haves

Demonstrates mastery level knowledge of NLP and LLM safety and how safety assessments can protect the public from LLM harms.
Solves AI assessment research challenges independently and efficiently.
Engages software engineering teams who build tools to help DSRI researchers scale their assessments to perform rapidly at scale
Looks ahead to needed research and development next steps, for better analytics to assess LLM or NLP outputs.
Begins developing relationships within the broader safety community

Responsibilities

Studies incident reports implicating LLMs or NLP algorithms and hypothesize root causes.
Conducts literature and open-source reviews in NLP or LLM
Designs, plans, and creates NLP or LLMs assessments - expanding digital safety best practices.
Applies technical, diagnostic, and troubleshooting skills.
Codes or trains text analytics needed to run NLP or LLM assessments.
Prepares written component documentation for technical audiences.
Publishes assessment research results, on-line, using Digital Safety lab tools, and in peer-reviewed conferences and journals.
Works closely with team members to ensure that all processes are accurate and technically sound.