RANDposted about 1 month ago
$137,000 - $246,600/Yr
Full-time • Senior
Boston, MA

About the position

RAND's Meselson Center, part of the Global and Emerging Risks (GER) division, is seeking an accomplished technical leader to drive our ambitious AI cyber evaluation agenda. As Research Lead - AI Cyber Testing & Evaluation, you'll direct a comprehensive research portfolio focused on assessing the offensive cyber capabilities of frontier AI models. You will be responsible for managing significant research budgets and personnel, overseeing complex technical research and policy analysis projects, and leading multidisciplinary teams of policy researchers, engineers, and scientists. Your team will build systems to evaluate how AI models perform across the full attack lifecycle, including resource development, initial access, discovery, lateral movement, and defense evasion. Your projects may include developing benchmarks for fully autonomous operations using scaffolding and tools, as well as uplift of both novice and expert humans. Such benchmarks may involve environments like CTF challenges, frameworks for assessing ability to reason over attack graphs and conduct multi-stage operations, assessment of stealth and defense evasion capabilities, and benchmarks for ability to conduct time-sensitive operations at machine speed. Many of your evaluations will be commissioned directly by relevant government agencies, and the results of your evaluations will drive responsible AI policy across the world. Your team will communicate findings through detailed technical analyses, evaluation frameworks, and quick-turnaround policy briefs. Your work will shape recommendations for the White House, regulatory agencies, the intelligence community, other national governments, and industry leaders. This position is structured as a focused two-year appointment to create the urgency needed to drive ambitious change in this rapidly evolving field. Every day of your tenure will count toward achieving ambitious projects in AI security. The appointment may be renewed for an additional year, with options for longer-term employment at RAND thereafter. RAND's reputation for excellence is built on our commitment to high-quality, rigorous analysis and objectivity. As a Research Lead - AI Cyber Testing & Evaluation, you'll have access to RAND's leading researchers, extensive government and industry connections, and world-class analytical resources.

Responsibilities

  • Direct a comprehensive research portfolio focused on assessing offensive cyber capabilities of frontier AI models.
  • Manage significant research budgets and personnel.
  • Oversee complex technical research and policy analysis projects.
  • Lead multidisciplinary teams of policy researchers, engineers, and scientists.
  • Build systems to evaluate AI model performance across the full attack lifecycle.
  • Develop benchmarks for fully autonomous operations.
  • Communicate findings through detailed technical analyses and quick-turnaround policy briefs.
  • Shape recommendations for government and industry leaders.

Requirements

  • 6+ years of technical experience in security engineering, software engineering, firmware engineering, hardware engineering, or related fields.
  • 6+ years of technical management experience, including leading cross-functional teams and managing project budgets.
  • Demonstrated ability to successfully lead complex projects to completion.
  • Proficiency in Python, Java, C/C++, or other popular programming languages.
  • Experience with red team operations or offensive cyber capabilities development.
  • Ability to develop rigorous and comprehensive threat models and identify potential system vulnerabilities.
  • Strong ability to communicate effectively in English, both verbally and in writing.
  • Ability to work effectively in a collaborative, multidisciplinary environment.
  • Fluency with MS Office suite.

Nice-to-haves

  • Graduate of the Computer Network Operations Development Program (CNODP), Remote Interactive Operator Training (RIOT), Future Operator Readiness Growth and Enrichment (FORGE), or equivalent experience.
  • Understanding of advanced persistent threat (APT) tactics, techniques, and procedures (TTPs) and experience with defending against them.
  • Ability to think creatively about offensive and/or defensive techniques and strategies, beyond compliance with existing regulations.
  • Experience working on AI research, ML model training, or model deployment.

Benefits

  • Health insurance coverage.
  • Life and disability insurance.
  • Savings plan.
  • Paid time-off.
  • Sabbatical pay.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service