LLM Security Evaluation Expert

SilverEdge Government Solutions • Columbia, MD

10h

About The Position

SilverEdge Government Solutions is seeking a highly skilled LLM Security Evaluation Expert to join our team. In this role, you will be responsible for rigorously testing the security and integrity of Large Language Models (LLMs). Your primary focus will be on designing and executing sophisticated adversarial prompt attacks to identify potential vulnerabilities, assess the model's resistance to exploitation, and ensure it maintains consistent, secure behavior. This is a critical role in safeguarding our AI systems and ensuring they operate responsibly.SilverEdge Government Solutions was founded on the belief that nurturing talent and collaborating closely with our customers enables us to think big and deliver the best for our country. Our mission is to bring top technology talent together to solve the world’s most challenging problems while protecting the United States and our allies.SilverEdge Government Solutions, LLC is an Equal Opportunity Employer and applicants receive lawful consideration for employment without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, disability, or protected veteran status.

Requirements

• TS/SCI with Polygraph level Clearance
• Strong knowledge of how LLMs work, including their architecture, training processes, capabilities, and inherent limitations.
• Familiarity with prominent LLM families (e.g., GPT series, Claude, Llama, PaLM) and their common characteristics.
• Proven experience in crafting and refining prompts to elicit specific behaviors or bypass restrictions in LLMs.
• Demonstrable understanding of techniques like jailbreaking, prompt injection, role-playing attacks, and exploiting model biases.
• Strong understanding of cybersecurity principles and common attack vectors, particularly as they apply to AI/ML systems.
• Ability to think like an attacker and anticipate potential exploits.
• Excellent ability to analyze complex systems, identify subtle vulnerabilities, and systematically test hypotheses.
• Clear and concise written and verbal communication skills, with the ability to document technical findings thoroughly.
• Understanding of the ethical implications of AI security and commitment to responsible testing practices.

Responsibilities

• Rigorously testing the security and integrity of Large Language Models (LLMs)
• Designing and executing sophisticated adversarial prompt attacks to identify potential vulnerabilities
• Assess the model's resistance to exploitation
• Ensure it maintains consistent, secure behavior

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed
• Number of Employees: 251-500 employees