AI Researcher

Precision Solutions • Fort Meade, MD

45d • Onsite

About The Position

The AI Researchers provide the technical and analytical foundation for the work. They conduct applied research, define and refine research questions, and perform literature reviews to survey and assess existing methods and emerging approaches. They own experimental design end to end, running experiments, evaluating candidate approaches, and producing publication-quality analysis of the results. They document findings in a form usable by both technical and non-technical stakeholders, contributing to technical reports, evaluation plans, and model and agent assessments. A core part of their role is translating research outcomes into concrete implementation guidance, turning findings and recommendations into direction that the Developers and the broader team can act on. Working closely with the Data Scientists, they shape benchmark design, scoring rationale, and the interpretation of evaluation results so that measured outcomes connect back to the original research objectives.

Requirements

• Experience with Applied AI/ML Research, Experimental Design, State-of-the-Art (SOTA) Literature Reviews, Statistical Analysis
• Familiar with conducting Model & Agentic System Capability Assessments, Evaluation Plan Development, Risk & Limitation Analysis
• Experience with Python, Jupyter Notebooks, Scientific Computing Libraries (e.g., NumPy, Pandas, SciPy), Git Version Control
• Comfortable with Technical Writing, Decision-Support Documentation, Executive Reporting, Jira, Confluence
• BS in Computer Science or similar technical field (4 years of relevant experience may be substituted in lieu of a BS degree)
• Active TS/SCI w/FS Poly clearance is required. Please note that the FS Poly currently needs to be held by the NSA or within the past two years.

Nice To Haves

• Python
• Jupyter notebooks
• Scientific computing libraries
• Machine learning / AI evaluation methods
• Experiment design
• Literature review tools
• Statistical analysis
• Technical writing
• Version control, such as Git
• Collaboration tools such as Jira or Confluence
• Operate effectively in an airgapped/constrained environment

Responsibilities

• Develop evaluation methodologies and experimental designs for assessing model and agent performance, including capability, reliability, and limitation analyses.
• Conduct reviews of current state-of-the-art AI/ML evaluation methods and emerging techniques to inform approach selection.
• Define and document evaluation criteria, success metrics, and assessment rationale in partnership with the Data Scientists.
• Assess candidate models and agentic systems and produce written technical findings and recommendations.
• Author technical reports, evaluation plans, and decision-support documentation for stakeholders.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior