Machine Learning - Software Engineer - Python, Mongo, Jupyter

Erias Ventures•Annapolis Junction, MD

19h

About The Position

We're seeking a Software Engineer to bridge the critical gap between cutting-edge ML research and production-ready solutions. You'll transform research prototypes into robust, deployable systems that end users can confidently put into production. This role uniquely combines software engineering, DevOps practices, and ML solution delivery.

Requirements

Seven (7) years' experience as a SWE in programs and contracts of similar scope, type, and complexity is required.
Bachelor’s degree in Computer Science or related discipline from an accredited college or university is required.
Four additional (4) years of SWE experience on projects with similar software processes may be substituted for a bachelor’s degree.
A current Top-Secret/SCI with polygraph security clearance is required.
InspectAI
Python
MongoDB
Jupyter notebooks
Data visualization tools
Statistical analysis
Data cleaning and validation
Cloud or containerized environments
Git-based version control
Collaboration tools such as Jira or Confluence
Experience operating in airgapped or constrained environments

Responsibilities

Design, implement, and maintain benchmark suites that measure model performance against defined evaluation criteria, including dataset curation, scoring, and results reporting.
Develop benchmarks and test scenarios that evaluate agentic workflows and multi-step task performance, including tool-use, task completion, and reliability metrics.
Curate, validate, and version evaluation datasets and test scenarios, including any adversarial or edge-case sets needed to stress agent behavior.
Produce scoring frameworks, visualizations, and written analyses that translate raw evaluation results into actionable findings for stakeholders.

Benefits

Above Market Hourly Pay
11% Roth or Traditional 401k with Immediate Vesting and Deposit
Spot Bonuses for Assisting with Business Development and Company Growth
Professional Development Bonuses for Certificates and Degrees
Company subsidized Medical Coverage
100% Company Paid Vision and Dental Coverage
100% Company Paid Long Term Disability , Short Term Disability , and Group Life Insurance
Monthly Wellness Reimbursement
Paid Time Off with Flexible Work Schedules and Birthday Off
Amazon Prime Membership and Monthly Internet Reimbursement
Technology and Productivity Allowance for Equipment and Supplies
Morale Building and Company Events to Celebrate our Successes and Build our Community
Onboarding and Annual Swag
Company Paid Professional Development and Training