AI & Data Technical Administrator
About The Position
The Calibrate Technical Administrator is responsible for the technical configuration, data management, and validation of the Calibrate AI platform. The administrator contributes to model reliability, scoring integrity, and continuous improvement, working closely with QA, Operations, and Data teams. This role ensures that: · QA requirements are accurately translated into system configurations · Evaluation data is complete, consistent, and reliable · Outputs are structured and usable for reporting and analysis This is a data-focused, entry-level IT role, not a QA decision-making role.
Responsibilities
- Implement and test AI prompts
- Track changes and validate output consistency
- Ensure evaluation coverage meets targets
- Identify missing, inconsistent, or duplicate data
- Monitor usage and scan volumes
- Set up clients, programs, and evaluation structures
- Translate QA scorecards into system logic
- Export and prepare datasets for QA and Operations
- Support dashboards and reporting needs
- Identify trends, anomalies, and scoring inconsistencies
- Compare automated vs manual QA results
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Entry Level
Education Level
No Education Listed
Number of Employees
251-500 employees
