AI Tools & Reliability Engineer--Remote Job
DELTASOFT SOLUTIONS LLC
•$70 - $70•Remote
About The Position
This is a remote position for an AI Tools & Reliability Engineer. The role involves monitoring the health, performance, and reliability of AI/ML applications, working with various AI tools, and collaborating with engineering teams.
Requirements
- Experience with AI tools such as LangSmith, PromptFlow, OpenTelemetry, and similar platforms.
- Experience with cloud monitoring tools such as AWS CloudWatch and Azure Monitor.
- Ability to troubleshoot issues related to AI applications and cloud environments.
- Ability to create dashboards and reports for AI performance and reliability metrics.
- Familiarity with AI evaluations (Evals).
Responsibilities
- Monitor the health, performance, and reliability of AI/ML applications.
- Work with AI tools such as LangSmith, PromptFlow, OpenTelemetry, and similar platforms.
- Set up and maintain monitoring, logging, and alerting for AI applications.
- Track AI model performance, response time, errors, and availability.
- Monitor token usage and AI/API costs.
- Troubleshoot issues related to AI applications and cloud environments.
- Create dashboards and reports for AI performance and reliability metrics.
- Support AI evaluations (Evals) to check the quality and accuracy of AI responses.
- Work with cloud monitoring tools such as AWS CloudWatch and Azure Monitor.
- Collaborate with AI/ML engineers, DevOps, and cloud teams.
Benefits
- 401(k)
- 401(k) matching
- Bonus based on performance
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Education Level
No Education Listed
