AI/ML Engineer

Triunity Software • Dc, WA

3d

About The Position

Triunity Software is seeking a talented AI/ML Engineer to join its team in New Jersey and develop artificial intelligence and machine learning solutions. The role focuses on building, deploying, and supporting production-grade LLM and Generative AI applications, including Retrieval-Augmented Generation systems. The engineer will work with cloud-based services, REST APIs, data pipelines, event-driven workers, and AI observability practices, while addressing enterprise security, compliance, and governance requirements. The position includes ownership and support of live AI applications, such as incident management, root-cause analysis, regression management, and production enhancements. The role offers an opportunity to work on client projects with industry experts and access training and development.

Requirements

• At least 5 years of overall software engineering experience.
• At least 2 years of hands-on LLM/Generative AI development experience.
• Strong proficiency in Python 3.11+, including asynchronous programming, type annotations, and automated testing.
• Hands-on experience with LLM/Generative AI application development.
• Strong experience with RAG, embedding models, indexing strategies, and retrieval optimization.
• Experience with at least one LLM orchestration framework: LangGraph, LangChain, LlamaIndex, Semantic Kernel, AutoGen, or Amazon Bedrock Agents.
• Expertise in LLM evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
• Experience developing cloud-based services, REST APIs, data pipelines, and event-driven workers.
• Knowledge of AI observability, tracing, structured logging, quality monitoring, and cost optimization.
• Exposure to enterprise security, compliance, and governance requirements.
• Demonstrated experience deploying at least one enterprise-grade AI/LLM application into production.
• Experience owning and supporting live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.

Nice To Haves

• Experience with FastAPI, Pydantic, PostgreSQL, Aurora PostgreSQL, and vector extensions.
• Experience with AgentCore and Agentic AI.
• Experience with Kubernetes, Helm, Terraform, and CI/CD.
• Experience with Apache Kafka and event-driven architecture.
• Experience with Datadog and OpenTelemetry.
• Experience with Document AI, OCR, intelligent document processing, and human-in-the-loop workflows.
• Experience in financial services, insurance, healthcare, or other regulated industries.

Responsibilities

• Develop LLM and Generative AI applications.
• Build Retrieval-Augmented Generation systems, including embedding models, indexing strategies, and retrieval optimization.
• Develop cloud-based services, REST APIs, data pipelines, and event-driven workers.
• Apply LLM evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
• Use AI observability practices, including tracing, structured logging, quality monitoring, and cost optimization.
• Deploy enterprise-grade AI/LLM applications into production.
• Own and support live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.
• Address enterprise security, compliance, and governance requirements.

Benefits

• Performance-based bonus
• Health insurance
• Training and development

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed