AI/ML Engineer

Triunity Software•Ocala, FL

19h

About The Position

Triunity Software is seeking a talented AI/ML Engineer to join its team in New Jersey. The role involves developing cutting-edge artificial intelligence and machine learning solutions, including LLM and Generative AI applications, that deliver real-world impact. The engineer will build and support enterprise-grade AI applications and cloud-based services, and will work with client projects in a fast-paced, innovative environment. The position requires strong Python skills, experience with retrieval-augmented generation and LLM orchestration, and expertise in evaluating and monitoring LLM applications. The engineer will also own and support production AI applications, including incident management, root-cause analysis, regression management, and production enhancements. Preferred technologies include FastAPI, PostgreSQL, Kubernetes, Terraform, Kafka, Datadog, and OpenTelemetry. Triunity is a product development, staff augmentation, and consulting services company that provides IT services and technology solutions across business sectors in North America. The company emphasizes teamwork, learning, knowledge sharing, training, and opportunities to work on challenging client problems and new technologies.

Requirements

Minimum 5 years of overall software engineering experience.
Minimum 2 years of hands-on LLM/Generative AI development experience.
Strong proficiency in Python 3.11 or later, including asynchronous programming, type annotations, and automated testing.
Hands-on experience with LLM/Generative AI application development.
Strong experience with RAG, embedding models, indexing strategies, and retrieval optimization.
Experience with at least one LLM orchestration framework: LangGraph, LangChain, LlamaIndex, Semantic Kernel, AutoGen, or Amazon Bedrock Agents.
Expertise in LLM evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
Experience developing cloud-based services, REST APIs, data pipelines, and event-driven workers.
Knowledge of AI observability, tracing, structured logging, quality monitoring, and cost optimization.
Exposure to enterprise security, compliance, and governance requirements.
Demonstrated experience deploying at least one enterprise-grade AI/LLM application into production.
Experience owning and supporting live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.

Nice To Haves

Experience with FastAPI, Pydantic, PostgreSQL, Aurora PostgreSQL, and vector extensions.
Experience with AgentCore and Agentic AI.
Experience with Kubernetes, Helm, Terraform, and CI/CD.
Experience with Apache Kafka and event-driven architecture.
Experience with Datadog and OpenTelemetry.
Experience with Document AI, OCR, intelligent document processing, and human-in-the-loop workflows.
Experience in financial services, insurance, healthcare, or other regulated industries.

Responsibilities

Develop LLM and Generative AI applications, including solutions using retrieval-augmented generation, embedding models, indexing strategies, and retrieval optimization.
Build cloud-based services, REST APIs, data pipelines, and event-driven workers.
Evaluate LLM applications using evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
Implement AI observability, tracing, structured logging, quality monitoring, and cost optimization.
Deploy enterprise-grade AI/LLM applications into production.
Own and support live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.
Address enterprise security, compliance, and governance requirements.