AI/ML Engineer
About The Position
Triunity Software is seeking a talented AI/ML Engineer to join its growing team in New Jersey. The role focuses on developing cutting-edge artificial intelligence and machine learning solutions with real-world impact. The engineer will build and support enterprise AI/LLM applications, including generative AI and Retrieval-Augmented Generation solutions, and work with cloud-based services, APIs, data pipelines, and event-driven systems. The position also involves evaluating and monitoring LLM applications, optimizing quality and cost, and addressing enterprise security, compliance, and governance needs.
Requirements
- At least 5 years of overall software engineering experience.
- At least 2 years of hands-on LLM/generative AI development experience.
- Demonstrated experience deploying at least one enterprise-grade AI/LLM application into production.
- Experience owning and supporting live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.
- Strong proficiency in Python 3.11 or later, including asynchronous programming, type annotations, and automated testing.
- Hands-on experience with LLM/generative AI application development.
- Strong experience with Retrieval-Augmented Generation, embedding models, indexing strategies, and retrieval optimization.
- Experience with at least one LLM orchestration framework: LangGraph, LangChain, LlamaIndex, Semantic Kernel, AutoGen, or Amazon Bedrock Agents.
- Expertise in LLM evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
- Experience developing cloud-based services, REST APIs, data pipelines, and event-driven workers.
- Knowledge of AI observability, tracing, structured logging, quality monitoring, and cost optimization.
- Exposure to enterprise security and compliance reviews, as well as security, compliance, and governance requirements.
Nice To Haves
- Experience with FastAPI, Pydantic, PostgreSQL, Aurora PostgreSQL, and vector extensions.
- Experience with AgentCore and Agentic AI.
- Experience with Kubernetes, Helm, Terraform, and CI/CD.
- Experience with Apache Kafka and event-driven architecture.
- Experience with Datadog and OpenTelemetry.
- Experience with Document AI, OCR, intelligent document processing, and human-in-the-loop workflows.
- Experience in financial services, insurance, healthcare, or other regulated industries.
Responsibilities
- Develop LLM and generative AI applications, including Retrieval-Augmented Generation solutions.
- Build and optimize embedding models, indexing strategies, and retrieval systems.
- Develop cloud-based services, REST APIs, data pipelines, and event-driven workers.
- Evaluate AI/LLM applications using evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
- Implement AI observability through tracing, structured logging, quality monitoring, and cost optimization.
- Deploy enterprise-grade AI/LLM applications into production.
- Own and support live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.
- Address enterprise security, compliance, and governance requirements.
Benefits
- Performance-based bonus.
- Health insurance.
- Training and development.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
