AI/ML Engineer
About The Position
Triunity Software is seeking a talented and passionate AI/ML Engineer to join its growing team in New Jersey. The role involves developing cutting-edge artificial intelligence and machine learning solutions with real-world impact in a fast-paced, innovative environment. The engineer will build LLM and Generative AI applications, including Retrieval-Augmented Generation solutions, and develop and support enterprise-grade AI applications in production. The position also involves cloud-based services, APIs, data pipelines, event-driven workers, evaluation, observability, cost optimization, and enterprise security and compliance considerations.
Requirements
- Strong proficiency in Python 3.11+, including asynchronous programming, type annotations, and automated testing.
- Hands-on experience in LLM/Generative AI application development.
- Strong experience with Retrieval-Augmented Generation (RAG), embedding models, indexing strategies, and retrieval optimization.
- Experience with at least one LLM orchestration framework: LangGraph, LangChain, LlamaIndex, Semantic Kernel, AutoGen, or Amazon Bedrock Agents.
- Expertise in LLM evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
- Experience developing cloud-based services, REST APIs, data pipelines, and event-driven workers.
- Knowledge of AI observability, tracing, structured logging, quality monitoring, and cost optimization.
- Exposure to enterprise security, compliance, and governance requirements.
- Minimum 5 years of overall software engineering experience.
- Minimum 2 years of hands-on LLM/Generative AI development experience.
- Demonstrated experience deploying at least one enterprise-grade AI/LLM application into production.
- Experience owning and supporting live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.
- Exposure to enterprise security and compliance reviews.
Nice To Haves
- FastAPI, Pydantic, PostgreSQL, Aurora PostgreSQL, and vector extensions.
- AgentCore and Agentic AI.
- Kubernetes, Helm, Terraform, and CI/CD.
- Apache Kafka and event-driven architecture.
- Datadog and OpenTelemetry.
- Document AI, OCR, intelligent document processing, and human-in-the-loop workflows.
- Experience in financial services, insurance, healthcare, or other regulated industries.
Responsibilities
- Develop LLM and Generative AI applications, including Retrieval-Augmented Generation solutions.
- Develop cloud-based services, REST APIs, data pipelines, and event-driven workers.
- Evaluate AI/LLM applications using evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
- Support AI observability through tracing, structured logging, quality monitoring, and cost optimization.
- Deploy enterprise-grade AI/LLM applications into production.
- Own and support live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.
- Address enterprise security, compliance, and governance requirements.
Benefits
- Performance-based bonus
- Health insurance
- Training and development
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
