AI/ML Engineer
About The Position
Triunity Software is seeking a talented and passionate AI/ML Engineer to join its growing team in New Jersey. The role involves developing cutting-edge artificial intelligence and machine learning solutions with real-world impact in a fast-paced, innovative environment. The engineer will build LLM and generative AI applications, including retrieval-augmented generation systems, and develop and support enterprise-grade AI applications in production. The position also involves cloud-based services, APIs, data pipelines, event-driven workers, AI observability, and work involving enterprise security, compliance, and governance.
Requirements
- At least 5 years of overall software engineering experience.
- At least 2 years of hands-on LLM/generative AI development experience.
- Strong proficiency in Python 3.11+, including asynchronous programming, type annotations, and automated testing.
- Hands-on experience with LLM/generative AI application development.
- Strong experience with RAG, embedding models, indexing strategies, and retrieval optimization.
- Experience with at least one LLM orchestration framework: LangGraph, LangChain, LlamaIndex, Semantic Kernel, AutoGen, or Amazon Bedrock Agents.
- Expertise in LLM evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
- Experience developing cloud-based services, REST APIs, data pipelines, and event-driven workers.
- Knowledge of AI observability, tracing, structured logging, quality monitoring, and cost optimization.
- Exposure to enterprise security, compliance, and governance requirements.
- Demonstrated experience deploying at least one enterprise-grade AI/LLM application into production.
- Experience owning and supporting live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.
Nice To Haves
- Experience with FastAPI, Pydantic, PostgreSQL, Aurora PostgreSQL, and vector extensions.
- Experience with AgentCore and Agentic AI.
- Experience with Kubernetes, Helm, Terraform, and CI/CD.
- Experience with Apache Kafka and event-driven architecture.
- Experience with Datadog and OpenTelemetry.
- Experience with Document AI, OCR, intelligent document processing, and human-in-the-loop workflows.
- Experience in financial services, insurance, healthcare, or other regulated industries.
Responsibilities
- Develop LLM and generative AI applications.
- Build and optimize retrieval-augmented generation systems, including embedding models, indexing strategies, and retrieval.
- Develop cloud-based services, REST APIs, data pipelines, and event-driven workers.
- Evaluate LLM applications using evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
- Support AI observability through tracing, structured logging, quality monitoring, and cost optimization.
- Deploy enterprise-grade AI/LLM applications into production.
- Own and support live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.
- Participate in enterprise security and compliance reviews.
Benefits
- Performance-based bonus
- Health insurance
- Training and development
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
