AI/ML Engineer
About The Position
Triunity Software is seeking a talented and passionate AI/ML Engineer to join its growing team in New Jersey. The role focuses on developing cutting-edge artificial intelligence and machine learning solutions with real-world impact in a fast-paced, innovative environment. The engineer will build and support LLM and Generative AI applications, including production deployments, and work with cloud-based services, APIs, data pipelines, and event-driven workers. The position also involves evaluation, observability, quality monitoring, cost optimization, and consideration of enterprise security, compliance, and governance requirements.
Requirements
- At least 5 years of overall software engineering experience.
- At least 2 years of hands-on LLM/Generative AI development experience.
- Strong proficiency in Python 3.11+, including asynchronous programming, type annotations, and automated testing.
- Hands-on experience with LLM/Generative AI application development.
- Strong experience in RAG, embedding models, indexing strategies, and retrieval optimization.
- Experience with at least one LLM orchestration framework: LangGraph, LangChain, LlamaIndex, Semantic Kernel, AutoGen, or Amazon Bedrock Agents.
- Expertise in LLM evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
- Experience developing cloud-based services, REST APIs, data pipelines, and event-driven workers.
- Knowledge of AI observability, tracing, structured logging, quality monitoring, and cost optimization.
- Exposure to enterprise security, compliance, and governance requirements.
- Demonstrated experience deploying at least one enterprise-grade AI/LLM application into production.
- Experience owning and supporting live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.
- Exposure to enterprise security and compliance reviews.
Nice To Haves
- Experience with FastAPI, Pydantic, PostgreSQL, Aurora PostgreSQL, and vector extensions.
- Experience with AgentCore and Agentic AI.
- Experience with Kubernetes, Helm, Terraform, and CI/CD.
- Experience with Apache Kafka and event-driven architecture.
- Experience with Datadog and OpenTelemetry.
- Experience with Document AI, OCR, intelligent document processing, and human-in-the-loop workflows.
- Experience in financial services, insurance, healthcare, or other regulated industries.
Responsibilities
- Develop LLM and Generative AI applications, including Retrieval-Augmented Generation solutions.
- Build and optimize embedding, indexing, and retrieval strategies.
- Develop cloud-based services, REST APIs, data pipelines, and event-driven workers.
- Evaluate AI/LLM applications using evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
- Deploy enterprise-grade AI/LLM applications into production.
- Own and support live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.
- Apply AI observability practices such as tracing, structured logging, and quality monitoring, and optimize costs.
- Address enterprise security, compliance, and governance requirements.
Benefits
- Bonus based on performance
- Health insurance
- Training & development
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
