AI/ML Engineer
About The Position
Triunity Software is seeking a talented and passionate AI/ML Engineer to join its growing team in New Jersey. The role offers an opportunity to develop artificial intelligence and machine learning solutions with real-world impact in a fast-paced, innovative environment. The engineer will build LLM and generative AI applications, including retrieval-augmented generation systems, and develop cloud-based services, APIs, data pipelines, and event-driven workers. The position also involves evaluating, deploying, observing, and supporting enterprise AI applications in production, with attention to security, compliance, quality, and cost.
Requirements
- At least 5 years of overall software engineering experience.
- At least 2 years of hands-on LLM or generative AI development experience.
- Strong proficiency in Python 3.11+, including asynchronous programming, type annotations, and automated testing.
- Hands-on experience developing LLM/generative AI applications.
- Strong experience with RAG, embedding models, indexing strategies, and retrieval optimization.
- Experience with at least one LLM orchestration framework: LangGraph, LangChain, LlamaIndex, Semantic Kernel, AutoGen, or Amazon Bedrock Agents.
- Expertise in LLM evaluation methodologies, golden datasets, evaluation metrics, and LLM-as-a-judge techniques.
- Experience developing cloud-based services, REST APIs, data pipelines, and event-driven workers.
- Knowledge of AI observability, tracing, structured logging, quality monitoring, and cost optimization.
- Exposure to enterprise security, compliance, and governance requirements.
- Demonstrated experience deploying at least one enterprise-grade AI/LLM application into production.
- Experience owning and supporting live AI applications, including incident management, root-cause analysis, regression management, and production enhancements.
- Exposure to enterprise security and compliance reviews.
Nice To Haves
- Experience with FastAPI, Pydantic, PostgreSQL, Aurora PostgreSQL, and vector extensions.
- Experience with AgentCore and Agentic AI.
- Experience with Kubernetes, Helm, Terraform, and CI/CD.
- Experience with Apache Kafka and event-driven architecture.
- Experience with Datadog and OpenTelemetry.
- Experience with Document AI, OCR, intelligent document processing, and human-in-the-loop workflows.
- Experience in financial services, insurance, healthcare, or other regulated industries.
Responsibilities
- Develop LLM and generative AI applications, including RAG solutions.
- Build and optimize embedding, indexing, and retrieval approaches.
- Develop cloud-based services, REST APIs, data pipelines, and event-driven workers.
- Evaluate LLM applications using evaluation methodologies, golden datasets, metrics, and LLM-as-a-judge techniques.
- Apply AI observability practices, including tracing, structured logging, quality monitoring, and cost optimization.
- Deploy enterprise-grade AI/LLM applications to production and support them in operation.
- Manage incidents, perform root-cause analysis, handle regression management, and deliver production enhancements.
- Participate in enterprise security and compliance reviews.
Benefits
- Performance-based bonus
- Health insurance
- Training and development
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
