Moring.ai builds enterprise AI for regulated industries, deploying AI applications and agents in customers’ cloud environments. The AI Observability Engineer will own observability for an AI platform used by developers at a large financial services enterprise to build and deploy Python agents that call LLMs, use tools, and run on Kubernetes. This hands-on individual contributor role focuses on enabling engineers, customer operations teams, and auditors to understand agent behavior, including model and tool calls, timing, and cost. The engineer will own end-to-end observability architecture across logs, traces, metrics, and AI-specific signals. The role includes deploying and integrating LangSmith and related tools, instrumenting agents and platform services with OpenTelemetry, creating collector pipelines, and developing developer tooling, dashboards, alerts, and audit reports. It also covers connecting production traces to evaluations, accounting for token usage and spend, making observability work in restricted enterprise networks, defining platform SLOs and on-call runbooks, improving them based on incidents, and teaching engineers how to use the systems. The position is based on-site in Newark, New Jersey, with up to 10% travel to customer sites.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed