AI/ML engineer II
About The Position
This role is part of Blue Origin Operations, which supports integrated supply chain, test operations, safety, quality, mission assurance, manufacturing, and supply chain across Blue Origin facilities. The AI/ML Engineer will develop AI-powered operational tooling that turns fragmented telemetry, documentation, and runbooks into fast, trustworthy answers for engineers. The role focuses on agentic workflows that detect incidents, investigate root causes, and guide engineers toward resolution across edge-to-cloud production systems. The engineer will collaborate with platform, operations, and software teams to define agent capabilities and build the tools and knowledge layers behind them. The work spans prototype development through audited production deployment, with the goal of reducing incident investigation time and enabling self-service debugging for on-floor technicians and engineers.
Requirements
- Bachelor’s degree in Computer Science, Electrical Engineering, or a related field.
- At least 2 years of software or ML engineering experience, including production systems.
- Hands-on experience building LLM-based applications, including prompt engineering, tool use or function calling, and retrieval-augmented generation (RAG).
- Experience with AWS services such as Lambda, S3, DynamoDB, CloudWatch, and IAM.
- Programming skills in Python and experience building APIs and services.
- Experience with infrastructure as code, such as AWS CDK, CloudFormation, or Terraform.
- Familiarity with observability concepts including logs, metrics, traces, alerting, and incident response.
- Ability to write clear design documents, interface definitions, and operational documentation.
Nice To Haves
- Experience designing multi-agent orchestration patterns and agent-to-agent communication.
- Experience with OpenSearch or other vector and hybrid search systems.
- Experience building evaluation harnesses for LLM and agent systems, including offline benchmarks and LLM-as-judge methods.
Responsibilities
- Design and build multi-agent systems for incident triage and root cause analysis, with specialized agents coordinated by a central orchestrator.
- Build and maintain knowledge bases over internal documentation, runbooks, and escalation paths, including ingestion pipelines, chunking and retrieval strategies, and relevance evaluation.
- Provision and manage AI infrastructure as code with AWS CDK and create repeatable deployments across environments.
- Define evaluation frameworks and metrics for agent accuracy, hallucination rate, tool-call correctness, latency, and cost, and drive continuous improvement.
- Partner with engineers and domain teams to turn real incident patterns into new tools, agents, and knowledge content.
- Document agent architectures, tool interfaces, guardrails, and operational runbooks for the AI assistant.
Benefits
- Medical insurance
- Dental insurance
- Vision insurance
- Basic and supplemental life insurance
- Paid parental leave
- Short- and long-term disability
- 401(k) with company match of up to 5%
- Education Support Program
- Stock options for regular employees working at least 20 hours per week
- Paid time off of up to four weeks per year based on weekly scheduled hours
- Up to 14 company-paid holidays
- Potential eligibility for bonuses, depending on role type and job level; amounts and eligibility are not guaranteed
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
