Senior DevOps Engineer

Akkadian Labs • Hoboken, NJ

8d • Remote

About The Position

Akkadian Labs is seeking a hands-on Senior DevOps Engineer with deep experience designing, building, and strengthening the infrastructure that keeps platforms secure, compliant, and uncomplicated. The ideal candidate will bring substantial experience maintaining production infrastructure and improving operational reliability through disciplined engineering practice. They should have a track record of helping to scale systems with a focus on dependability, observability, deployment confidence, and repeatable processes that support long-term growth. This role is for someone energized by solving infrastructure challenges in complex enterprise environments and by building systems that reduce manual work, improve governance, and support operational accuracy at scale. This role supports Akkadian’s purpose to uncomplicate work by removing friction between people and their purpose — helping enterprise customers govern, automate, and continuously control complex collaboration environments across cloud, hybrid, and on-premises systems. The engineer will design, implement, and maintain scalable and secure infrastructure and DevOps processes at Akkadian Labs, working closely with development, QA, and product teams to enable reliable deployments, automate workflows, and improve system observability across Rocky OS-based, AWS-hosted, and on-premises solutions. This is a hands-on technical role focused on system-level execution, continuous improvement, and operational excellence within the DevOps function.

Requirements

• 10+ years of experience in DevOps or Site Reliability Engineering (SRE).
• Expertise with AWS (e.g., EC2, ECS, S3, IAM, Lambda, CloudWatch).
• Expertise with infrastructure-as-code tools, including Terraform and CloudFormation.
• Strong knowledge of Linux environments.
• Experienced with Docker and Kubernetes.
• Scripting ability in Python, Bash, or similar languages.
• Experience building or maintaining CI/CD pipelines and related tools.
• Experience in monitoring and observability tools such as Prometheus, Grafana, and ELK.
• Experience in implementing secure DevOps practices and compliance frameworks (SOC2, ISO, etc).
• Experience supporting AI or machine learning workloads and compute environments.
• Exposure to AI model deployment pipelines and model versioning practices.
• Familiarity with hybrid cloud or on-premises environments.
• Exposure to security best practices in DevOps contexts, including AI-specific concerns such as data isolation and access controls.
• Experience supporting production systems and participating in on-call rotations.

Responsibilities

• Deploy and maintain scalable infrastructure in AWS and hybrid cloud environments.
• Manage infrastructure-as-code (IaC) using Terraform, CloudFormation, or similar tools.
• Maintain Linux-based environments.
• Design and implement containerization using Docker and orchestration via Kubernetes.
• Design, deploy and manage AI agent workloads, including provisioning compute instances and managing resource scaling for inference-heavy tasks.
• Build and maintain model deployment pipelines, including versioning, testing, and rollback of AI models in production environments.
• Monitor AI API consumption and infrastructure costs, implementing alerting and controls to prevent runaway usage and support budget visibility.
• Collaborate with the engineering team to implement infrastructure-level security guardrails for AI systems, including access controls and data isolation for model inputs and outputs.
• Manage monitoring and observability efforts using tools such as Prometheus, Grafana, and the ELK stack.
• Troubleshoot system issues and contribute to incident response and root cause analysis.
• Develop and execute strategies for improving system reliability, performance, and uptime.
• Build, maintain, and optimize CI/CD pipelines using tools such as Jenkins, Bitbucket CI/CD, or similar.
• Automate routine operational tasks including builds, testing, deployments, and system updates.
• Collaborate with engineering teams to integrate pipelines with Akkadian tools.
• Follow secure DevOps practices and implement and maintain security controls.
• Support compliance initiatives and vulnerability remediation efforts.
• Work closely with DevOps, engineering, QA, and product teams to support deployments and releases.
• Maintain documentation for infrastructure, processes, and operational procedures.
• Participate in collaborative team processes and continuous improvement initiatives.

Benefits

• medical
• dental
• vision
• company-paid life insurance
• disability policies
• 401(k) with a generous matching program
• paid time off

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed