Senior DevOps Engineer

Akkadian Labs•Hoboken, NJ

6d•Remote

About The Position

Akkadian Labs is seeking a hands-on Senior DevOps Engineer to design, build, and strengthen the infrastructure that keeps platforms secure, compliant, and uncomplicated. This role supports Akkadian’s purpose to uncomplicate work by removing friction between people and their purpose — helping enterprise customers govern, automate, and continuously control complex collaboration environments across cloud, hybrid, and on-premises systems. The engineer will design, implement, and maintain scalable and secure infrastructure and DevOps processes at Akkadian Labs, working closely with development, QA, and product teams to enable reliable deployments, automate workflows, and improve system observability across Rocky OS-based, AWS-hosted, and on-premises solutions. This is a hands-on technical role focused on system-level execution, continuous improvement, and operational excellence within the DevOps function.

Requirements

10+ years of experience in DevOps or Site Reliability Engineering (SRE).
Expertise with AWS (e.g., EC2, ECS, S3, IAM, Lambda, CloudWatch).
Expertise with infrastructure-as-code tools, including Terraform and CloudFormation.
Strong knowledge of Linux environments.
Experienced with Docker and Kubernetes.
Scripting ability in Python, Bash, or similar languages.
Experience building or maintaining CI/CD pipelines and related tools.
Experience in monitoring and observability tools such as Prometheus, Grafana, and ELK.
Experience in implementing secure DevOps practices and compliance frameworks (SOC2, ISO, etc).
Experience supporting AI or machine learning workloads and compute environments.
Exposure to AI model deployment pipelines and model versioning practices.
Familiarity with hybrid cloud or on-premises environments.
Exposure to security best practices in DevOps contexts, including AI-specific concerns such as data isolation and access controls.
Experience supporting production systems and participating in on-call rotations.
Must be a resident of the United States.

Nice To Haves

Experience with Rocky OS-based systems.

Responsibilities

Deploy and maintain scalable infrastructure in AWS and hybrid cloud environments.
Manage infrastructure-as-code (IaC) using Terraform, CloudFormation, or similar tools.
Maintain Linux-based environments.
Design and implement containerization using Docker and orchestration via Kubernetes.
Design, deploy and manage AI agent workloads, including provisioning compute instances and managing resource scaling for inference-heavy tasks.
Build and maintain model deployment pipelines, including versioning, testing, and rollback of AI models in production environments.
Monitor AI API consumption and infrastructure costs, implementing alerting and controls to prevent runaway usage and support budget visibility.
Collaborate with the engineering team to implement infrastructure-level security guardrails for AI systems, including access controls and data isolation for model inputs and outputs.
Manage monitoring and observability efforts using tools such as Prometheus, Grafana, and the ELK stack.
Troubleshoot system issues and contribute to incident response and root cause analysis.
Develop and execute strategies for improving system reliability, performance, and uptime.
Build, maintain, and optimize CI/CD pipelines using tools such as Jenkins, Bitbucket CI/CD, or similar.
Automate routine operational tasks including builds, testing, deployments, and system updates.
Collaborate with engineering teams to integrate pipelines with Akkadian tools.
Follow secure DevOps practices and implement and maintain security controls.
Support compliance initiatives and vulnerability remediation efforts.
Work closely with DevOps, engineering, QA, and product teams to support deployments and releases.
Maintain documentation for infrastructure, processes, and operational procedures.
Participate in collaborative team processes and continuous improvement initiatives.