Senior DevOps Engineer - Assistant Vice President

Citi • New Castle, DE

6d • $107,120 - $160,680 • Onsite

About The Position

We are seeking an experienced and highly skilled Senior DevOps Engineer to join our innovation team. The successful candidate will be responsible for the architecture, implementation, and maintenance of our cutting-edge Intelligent Document Processing (IDP) platform, specifically for our Passport processing division. This role involves end-to-end ownership of the CI/CD pipeline, deployment environments on OpenShift, and the operational management of our "IDP Studio."
The ideal candidate is a hands-on engineer with deep expertise in modern DevOps practices, container orchestration, and observability. You will play a critical role in ensuring the reliability, scalability, and security of a platform that leverages Large Language Models (LLMs) for document processing.

Requirements

• 4+ years in a DevOps, SRE, or platform engineering role.
• Proven hands-on experience with at least two of the following: Harness, Tekton, Lightspeed (LSE), and experience with Python and React JS build processes.
• Experience with Postgres database management and schema migration using Liquibase.
• Expert-level knowledge of Docker and container orchestration with Kubernetes and/or OpenShift.
• Demonstrable experience in creating and managing complex Helm charts.
• Strong operational experience with Kafka, including administration and performance tuning.
• Experience with container security scanning tools (e.g., Snyk, Checkmarx) and repository management (e.g., Artifactory).
• Proficiency in setting up and managing monitoring and logging tools like Prometheus, Grafana, and the ELK stack or Splunk.
• Bachelor's degree in computer science, Engineering, or equivalent experience

Nice To Haves

• Direct experience building, supporting, or working with platforms that utilize Generative AI and Large Language Models (LLMs).
• Advanced proficiency in Python for scripting, automation, and developing backend services.
• OpenShift or Kubernetes certifications (e.g., CKA, CKAD, Red Hat Certified Specialist in OpenShift Administration) are a plus.
• Experience working in a highly regulated environment such as finance or government.

Responsibilities

• Design, build, and maintain robust, automated CI/CD pipelines using a combination of Harness, Github, Tekton, and Lightspeed (LSE).
• Ensure seamless integration from code commit to production deployment, focusing on speed, quality, and security.
• Manage and optimize the build, test, and release processes for all components of the IDP platform, including Python and React JS applications.
• Manage and automate deployments of microservices and applications to OpenShift clusters.
• Implement and maintain deployment strategies such as blue-green, canary, and rolling updates.
• Ensure high availability, scalability, and resilience of applications running on OpenShift.
• Oversee the management and maintenance of Postgres databases.
• Implement and manage database schema changes using Liquibase.
• Lead the authoring, versioning, and release management of Helm charts for all platform services.
• Establish and enforce best practices for Helm chart development to ensure reusability and maintainability.
• Manage the lifecycle of charts in our Artifactory repository.
• Oversee the operational health of our Kafka messaging backbone.
• Responsible for topic management, including creation, partitioning, and access control.
• Perform consumer group tuning and monitoring to ensure optimal performance and data throughput.
• Implement and manage a strict container governance policy.
• Integrate automated image scanning (Snyk/Checkmarx) into the CI/CD pipeline to identify vulnerabilities.
• Manage the container lifecycle within Artifactory, including promotion, retention, and patching strategies for base and application images.
• Architect, build, and maintain a comprehensive observability stack using Prometheus, Grafana, and ELK/Splunk.
• Develop dashboards, alerts, and logging solutions to provide deep insights into platform health and performance.
• Proactively identify and resolve issues through effective monitoring and root cause analysis.

Benefits

• medical, dental & vision coverage
• 401(k)
• life, accident, and disability insurance
• wellness programs
• paid time off packages, including planned time off (vacation), unplanned time off (sick leave), and paid holidays

What This Job Offers

• Job Type: Full-time
• Career Level: Senior