Senior Principal Software Engineer, Backend - Advanced Cluster Security (RHACS)

Red Hat • Raleigh, NC

1d • Remote

About The Position

Red Hat Advanced Cluster Security (RHACS) Engineering builds security solutions for OpenShift and Kubernetes deployments. Our mission is to make OpenShift the most secure Kubernetes distribution by designing security workflows across the full software development lifecycle. We are seeking a Senior Principal Software Engineer - product-minded, with strong backend, distributed systems, and AI-driven engineering experience - to join our team. In this role, you will define the technical strategy across teams to solve hard problems for our customers. You will design large-scale systems that address Kubernetes security challenges today and hold up as requirements grow. As the engineering organization transitions toward an agentic software development lifecycle, you will drive the strategy for integrating AI-powered tools and workflows into how we build, test, and ship software. We are looking for someone who doesn't just implement what they're told - you challenge specifications, propose alternative approaches, and evaluate both engineering and product trade-offs simultaneously. You understand how your technical decisions connect to business outcomes and customer value, and you stay engaged well beyond shipping to understand real-world impact.

Requirements

• Bachelor's degree in Computer Science, Engineering, or a related STEM field (or equivalent practical experience) with 8+ years of software development experience.
• Proven track record in architecting and implementing high-performance backend services (RESTful and gRPC APIs) and large-scale distributed systems.
• Significant hands-on experience with Kubernetes, including deployment, scaling, and securing clusters in production environments.
• Deep expertise in at least two of: Linux system internals, container runtime security, distributed data systems (PostgreSQL), or observability at scale.
• Knowledge of frameworks like Terraform and Helm, with experience creating tools that enhance developer productivity.
• Experience setting standards and driving alignment across multiple teams, with the ability to mentor senior and principal-level engineers.
• The ability to think beyond code to understand how technical decisions affect customer experience and business outcomes, and to proactively balance engineering effort with user impact.
• Able to take an unclear problem, define the approach, and drive it to completion across teams with competing priorities.
• Open to learning new technologies and languages (we primarily use Golang).

Nice To Haves

• Experience adopting AI-powered development tools (AI-assisted code gen, automated testing, AI code review) or driving similar technology transformations at scale.
• A track record of solving hard engineering problems with practical, working solutions - specifically in container security or distributed systems.
• A history of contributions to open-source projects and active participation in community discussions or industry events.

Responsibilities

• Drive the design of backend systems across multiple RHACS subsystems, ensuring scalability and fault-tolerance for the world's largest commercial Kubernetes clusters.
• Drive cross-functional alignment with product management, design, and peer engineering teams.
• Lead the adoption of agentic development practices - defining how AI tools, context registries, and automated workflows reshape the SDLC from intake through release.
• Establish testing practices, architectural patterns, and development methodologies that multiple teams can adopt to raise the bar on system reliability.
• Improve how teams build and ship software by introducing new methodologies, including AI-accelerated approaches, to make multiple teams more effective.
• Identify and drive adoption of new technologies and frameworks.
• Represent RHACS in open-source communities and industry working groups.
• Coach and mentor Principal Engineers across organizations through code reviews, design feedback, and guidance on agentic development.
• Own complex, multi-month technical initiatives, navigating ambiguity and tracking real-world usage beyond shipping to inform future product direction.

Benefits

• Comprehensive medical, dental, and vision coverage
• Flexible Spending Account - healthcare and dependent care
• Health Savings Account - high deductible medical plan
• Retirement 401(k) with employer match
• Paid time off and holidays
• Paid parental leave plans for all new parents
• Leave benefits including disability, paid family medical leave, and paid military leave
• Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!

What This Job Offers

• Job Type: Full-time
• Career Level: Senior