Principal Software Engineer, AI & Edge

Red River • Raleigh, NC

1d

About The Position

The Red Hat Ecosystems Engineering group is seeking a Principal Software Engineer to join our rapidly growing team. This is a game-changing opportunity to join an open-source AI platform that harnesses the power of hybrid cloud to drive innovation. In this role, you will work with a diverse team of highly talented engineers on designing, implementing, and productizing new AI solutions, with a focus on deep integration of the AI stack, hardware accelerators, and leading OEMs and Cloud Computing Service Providers (CCSPs). You'll play a critical role in shaping the next generation of hybrid cloud platforms by directly contributing to Red Hat's innovative AI and Edge products. This is your chance to be at the forefront of AI's exciting evolution, joining an ecosystem that champions continuous learning, career growth, and professional development. You'll also collaborate closely with product management, other Red Hat engineering teams, and key partners and lighthouse customers.

Requirements

• 7+ years of relevant technical experience in software development.
• Advanced experience working in a Linux environment with at least one language like Golang, Rust, Java, C, or C++.
• Advanced experience with a container orchestration ecosystem like Kubernetes, or Red Hat OpenShift.
• Strong experience with microservices architectures and concepts including APIs, versioning, monitoring, etc.
• Experience with AI/ML technologies, including foundational frameworks, large language models (LLMs), Retrieval Augmented Generation (RAG) paradigms, vector databases, and LLM orchestration tools.
• Ability to quickly learn and guide others on using new tools and technologies.
• Proven ability to innovate and a passion for staying at the forefront of technology.
• Excellent system understanding and troubleshooting capabilities.
• Autonomous work ethic, thriving in a dynamic, fast-paced environment.
• Technical leadership acumen in a global team environment.
• Proficient written and verbal communication skills in English.

Nice To Haves

• Experience with cloud development for public cloud services (AWS, GCE, Azure).
• Familiarity with virtualization, networking, or storage.
• Background in DevOps or site reliability engineering (SRE).
• Experience with hardware accelerators (e.g., GPUs, FPGAs) for AI workloads.
• Recent hands-on experience with distributed computation, either at the end-user or infrastructure provider level.
• Experience with performance analysis tools.
• Experience with Linux kernel development.

Responsibilities

• Architect and lead the implementation of new features and solutions for Red Hat AI and Edge products.
• Explore deep code integration into various Red Hat products, ensuring optimal integration between the Red Hat portfolio, hardware accelerators and partners.
• Provide technical vision and leadership on critical and high-impact projects, ensuring non-functional requirements including security, resiliency, and maintainability are met.
• Integrate software that leverages hardware accelerators (e.g., DPUs, GPUs, AIUs) and perform performance analysis and optimization of AI workloads with accelerators.
• Work with major AI and hardware partners such as NVIDIA, AMD, Dell, and others on building joint integrations and products.
• Collaborate closely with UX, UI, QE, and cross-functional teams to deliver a great experience to Red Hat partners and customers.
• Coordinate with team leads, architects, and other engineers on the design and architecture of our offerings.
• Become responsible for the quality of our offerings, participate in peer code reviews and continuous integration (CI), and respond to security threats.
• Mentor, influence, and coach a distributed team of engineers, contributing to a culture of continuous improvement by sharing recommendations and technical knowledge

Benefits

• Comprehensive medical, dental, and vision coverage
• Flexible Spending Account - healthcare and dependent care
• Health Savings Account - high deductible medical plan
• Retirement 401(k) with employer match
• Paid time off and holidays
• Paid parental leave plans for all new parents
• Leave benefits including disability, paid family medical leave, and paid military leave
• Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed
• Number of Employees: 501-1,000 employees