Senior Principal Software Engineer, AI & Edge

Red River•Boston, MA

About The Position

The Red Hat Ecosystems Engineering group is seeking a Senior Principal Software Engineer to join our rapidly growing team. This is a game-changing opportunity to join an open-source AI platform that harnesses the power of hybrid cloud to drive innovation. In this role, you will work with a diverse team of highly talented engineers on designing, implementing, and productizing new AI solutions, with a focus on deep integration of the AI stack, hardware accelerators, and leading OEMs and Cloud Computing Service Providers (CCSPs). You'll play a critical role in shaping the next generation of hybrid cloud platforms by directly contributing to Red Hat's innovative AI and Edge products. This is your chance to be at the forefront of AI's exciting evolution, joining an ecosystem that champions continuous learning, career growth, and professional development. You'll also collaborate closely with product management, other Red Hat engineering teams, and key partners and lighthouse customers. At Red Hat, our commitment to open source innovation extends beyond our products - it’s embedded in how we work and grow. Red Hatters embrace change – especially in our fast-moving technological landscape – and have a strong growth mindset. That's why we encourage our teams to proactively, thoughtfully, and ethically use AI to simplify their workflows, cut complexity, and boost efficiency. This empowers our associates to focus on higher-impact work, creating smart, more innovative solutions that solve our customers' most pressing challenges.

Requirements

10+ years of relevant technical experience in software development.
Advanced experience working in a Linux environment with at least one language like Golang, Rust, Java, C, or C++
Advanced experience with a container orchestration ecosystem like Kubernetes, or Red Hat OpenShift
Strong experience with microservices architectures and concepts including APIs, versioning, monitoring, etc.
Experience with AI/ML technologies, including foundational frameworks, large language models (LLMs), Retrieval Augmented Generation (RAG) paradigms, vector databases, and LLM orchestration tools
Ability to quickly learn and guide others on using new tools and technologies
Proven ability to innovate and a passion for staying at the forefront of technology
Excellent system understanding and troubleshooting capabilities
Autonomous work ethic, thriving in a dynamic, fast-paced environment
Technical leadership acumen in a global team environment
Proficient written and verbal communication skills in English

Nice To Haves

Experience with cloud development for public cloud services (AWS, GCE, Azure)
Familiarity with virtualization, networking, or storage
Background in DevOps or site reliability engineering (SRE)
Experience with hardware accelerators (e.g., GPUs, FPGAs) for AI workloads
Recent hands-on experience with distributed computation, either at the end-user or infrastructure provider level
Experience with performance analysis tools
Experience with Linux kernel development

Responsibilities

Architect and lead the implementation of new features and solutions for Red Hat AI and Edge products
Explore deep code integration into various Red Hat products, ensuring optimal integration between the Red Hat portfolio, hardware accelerators and partners
Provide technical vision and leadership on critical and high-impact projects, ensuring non-functional requirements including security, resiliency, and maintainability are met
Integrate software that leverages hardware accelerators (e.g., DPUs, GPUs, AIUs) and perform performance analysis and optimization of AI workloads with accelerators
Work with major AI and hardware partners such as NVIDIA, AMD, Dell, and others on building joint integrations and products
Collaborate closely with UX, UI, QE, and cross-functional teams to deliver a great experience to Red Hat partners and customers
Coordinate with team leads, architects, and other engineers on the design and architecture of our offerings
Become responsible for the quality of our offerings, participate in peer code reviews and continuous integration (CI), and respond to security threats
Mentor, influence, and coach a distributed team of engineers, contributing to a culture of continuous improvement by sharing recommendations and technical knowledge

Benefits

Comprehensive medical, dental, and vision coverage
Flexible Spending Account - healthcare and dependent care
Health Savings Account - high deductible medical plan
Retirement 401(k) with employer match
Paid time off and holidays
Paid parental leave plans for all new parents
Leave benefits including disability, paid family medical leave, and paid military leave
Additional benefits including employee stock purchase plan, family planning reimbursement, tuition reimbursement, transportation expense account, employee assistance program, and more!

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume