Lead Principal Core Infrastructure Engineer

Oracle•Nashville, TN

2d•$146,300 - $306,400

About The Position

Oracle Cloud Infrastructure (OCI) is building large-scale AI clusters and a GPU-focused cloud designed to deliver performance, efficiency, reliability, and scalability. The AI Infrastructure organization develops systems that enable customers to scale AI workloads from tens to thousands of GPUs without compromising performance. The Lead Principal Core Infrastructure Engineer provides technical leadership for the architecture and optimization of distributed AI compute infrastructure, including GPU control-plane and data-plane components. The role brings clarity to ambiguous problems, develops innovative solutions, and collaborates with cross-functional teams to improve customer experience and workload performance. It also mentors teams and leads the design of highly scalable, resilient distributed systems; establishes performance, reliability, security, and operational standards; and advances software development practices and automation. The position requires a bachelor’s degree or equivalent experience in computer science, engineering, or a related field, 10 years of software development experience, 5 years designing large-scale distributed systems, and 3 years providing technical leadership. Experience managing cloud infrastructure with hundreds of thousands of servers is preferred. The stated U.S. hiring range is $146,300–$306,400 per annum. The role may also be eligible for bonus, equity, and compensation deferral.

Requirements

Bachelor’s degree or equivalent experience in computer science, engineering, or a related field.
10 years of software development experience using programming languages including, but not limited to, C, C++, C#, Java, Go, or Rust.
5 years of experience designing and developing large-scale distributed systems, services, and infrastructure.
3 years of experience providing technical leadership and clarity to cross-functional teams and projects while collaborating across stakeholders.
Systematic problem-solving approach, strong communication skills, sense of ownership, and drive.
Ability to adapt to a fast-paced, dynamic environment and manage multiple tasks and priorities effectively.

Nice To Haves

Experience managing cloud infrastructure with hundreds of thousands of servers.

Responsibilities

Architect solutions to scale and optimize AI compute infrastructure components, including GPU control-plane and GPU data-plane systems, to improve customer experience and workload performance.
Develop modular, secure, reliable, diagnosable, monitored, compliant, and reusable AI compute infrastructure services and components.
Collaborate with development, operations, product management, and other cross-functional teams to understand requirements and design solutions.
Improve the organization’s software development processes and developer efficiency.
Mentor developers and promote modern engineering practices, including data- and telemetry-informed decisions, well-defined component interfaces, design reviews, coding standards, code reviews, unit and integration testing, and production monitoring.
Develop benchmark metrics and automation to measure and improve performance and reliability across customer workloads and correlate results with lower infrastructure layers.
Stay current with industry trends, emerging technologies, and best practices in distributed systems and AI infrastructure management.
Lead architecture for highly scalable, interdependent distributed systems and identify and remove performance and scalability bottlenecks.
Define scalability requirements with stakeholders and design elastic systems for hyper-scale workloads.
Engineer fault-tolerant, in-service-upgradable designs and optimize resilience mechanisms such as load shedding, throttling, and rate limiting.
Set SLO-aligned durability and availability standards across dependent services.
Establish KPIs and advanced telemetry, apply formal verification to complex features, and develop replication and synchronization strategies.
Advise on and lead resolution of complex production issues; establish operational readiness and standard operating procedures; direct incident response and root-cause analyses.
Architect security controls, drive remediation and compliance, and deliver infrastructure-as-code automation and change strategies for safe patching, updates, and rollbacks.