Lead Principal Core Infrastructure Engineer

Oracle•Nashville, TN

17d•$146,300 - $306,400

About The Position

Oracle’s AI Infrastructure organization is building GPU-focused cloud infrastructure designed to let customers scale AI workloads from tens to thousands of GPUs while maintaining performance, efficiency, reliability, and scalability. The engineer will architect and optimize AI infrastructure components, including GPU control-plane and data-plane systems, and provide technical leadership to improve customer experience and workload performance. The role leads the design of scalable, interdependent distributed systems and addresses performance and scalability bottlenecks. It includes defining scalability requirements, developing resilient and secure systems, improving telemetry and performance measurement, and guiding resolution of complex production issues. The engineer will work with development, operations, product management, and other stakeholders, bring clarity to ambiguous problems, mentor engineers, and advance software engineering practices and developer efficiency. Oracle offers a comprehensive benefits package, including medical, dental, and vision coverage; disability and life insurance; flexible spending accounts; commuter benefits; a 401(k) plan with company match; paid time off and holidays; paid sick leave and parental leave; adoption assistance; an employee stock purchase plan; financial planning and group legal benefits; and voluntary insurance options.

Requirements

Bachelor’s degree or equivalent experience in Computer Science, Engineering, or a related field.
At least 10 years of software development experience using programming languages such as C, C++, C#, Java, Go, or Rust.
At least 5 years of experience designing and developing large-scale distributed systems, services, and infrastructure.
At least 3 years of experience providing technical leadership and clarity to cross-functional teams and projects while collaborating across stakeholders.
Systematic problem-solving approach, strong communication skills, sense of ownership, and drive.
Ability to adapt to a fast-paced, dynamic environment and manage multiple tasks and priorities effectively.

Nice To Haves

Experience managing cloud infrastructure with hundreds of thousands of servers.

Responsibilities

Architect solutions to scale and optimize AI compute infrastructure components, including GPU control-plane and GPU data-plane systems, to improve customer experience and workload performance.
Develop modular, secure, reliable, diagnosable, monitored, compliant, and reusable AI compute infrastructure services and components.
Collaborate with development, operations, product management, and other cross-functional stakeholders to understand requirements and design solutions.
Optimize software development processes to improve developer efficiency.
Mentor junior developers and promote modern engineering practices, including data- and telemetry-informed decisions, well-defined component interfaces, design reviews, coding standards, code reviews, and comprehensive unit, integration, and production monitoring coverage.
Develop benchmark metrics and automation to track performance and reliability across customer workloads and correlate results with lower infrastructure layers.
Stay current with industry trends, emerging technologies, and best practices in distributed systems and AI infrastructure management.
Lead architecture for highly scalable distributed systems and identify and remove performance and scalability bottlenecks.
Engineer fault-tolerant, in-service-upgradable systems and optimize resilience mechanisms such as load shedding, throttling, and rate limiting.
Establish KPIs, advanced telemetry, SLO-aligned durability and availability standards, and replication and synchronization strategies.
Advise on complex production issues; establish operational readiness and standard operating procedure standards; and direct incident response and root-cause analyses.
Architect security controls, drive remediation and compliance, and deliver infrastructure-as-code automation and safe change, patching, update, and rollback strategies.