Principal Core Infrastructure Engineer

Oracle•Austin, TX

About The Position

Oracle Cloud Infrastructure (OCI) is hiring a Principal Core Infrastructure Engineer for its Next Gen Network Observability team. The role focuses on building cloud-scale intelligence systems that help OCI networks detect, diagnose, and respond to failures automatically, advancing the vision of self-healing networks through automated network control. The engineer will design and build distributed systems and algorithms that measure, analyze, and explain network behavior across OCI data centers and WAN. The work combines active measurements, network topology, routing state, flow signals, and switch telemetry to identify the origins of latency, congestion, packet loss, and failures. The platform will turn trusted, confidence-scored insights into explainable signals that automated controllers can use to steer traffic, mitigate congestion, isolate faults, and restore network health safely, with policy controls and operational safeguards. The position requires deep systems expertise and hands-on experience with networking, algorithms, telemetry, and distributed computing. The engineer will develop topology-aware observability capabilities, congestion-triangulation and queue-wait reconstruction algorithms, confidence-scored fault localization, and reliable production services operating at cloud scale. The role also includes system architecture, scalability and reliability engineering, production troubleshooting, security and compliance, automation, cross-functional collaboration, technical leadership, and mentoring. Operational support rotations are part of the role.

Requirements

Bachelor’s or Master’s degree in Computer Science, Electrical Engineering, or a related technical field, or equivalent professional experience.
6–10+ years of experience building large-scale distributed systems, network modeling software, network measurement platforms, or telemetry and observability systems.
Strong knowledge of networking fundamentals, including L2/L3 forwarding, routing, switching, BGP, ECMP, data center fabrics, queues and buffers, congestion, and packet loss.
Advanced programming experience in at least one language such as Java, Go, C++, Rust, or Python.
Strong understanding of algorithms, distributed systems, data structures, system reliability, and performance engineering.
Experience with one or more of: active network measurement, streaming telemetry, time-series or stream processing, graph algorithms, statistical inference, probabilistic modeling, or multi-source data fusion.
Familiarity with ML pipelines and models, including data preparation, training and evaluation, deployment, versioning, monitoring, and integration into production systems.
Hands-on experience using AI-assisted development tools and workflows across the software development lifecycle.
Experience building systems that process high-volume, time-sensitive data and operate reliably under incomplete, delayed, or contradictory inputs.
Ability to validate complex algorithms and models against ground truth and translate experimental results into production-quality systems.
Experience designing automated or closed-loop systems with safety controls, rollback mechanisms, and human oversight.
Track record of technical leadership, mentorship, and delivery across complex, cross-functional projects.
Experience operating production systems in cloud-scale or large enterprise environments.
Ability to design, implement, troubleshoot, and operate scalable, reliable distributed systems and production services.
Ability to participate in operational support rotations and incident response.

Responsibilities

Design, implement, and maintain critical components of OCI’s Next Gen Network Observability platform.
Build scalable, topology-aware measurement, analytics, and inference systems for data center and WAN networks.
Develop algorithms for path reconstruction, congestion triangulation, queue-wait estimation, fault localization, root cause analysis, and customer-impact attribution.
Ingest and correlate signals from active probes, routing and topology systems, switches, ASICs, queues, flows, logs, metrics, events, and streaming telemetry.
Produce ranked, confidence-scored diagnoses that localize problems to the responsible path, link, queue, device, or shared network resource.
Convert observability insights into safe, explainable, controller-consumable signals for automated traffic steering, congestion mitigation, fault isolation, and service recovery.
Design control-loop safeguards to account for uncertainty, stale or conflicting evidence, policy constraints, and unintended interactions between automated actions.
Design systems that remain accurate and available despite missing or delayed telemetry, topology changes, clock uncertainty, and partial network failures.
Build validation frameworks to measure detection and localization time, accuracy, false-positive rates, confidence calibration, corrective-action effectiveness, and resilience across failure scenarios.
Apply AI-assisted software development lifecycle practices across design, implementation, testing, debugging, code review, documentation, and operational analysis while maintaining engineering, security, and quality standards.
Write robust, well-tested production code in languages such as Java, Go, C++, Rust, or Python.
Own and resolve complex production issues involving distributed services, large-scale telemetry pipelines, real-time network state, and automated control workflows.
Lead design and code reviews, maintaining standards for correctness, scalability, reliability, safety, and operational readiness.
Mentor engineers and establish strong engineering practices for network measurement, analytics, inference, and automated remediation systems.
Partner with network controller, SRE, hardware, network operations, security, AI/ML, and product teams to deliver closed-loop capabilities end to end.
Lead development and implementation, and begin architecting, scalable distributed-system components; define scalability requirements and ensure designs meet them.
Optimize code and systems for large-scale data processing and high throughput; design for elasticity and leverage data-plane platforms for data retrieval, storage, and processing.
Design performance and load testing.
Build fault-tolerant systems capable of in-service updates using redundancy, replication, and automatic failover; design for service disruptions and network partitions.
Implement approaches to handle network unreliability, including load-shedding, throttling, and rate-limiting, and design durable components that adhere to service level objectives.
Define KPIs and telemetry, and build dashboards, monitoring systems, and alerting mechanisms for system health.
Design and implement functional and correctness requirements, complex fault-injection and brown-out test scenarios, and data replication and synchronization techniques.
Diagnose, debug, and resolve issues in active systems; mentor others in troubleshooting and root cause investigations.
Implement strategies to prevent service interruptions and maintenance windows for customers and users; meet operational-readiness expectations and participate in operational support rotations.
Implement security measures for multi-tenant environments, including encryption and access controls; remediate security gaps and maintain compliance and documentation.
Develop and maintain automation scripts and tools, such as Infrastructure as Code, and create and follow change-management plans for patching, updates, and rollbacks.
Coordinate moderately complex tasks, timelines, deliverables, and work across projects; provide technical oversight and adjust plans as needed.
Collaborate across the organization, align on expectations, and ensure solutions meet stakeholder and customer needs while supporting inclusivity.
Analyze complex issues, identify solutions, escalate unresolved or critical issues with assessments and potential solutions, and document problem-solving strategies.
Pursue learning, stay current with industry trends and practices, seek feedback and training, and coach and mentor junior team members.
Recommend and collaborate on process improvements, solicit feedback, and evaluate their impact on stakeholders.
Participate in candidate interviews, assess candidates, and provide hiring recommendations.

Benefits

Medical, dental, and vision insurance, including expert medical opinion.
Short-term and long-term disability insurance.
Life insurance and AD&D.
Supplemental life insurance for employees, spouses, and children.
Health care and dependent care flexible spending accounts.
Pre-tax commuter and parking benefits.
401(k) Savings and Investment Plan with company match.
Paid time off, including flexible or accrued vacation depending on employee eligibility and position status.
11 paid holidays.
Paid sick leave.
Paid parental leave.
Adoption assistance.
Employee Stock Purchase Plan.
Financial planning and group legal benefits.
Voluntary auto, homeowner, and pet insurance.
May be eligible for bonus, equity, and compensation deferral.