About The Position

Oracle Cloud Infrastructure (OCI) delivers mission-critical cloud services to enterprises worldwide. The Physical Networking Automation and Tooling team builds solutions that improve Network Engineering productivity and efficiency through automation, observability, and actionable insights at hyperscale. As a Principal Core Infrastructure Engineer, you will design, build, and deliver scalable automation frameworks and advanced platforms that use AI/ML to improve operational excellence across OCI’s global network. You will develop event-driven data pipelines that process network signals, including failures and power capabilities, to support anomaly detection, automated remediation, self-healing operations, model training, and real-time inference. The role calls for a software engineer who enjoys solving operational challenges, working with complex distributed systems, and delivering simple, scalable solutions collaboratively. You will provide technical leadership across architecture and engineering standards, build AI-driven decision and agent systems, and establish controls for safely affecting production networks. You will also contribute to system reliability, scalability, security, operational readiness, incident response, and continuous improvement. The role includes mentoring engineers and coordinating work across projects and teams.

Requirements

  • At least 6 to 10+ years of experience in software engineering, network automation, cloud infrastructure, or a related field, including technical leadership of initiatives spanning multiple teams.
  • Bachelor’s degree in Computer Science, Computer Engineering, a related technical field, or equivalent practical experience.
  • Strong programming skills in Java and Python, with experience building and operating production software.
  • Deep experience designing distributed systems, APIs, event-driven data pipelines, workflow systems, or cloud-native services.
  • Experience defining technical architecture and leading complex projects from concept through production operation.
  • Experience with network operations, data center infrastructure, or other large-scale infrastructure systems.
  • Experience applying AI/ML or LLM-based capabilities to operational problems, including evaluating outputs and defining when human review is required.
  • Strong knowledge of Linux, software development practices, CI/CD, observability, and production incident response.
  • Demonstrated ability to influence senior stakeholders, resolve architectural tradeoffs, and mentor experienced engineers.

Nice To Haves

  • Experience developing AI/ML automation workflows with network telemetry, device connectivity, configuration validation, or automated remediation in large-scale networks.
  • Track record of architecting agentic systems, including planner and executor patterns, tool orchestration, agent handoffs, state management, checkpointing, retries, and durable workflows.
  • Hands-on experience integrating agents with enterprise tools through MCP, A2A, or similar protocols, including authentication, tool schemas, context handling, approval gates, and failure handling.
  • Knowledge of AI evaluation, quality, observability, and governance practices for production systems.
  • Proficiency with Kubernetes, containers, and operating cloud-native platforms such as AWS, Azure, Google GCP, or Oracle Cloud in production.
  • Practical use of AI-assisted development tools for coding, testing, review, and debugging.

Responsibilities

  • Lead the design of distributed, event-driven systems that ingest and correlate network failures, performance, power, capacity, topology, and change data at global scale.
  • Architect AI decision systems for anomaly detection, fault diagnosis, capacity forecasting, and remediation.
  • Establish how models and agents use network context, express uncertainty, and escalate decisions to engineers when needed.
  • Direct development of agent workflows that discover and invoke approved capabilities, coordinate tools and services, maintain execution state, and recover safely from partial failures.
  • Establish controls for production network actions, including identity and authorization, approval gates, validation, impact limits, cancellation, rollback, and audit trails.
  • Define evaluation and observability standards for AI-driven capabilities, measuring diagnostic accuracy, false positives, action quality, latency, cost, and operational outcomes before and after deployment.
  • Set architecture and engineering standards across APIs, backend services, data pipelines, workflow execution, testing, deployment, and production operations.
  • Architect and implement scalable distributed systems, including distributed state management, elastic scaling, high-throughput processing, and data-plane platforms for retrieval, storage, and processing.
  • Define scalability requirements and design performance and load testing.
  • Design fault-tolerant systems with redundancy, replication, automatic failover, and resilience to service disruptions and network partitions.
  • Implement approaches for network unreliability, including load-shedding, throttling, and rate-limiting, and design durable systems that adhere to service-level objectives.
  • Define performance indicators and telemetry, and build dashboards, monitoring, and alerting to identify system health issues proactively.
  • Design correctness requirements and complex tests, including fault-injection and brown-out scenarios; implement data replication and synchronization to maintain integrity and availability.
  • Diagnose, debug, and resolve issues in active systems; mentor others in troubleshooting; maintain operational readiness; and participate in operational support rotations and incident investigations.
  • Design systems and maintenance practices that prevent service interruptions and avoid customer maintenance windows when resolving issues.
  • Implement security measures for multi-tenant environments, including encryption and access controls; remediate security gaps; and maintain compliance documentation.
  • Develop and maintain automation scripts and tools, including Infrastructure as Code, and create and follow change management plans for patching, updates, and rollbacks.
  • Coordinate project tasks, timelines, deliverables, and work across multiple projects, providing technical oversight and adjusting plans as needed.
  • Collaborate across the organization to align expectations and deliver solutions that meet stakeholder and customer needs, while seeking and respecting diverse perspectives.
  • Analyze complex issues, document problem-solving strategies, escalate critical unresolved issues, and recommend solutions.
  • Pursue continuous learning, stay current with industry practices, seek feedback, and coach and mentor junior team members.
  • Recommend and help implement process improvements, solicit feedback, and evaluate their impact.
  • Participate in candidate interviews, assess candidates, and provide hiring recommendations.

Benefits

  • Medical, dental, and vision insurance, including expert medical opinion
  • Short-term and long-term disability
  • Life insurance and AD&D
  • Supplemental life insurance for employees, spouses, and children
  • Health care and dependent care Flexible Spending Accounts
  • Pre-tax commuter and parking benefits
  • 401(k) Savings and Investment Plan with company match
  • Paid time off, including flexible or accrued vacation depending on eligibility
  • 11 paid holidays
  • Paid sick leave
  • Paid parental leave
  • Adoption assistance
  • Employee Stock Purchase Plan
  • Financial planning and group legal benefits
  • Voluntary auto, homeowner, and pet insurance
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service