Principal Platform Software Engineer
About The Position
Oracle Cloud Infrastructure’s Generative AI Service team builds cloud services at the intersection of artificial intelligence and cloud infrastructure. The team develops and operates large-scale services using machine-learning technologies to support customers solving challenging problems. In this role, you will lead development of distributed, scalable, high-performance systems for AI model training and serving, partnering with applied scientists and software engineers. You will examine model structures to improve performance and scalability, build systems using emerging technologies, and diagnose and resolve problems in model training and serving. You may perform other duties as assigned.
Requirements
- Bachelor’s degree in Computer Science or equivalent experience.
- At least 5 years of experience shipping scalable, cloud-native distributed systems.
- Ability to work collaboratively in a cross-functional team environment.
- Proficiency in Python and shell scripting tools.
- Experience with container orchestration technologies such as Kubernetes.
- Experience with production operations and best practices for deploying quality code and troubleshooting issues.
- Ability to communicate technical ideas verbally and in writing, including through technical proposals, design specifications, architecture diagrams, and presentations.
- Strong communication skills and ability to explain complex technical concepts.
- Customer-focused approach and commitment to high engineering standards.
Nice To Haves
- Master’s degree in Computer Science.
- Production experience with cloud computing.
- Experience with large language model serving technologies such as DeepSpeed or FasterTransformer.
- Experience with model training and serving frameworks such as KServe, KubeFlow, or Triton.
- Experience with LLM fine-tuning, especially parameter-efficient fine-tuning technologies and multi-task serving technologies.
- Experience with deep learning frameworks such as PyTorch, JAX, or TensorFlow and architectures, especially Transformers.
- Experience diagnosing, troubleshooting, and resolving issues in AI model training and serving.
- Proven track record delivering large-scale, high-performance model serving or training systems in production.
- Passion for technology and motivation to stay current with machine-learning developments.
Responsibilities
- Lead development of distributed, scalable, high-performance AI model training and serving systems.
- Partner with applied scientists and software engineers to build and deploy solutions.
- Analyze model structure to optimize model performance and scalability.
- Build systems using state-of-the-art technologies.
- Diagnose, troubleshoot, and resolve issues in AI model training and serving.
- Perform other duties as assigned.
Benefits
- Medical, dental, and vision insurance
- Short-term and long-term disability insurance
- Life insurance and AD&D
- Supplemental life insurance
- Health care and dependent care flexible spending accounts
- Pre-tax commuter and parking benefits
- 401(k) Savings and Investment Plan with company match
- Flexible or accrued vacation, depending on employee eligibility and position
- 11 paid holidays
- Paid sick leave
- Paid parental leave
- Adoption assistance
- Employee Stock Purchase Plan
- Financial planning and group legal benefits
- Voluntary auto, homeowner, and pet insurance
- May be eligible for bonus, equity, and compensation deferral
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Principal
