Machine Learning Engineer-Model Serving Infrastructure

ByteDance • Seattle, WA

85d

About The Position

ByteDance is seeking a Machine Learning Engineer - Model Serving Infrastructure to join our AML team. The mission of our team is to push the next-generation AI infrastructure and recommendation platform for ads ranking, search ranking, live & ecom ranking. This role is crucial in supporting and advancing our mission, which drives substantial impact on the core businesses of the company. As part of our team, you will be involved in designing and implementing distributed inference infrastructure, building monitoring tools, and collaborating with product teams to provide solutions that meet their requirements.

Responsibilities

• Design and implement distributed inference infrastructure for feeds, ads, and search ranking models.
• Build monitoring and management tools to oversee the reliability and scalability of online inference servers.
• Triage system inefficiencies and bottlenecks to improve system performance.
• Build tools to analyze bottlenecks and sources of instability, and design and implement solutions.
• Collaborate with product teams to provide general solutions to meet their requirements.

What This Job Offers

• Industry: Publishing Industries
• Number of Employees: 5,001-10,000 employees