Senior Machine Learning Engineer, Accelerated Apache Spark

NVIDIA•Santa Clara, CA

9d•$224,000 - $356,500

About The Position

NVIDIA is seeking a Machine Learning Engineer to join its GPU-accelerated Apache Spark team. Apache Spark is a widely used data-processing engine for large-scale ETL, SQL, and machine learning and deep learning training and inference. NVIDIA GPUs can help accelerate or reduce the cost of large Apache Spark applications. In this role, you will work with the open-source community to accelerate Apache Spark with GPUs and apply current machine learning and AI methods to help enterprises migrate Spark workloads to GPUs at scale.

Requirements

Bachelor’s, master’s, or PhD degree, or equivalent experience, in Machine Learning, Data Science, Computer Science, or a closely related field.
12+ years of professional experience designing, implementing, and productionizing high-quality ML/DL solutions.
3+ years of experience as a technical lead in ML model development.
At least 2 years of hands-on experience with large-scale data processing platforms such as Apache Spark.
Proven ability to use modern tooling and sound techniques to craft, deploy, and maintain machine learning models.
Excellent Python programming skills and experience with Python data science libraries such as NumPy, pandas, scikit-learn, SciPy, PyTorch, and TensorFlow.
Deep experience with sophisticated machine learning methodologies, including LLM/GenAI, reinforcement learning, and adaptive online ML systems.
Strong expertise in feature engineering, feature importance assessment, and developing boosted tree model solutions such as XGBoost.

Nice To Haves

Understanding of Apache Spark’s internal workings and architecture.
Familiarity with NVIDIA GPUs and CUDA.
Experience coding in Scala, Java, and/or C++.

Responsibilities

Design and implement machine learning solutions for performance prediction and optimization of GPU-accelerated enterprise Apache Spark workloads.
Develop advanced algorithms and adaptive systems to continuously improve the performance of Apache Spark workloads on GPUs.
Develop AI-based agents and tools to help diagnose system issues and optimize applications.
Collaborate with key partners and customers on deploying complex machine learning solutions in varied environments.
Maintain deep domain expertise by keeping current with published advances in machine learning systems and algorithms.
Provide technical mentorship and leadership in data science and machine learning to a team of engineers.