Senior Data Engineer - EDA Datacenter Analytics and Observability

NVIDIA•Westford, MA

3d•$184,000 - $356,500•Hybrid

About The Position

NVIDIA’s Hardware Infrastructure organization is seeking a Senior Data Engineer to build and evolve analytics-ready data platforms supporting observability, reliability analysis, and capacity forecasting for EDA datacenters. The role transforms large-scale observability and telemetry data into trusted, well-modeled datasets for data scientists, analysts, and engineers working across global CPU and GPU compute clusters. The engineer works closely with observability, infrastructure, and data science teams to ensure data from EDA workloads and datacenter hardware is high quality, accessible, and optimized for analytical and predictive use cases.

Requirements

Master’s degree preferred, or bachelor’s degree in Computer Science or a related field, or equivalent experience.
At least 10 years of experience designing, building, and operating large-scale data pipelines and data platforms for distributed systems or infrastructure data.
Proficiency in Python and SQL, including experience supporting analytical and exploratory workloads.
Hands-on experience with distributed data processing frameworks such as Spark or similar technologies.
Familiarity with observability and telemetry data, including metrics, logs, traces, and time-series data.
Experience designing data models and schemas that support flexible analysis and forecasting.
Ability to own data engineering initiatives and drive them end-to-end in collaboration with cross-functional partners.
Experience implementing data quality, validation, and monitoring for analytics pipelines.
Strong communication and collaboration skills, particularly with engineering and infrastructure teams.
Adaptability in fast-paced environments with evolving analytical and operational needs.

Nice To Haves

Experience supporting datacenter infrastructure analytics, hardware reliability programs, or workload performance analysis.
Familiarity with EDA workflows, HPC environments, or GPU-accelerated compute platforms.
Experience integrating or operating observability stacks such as Prometheus, Grafana, Elastic/OpenSearch, Kafka, Spark, or similar tools.
Background in large-scale distributed systems or data platforms.
A track record of improving analytics velocity and reliability through better data foundations.

Responsibilities

Design, build, and maintain analytics-focused data pipelines that ingest, transform, and curate observability data from EDA datacenters.
Develop reliable ingestion pipelines for metrics, logs, traces, and hardware health telemetry generated by large-scale CPU and GPU clusters.
Partner with observability engineers to integrate data from tools such as Prometheus, Grafana, Elastic/OpenSearch, and Spark-based platforms into unified analytical datasets.
Model and organize data to support exploratory analysis, reliability modeling, forecasting, and long-term trend analysis.
Build and optimize batch and streaming workflows for near-real-time and historical analytics.
Implement data quality checks, validation frameworks, and monitoring to ensure analytical accuracy and consistency.
Define data retention, aggregation, and enrichment strategies that balance analysis needs, system performance, and storage costs.
Improve data discoverability, documentation, and usability to enable self-service analytics.
Collaborate with data scientists and analysts to understand analytical requirements and evolve datasets for new models and insights.
Continuously improve pipeline scalability, reliability, and performance as datacenter footprint and workload complexity grow.