Senior Data Engineer
About The Position
As a Data Engineer on the Smart Manufacturing and Automation team, you will design and implement data models that transform raw semiconductor manufacturing data into analytics-ready assets. Using modern lakehouse technologies (Spark, Apache Iceberg, Delta Lake, and OLAP SQL Engines), you will build ETL pipelines that integrate data from shop floor systems spanning ISA-95 Levels 0-4, processing Petabytes of data. This role requires understanding of manufacturing data standards including ISA-95 and SEMI standards such as E90 (Substrate Tracking), E10 (Equipment Reliability, Availability, Maintainability, and Utilization), E116, etc. You will translate these domain concepts into scalable data structures that serve downstream analytics and reporting.
Requirements
- Understanding of manufacturing data standards including ISA-95 and SEMI standards such as E90 (Substrate Tracking), E10 (Equipment Reliability, Availability, Maintainability, and Utilization), E116, etc.
- Experience with Spark, Apache Iceberg, Delta Lake, and OLAP SQL Engines
- Experience building ETL pipelines
- Experience with PySpark and SQL
Responsibilities
- Design and implement data models for manufacturing data domains including equipment performance, substrate tracking, and production metrics, electrical test, etc.
- Build ETL/ELT pipelines using PySpark and SQL to load data into Iceberg and Delta Lake tables with proper historization and auditability
- Develop data transformations aligned with ISA-95 hierarchy and SEMI standards
- Create business vault and information marts that translate raw manufacturing data into analytics-ready data products
- Implement data quality checks and expectations within pipelines to ensure accurate, reliable data
- Collaborate with Manufacturing Engineering and Analytics teams to understand data requirements and deliver solutions
- Document data models, transformation logic, and business rules
- Optimize query performance by optimizing partitioning, clustering, and/or indexing strategies in various database technologies, Delta, and Iceberg.
Benefits
- Competitive pay
- Benefits designed to help you and your family live your best life
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
