Sr. IT Engineer

Advanced Micro Devices, Inc•San Jose, CA

About The Position

Xilinx, Inc., a subsidiary of AMD, Inc., is hiring a Sr. IT Engineer to design, develop, and implement scalable data pipeline architectures using Kafka, Spark, and Flink. The role manages data ingestion, processing, and distribution across multiple data sources and sinks using Apache Iceberg, and collaborates with data scientists and engineers to ensure the system supports business requirements. It also involves optimizing pipeline performance and scalability; implementing data governance and security measures; troubleshooting and monitoring pipelines; resolving failures and exceptions; and keeping the data architecture modern and efficient by staying current with industry trends and technologies. The engineer analyzes and resolves database or system performance, capacity, and scalability issues; plans and directs analysis of business problems with automated systems solutions; models, designs, and constructs large relational databases or data warehouses; creates and optimizes data models for warehouse infrastructure and workflow; and collaborates with technical teams to use new technologies to enhance applications and service infrastructure.

Requirements

Master’s degree or foreign equivalent in Computer Engineering, Computer Science, Information Technology, or a related field.
One year of experience in the job offered or a closely related engineering role.
One year of experience with Object-Oriented Design.
One year of experience with relational databases, including PostgreSQL, MySQL, and SQL.
One year of experience with Ansible or Airflow automation.
One year of experience with Model Training and Deep Learning.
One year of experience with AI.
One year of experience with ML Exploratory Data Analytics Python Packages.
One year of experience with MLOps.

Responsibilities

Design, develop, and implement scalable data pipeline architectures using Kafka, Spark, and Flink.
Manage data ingestion, processing, and distribution across multiple data sources and sinks using Apache Iceberg.
Collaborate with data scientists and engineers to ensure systems support business requirements.
Optimize data pipelines for performance and scalability.
Implement data governance and security measures.
Troubleshoot and resolve data pipeline issues.
Monitor data pipeline performance and address failures or exceptions.
Stay updated on industry trends and technologies to keep the data architecture modern and efficient.
Analyze and resolve database or system performance, capacity, and scalability issues.
Plan, conduct, and direct analysis of business problems with automated systems solutions.
Model, design, and construct large relational databases or data warehouses.
Create and optimize data models for warehouse infrastructure and workflow.
Collaborate with technical teams to use new technologies to enhance applications and service infrastructure.