Senior Data Engineer – Python, PySpark & AWS

SCI SOLUTIONS GLOBAL • Plano, TX

3d

About The Position

We are seeking a hands-on Senior Data Engineer with strong Python, PySpark, and AWS experience to develop and maintain scalable data pipelines and distributed data processing solutions. The ideal candidate will have experience supporting production data engineering workloads, cloud infrastructure, and data orchestration.

The position is located in Plano, Texas, and relocation is open. Applicants must be available for W-2 employment; C2C, 1099, and third-party resumes are not accepted. The client is accepting only U.S. citizens, Green Card holders, and Green Card EAD holders; other visa types are not accepted.

Requirements

• Strong hands-on Python and PySpark experience.
• Experience with big-data processing and production data pipelines.
• AWS experience with S3, EMR, and Lambda.
• Working knowledge of Terraform.
• Familiarity with Kafka, MQ messaging, REST APIs, Java, and Cassandra.
• Experience with Airflow, Control-M, or other workflow scheduling tools.
• Must be eligible for W-2 employment; C2C, 1099, and third-party resumes are not accepted.
• Must be a U.S. citizen, Green Card holder, or Green Card EAD holder; other visa types are not accepted.

Nice To Haves

• Databricks experience.
• Exposure to machine-learning workflows.

Responsibilities

• Develop, test, and maintain ETL/ELT data pipelines using Python and PySpark.
• Build and support big-data processing solutions on AWS using S3, EMR, and Lambda.
• Implement infrastructure automation using Terraform.
• Develop data integrations using REST APIs, Kafka, and MQ messaging.
• Support data storage and retrieval using Cassandra.
• Orchestrate and monitor workflows using Airflow, Control-M, and native schedulers.
• Troubleshoot pipeline failures and optimize performance, reliability, and data quality.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed