Data Engineer
Hudson Manpower•Columbus, OH
4d•Onsite
About The Position
We are seeking an experienced Data Engineer to design, build, and maintain scalable data pipelines and distributed data systems. The ideal candidate will have strong expertise in Python, PySpark, and AWS-based data platforms, along with solid experience in data modeling and ETL frameworks.
Requirements
- Strong proficiency in Python for data processing and pipeline development
- Hands-on experience with Apache Spark (PySpark preferred)
- Solid experience with AWS services such as S3, Glue, EMR, Redshift, Athena, and Lambda
- Strong experience with SQL and relational/non-relational databases
- Knowledge of data modeling, data warehousing concepts, and ETL frameworks
- Experience working with large-scale distributed data systems
- Familiarity with CI/CD pipelines and Git
- Strong analytical, problem-solving, and communication skills
Nice To Haves
- Experience with Airflow or other workflow orchestration tools
- Knowledge of Kafka, Kinesis, or streaming data platforms
- Experience with Docker/Kubernetes
- Exposure to Delta Lake, Iceberg, or Hudi
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Career Level
Mid Level
Education Level
No Education Listed
