Contract Data Engineer

Codetech • Malvern, PA

23h

About The Position

The Data Engineer analyzes complex business problems, identifies and documents information and requirements, and develops technical solutions. The role troubleshoots and optimizes new and existing ETL packages and builds data processing applications using Spark, Python, and PySpark. It also involves developing SQL and AWS cloud infrastructure, including CloudFormation templates and server-level architecture frameworks.

Requirements

• Strong analytical and problem-solving skills and the tenacity to overcome technical challenges.
• Experience with AWS EMR, AWS Glue, AWS Athena, AWS CloudFormation, AWS IAM, AWS S3, and AWS SNS.
• Experience with Tableau and Hive.
• Experience with CI/CD pipeline tools such as Bamboo, Bitbucket, or GitHub.
• Experience with Test Driven Development.
• Experience building Spark data processing applications using Python and PySpark.
• SQL development experience; SQL is listed as a required skill.

Nice To Haves

• Experience with Unix scripting and Linux configuration.

Responsibilities

• Analyze complex business problems and track down required information.
• Document requirements and develop technical solutions.
• Troubleshoot and optimize new and existing ETL packages.
• Build Spark data processing applications using Python and PySpark.
• Develop SQL solutions.
• Build AWS CloudFormation templates and server-level architecture frameworks in AWS.

What This Job Offers

• Education Level: No Education Listed