Data Engineer

Intone NetworksMcLean, VA
40d

About The Position

Data Engineer Key Responsibilities: • Design, build, and optimize ETL pipelines using Python, PySpark, and Spark • Develop scalable data solutions leveraging Databricks, AWS Glue, EMR, and S3 • Collaborate with cross-functional engineering and analytics teams to implement best practices in data ingestion, transformation, and storage • Support data quality, performance tuning, and process automation across the data lifecycle • Work in Agile environments with CI/CD and version control tools

Requirements

  • 3 to 7 plus years of experience in data engineering, preferably in cloud-based environments
  • Strong proficiency in Python, PySpark, Spark, and SQL
  • Hands-on experience with AWS data services (S3, Glue, EMR, Redshift, Lambda, Athena)
  • Experience with Databricks or equivalent data lake platforms
  • Familiarity with modern DevOps practices (Git, Jenkins, Terraform, Airflow, etc.)

Responsibilities

  • Design, build, and optimize ETL pipelines using Python, PySpark, and Spark
  • Develop scalable data solutions leveraging Databricks, AWS Glue, EMR, and S3
  • Collaborate with cross-functional engineering and analytics teams to implement best practices in data ingestion, transformation, and storage
  • Support data quality, performance tuning, and process automation across the data lifecycle
  • Work in Agile environments with CI/CD and version control tools
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service