Senior Data Engineer - PySpark

AmeriLife
2d$135,000 - $155,000

About The Position

The Senior Data Engineer will design and develop scalable data pipelines that support analytics, reporting, and AI initiatives across the enterprise data platform.

Requirements

  • Strong expertise in Python and SQL
  • Experience with PySpark, Spark, and Databricks
  • Experience building ETL/ELT pipelines
  • Strong understanding of data transformation and performance optimization
  • Strong communication and teamwork skills
  • Ability to collaborate across engineering and analytics teams
  • Passion for building scalable data systems

Nice To Haves

  • Databricks certification
  • AWS or Azure certification

Responsibilities

  • Build and maintain PySpark pipelines in Databricks
  • Develop scalable data ingestion and transformation workflows
  • Implement data validation and quality checks
  • Optimize Spark workloads and processing performance
  • Work closely with architecture and analytics teams

Benefits

  • PTO
  • medical
  • dental
  • vision
  • retirement savings
  • disability insurance
  • life insurance
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service