Lead Senior Python ETL Developer

CADEXAnkeny, IA
18hRemote

About The Position

We are seeking a Senior ETL Python Developer to architect and build high-performance data pipelines that power critical business insights. Moving beyond traditional ETL, you will design scalable Python-based frameworks to process and transform complex datasets, optimize query performance, and implement rigorous data quality controls. This is a hands-on architectural role requiring deep expertise in Python, SQL, and modern data engineering practices.

Requirements

  • 5+ years of professional experience in Data Engineering, with at least 2 years in a lead or senior capacity (Team Lead, Tech Lead, or Manager).
  • Advanced proficiency in Python: Demonstrated ability to write highly optimized, maintainable code.
  • Deep experience with Pandas for data manipulation is mandatory.
  • Extensive experience designing and maintaining ETL/ELT workflows handling high-volume, large-scale datasets.
  • Strong expertise in SQL and database systems (MySQL, PostgreSQL, or NoSQL variants).
  • Proven experience building or managing REST APIs / microservices to support data integration.
  • Deep understanding of the software development lifecycle, including CI/CD pipelines, unit/integration testing, and Git workflows.

Nice To Haves

  • Working knowledge of JavaScript for building internal tools or custom API integrations.
  • Experience with cloud platforms (GCP or Azure).
  • Familiarity with containerization and orchestration (Docker, Kubernetes).
  • Knowledge of modern data warehousing solutions (BigQuery, Snowflake, or

Responsibilities

  • Design, develop and maintain ETL pipelines and data processing workflows
  • Write clean, efficient and testable Python code to support data ingestion,transformation and integration
  • Collaborate closely with data engineers, analysts and other stakeholders to define data requirements and optimize pipeline performance
  • Implement monitoring, logging and alerting to ensure pipeline reliability
  • Optimize and refactor legacy ETL processes for scalability and improved performance
  • Participate in code reviews, provide technical guidance and mentor junior developers
  • Troubleshoot production issues and contribute to root-cause analysis and continuous improvement efforts.
  • Guide technical direction, enforce code standards, provide mentorship, and ensure delivery ownership
  • Design, build, and optimize complex ETL/ELT pipelines capable of handling massive datasets.
  • Define the technical roadmap for migrating legacy processes to modern, scalable Python frameworks.
  • Write and review clean, modular, production-ready Python code.
  • Leverage libraries such as Pandas for high-performance data validation, cleansing, and transformation.
  • Implement rigorous frameworks for data validation and quality control, ensuring accuracy and consistency across petabyte-scale environments.
  • Lead code reviews, enforce software engineering best practices (testing, CI/CD, version control), and provide direct technical mentorship to junior and senior developers.
  • Partner with Data Architects, Analysts, and Product stakeholders to define data requirements and optimize query performance against relational/NoSQL databases (MySQL, BigQuery, etc.).
  • Oversee monitoring, logging, and alerting strategies to ensure 99.9% pipeline reliability.
  • Lead root-cause analysis and troubleshooting for critical production incidents.
  • Take full ownership of project delivery timelines.
  • Guide the team in breaking down complex epics into manageable sprints while maintaining velocity and quality.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service