Lead Data Engineer

PulteGroupAtlanta, GA
36d

About The Position

The Lead Data Engineer is a senior technical leader responsible for architecting, building, and optimizing enterprise-scale data solutions that enable advanced analytics and business insights. This role combines deep technical expertise with leadership skills to guide the data engineering team and ensure alignment with organizational goals. The Lead Data Engineer will drive the modernization of the data platform, including the transition to Microsoft Fabric, while providing scalability, security, and compliance.

Requirements

  • Advanced proficiency in Python for data pipeline development and orchestration
  • Advanced proficiency in SQL for data transformation and performance tuning
  • Strong understanding of Microsoft Fabric architecture and components: Data Lake, Azure Data Factory, PowerBI
  • Hands-on experience in data warehousing, data lakes, data modeling and ETL/ELT methodologies
  • Expertise in data governance, security, and compliance frameworks.
  • Knowledge of DevOps principles and CI/CD for data solutions.
  • Proven ability to lead technical teams and mentor junior engineers.
  • Strong collaboration skills to work across IT and business teams.
  • Requires deep knowledge of area typically obtained through higher education combined with experience.
  • Typically requires a university degree or equivalent experience and minimum 6-8 years of prior relevant experience.

Nice To Haves

  • Experience with PySpark and Databricks a plus
  • Experience with Data Vault data modeling a plus
  • Proficiency in KQL is a plus
  • Experience with real-time data processing and big data technologies.
  • Understanding of advanced analytics and AI/ML integration within data platforms.

Responsibilities

  • Leadership & Strategy Mentor and coach junior data engineers; foster a culture of collaboration and continuous improvement.
  • Define and implement the organization’s data engineering strategy, aligning with business objectives and future growth.
  • Represent the data engineering team in executive discussions and provide strategic guidance on data initiatives.
  • Data Platform Design & Optimization Own the architecture and performance of the enterprise data platform, ensuring reliability and scalability.
  • Lead the design and implementation of complex data pipelines, ETL/ELT processes, and integration strategies.
  • Drive adoption of DataOps practices and automation for efficient data delivery.
  • Modernization & Migration Lead the migration from legacy systems to Microsoft Fabric, ensuring seamless integration and minimal disruption.
  • Evaluate emerging technologies and recommend solutions that enhance data capabilities and cost efficiency.
  • Collaboration & Governance Partner with business stakeholders, data scientists, and analysts to deliver data solutions that meet business needs.
  • Ensure data quality, security, and compliance with regulatory standards.
  • Maintain clear documentation for data processes, models, and tools.
  • Operational Excellence Monitor and optimize database performance; troubleshoot and resolve complex data issues.
  • Provide escalation support for critical production issues, including after-hours when necessary.
  • Recruits, selects, coaches, and develops team members.
  • When direct reports are assigned, conducts performance reviews per HR guidelines.
  • Takes corrective actions, including Performance Improvement Plans and terminations, when necessary.
  • Also manages professional growth and development plans.

Benefits

  • Comprehensive, Flexible and Affordable Healthcare Coverage Options
  • Supplemental Healthcare Coverage Opportunities
  • PTO and Work/Life Benefits
  • Health Advocacy and Wellness
  • Retirement Plan with Company Match
  • Education and Employee Assistance Programs
  • Paid Parental Leave and Adoption Benefits
  • Mortgage Financing Discounts through Pulte Mortgage
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service