Data Lakehouse Engineering Lead

U.S. BankIrving, TX
3dHybrid

About The Position

At U.S. Bank, we’re on a journey to do our best. Helping the customers and businesses we serve to make better and smarter financial decisions and enabling the communities we support to grow and succeed. We believe it takes all of us to bring our shared ambition to life, and each person is unique in their potential. A career with U.S. Bank gives you a wide, ever-growing range of opportunities to discover what makes you thrive at every stage of your career. Try new things, learn new skills and discover what you excel at—all from Day One. Job Description Summary: As the Databricks Engineering Lead, this role will be required to take ownership of designing, building, and optimizing enterprise-scale data platforms using Databricks. This role plays a key part in creating a modern data ecosystem that powers advanced analytics, AI/ML, and real-time processing across multi-cloud environments. This role will bring deep expertise in Databricks, Spark, and cloud technologies like AWS and Azure, combined with strong leadership skills to guide engineering teams. Focus will be on delivering secure, scalable, and cost-efficient solutions that align with business goals and drive measurable impact.

Requirements

  • 8+ years in data engineering or related roles, with 3+ years in Databricks platform leadership.
  • Expertise in PySpark, Spark SQL, and cloud services (AWS/Azure).
  • Strong understanding of data architecture, governance, and security frameworks.
  • Hands-on experience with CI/CD tools (GitLab, Jenkins) and infrastructure-as-code (Terraform).

Responsibilities

  • Define and execute the technical roadmap for Databricks-based data platforms, ensuring alignment with enterprise architecture and business priorities.
  • Design and implement robust ETL/ELT pipelines using PySpark and Spark SQL.
  • Optimize cluster performance, job orchestration, and resource utilization for efficiency and cost control.
  • Implement data governance policies, enforce access controls, and ensure compliance with regulatory standards using tools like Unity Catalog.
  • Integrate Databricks with AWS/Azure services (e.g., S3, EC2, Glue) and manage DBU consumption through autoscaling and cost optimization strategies.
  • Champion Agile methodologies and ensure disciplined use of Jira for backlog management, sprint planning, and progress tracking.
  • Stay ahead of emerging technologies and Databricks features.
  • Lead proof-of-concepts for new capabilities and drive automation for data workflows.
  • Guide and mentor engineering teams, conduct code reviews, and enforce best practices.
  • Foster collaboration and continuous improvement across cross-functional teams.
  • Excellent stakeholder management and communication skills.
  • Ability to lead large-scale, cross-functional projects in an Agile environment.
  • Familiarity with Unity Catalog, Delta Live Tables, and advanced Databricks features.

Benefits

  • Healthcare (medical, dental, vision)
  • Basic term and optional term life insurance
  • Short-term and long-term disability
  • Pregnancy disability and parental leave
  • 401(k) and employer-funded retirement plan
  • Paid vacation (from two to five weeks depending on salary grade and tenure)
  • Up to 11 paid holiday opportunities
  • Adoption assistance
  • Sick and Safe Leave accruals of one hour for every 30 worked, up to 80 hours per calendar year unless otherwise provided by law

Stand Out From the Crowd

Upload your resume and get instant feedback on how well it matches this job.

Upload and Match Resume

What This Job Offers

Job Type

Full-time

Career Level

Mid Level

Education Level

No Education Listed

Number of Employees

5,001-10,000 employees

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service