About The Position

We are looking for a Senior Data Governance and Quality Engineer to play a critical role in maintaining the integrity, accuracy, and reliability of data throughout our enterprise data ecosystem. This role involves designing and implementing scalable data quality frameworks, driving governance initiatives, and collaborating with cross-functional teams to operationalize high standards of data quality. The ideal candidate will possess a strong understanding of data governance principles, data lifecycle management, and end-to-end data transformation processes, along with hands-on experience in deploying enterprise-level data quality solutions. As a member of our engineering team, you will be responsible for coaching, mentoring, managing, and leading team members within an agile environment.

Requirements

  • Bachelor’s or Master’s degree in Computer Science, Data Engineering, Information Systems, or a related field.
  • Minimum 5+ years of experience in Data Quality, Data Governance, or Data Engineering roles.
  • Strong hands-on experience with Databricks, PySpark, Python, and SQL.
  • Proficiency in SQL, Python, and modern data pipeline tools.
  • Familiarity with data governance and quality tools (e.g., Collibra, Informatica, Alation, Great Expectations).
  • Experience working with cloud platforms (AWS, Azure, or GCP).
  • Strong understanding of BI and reporting tools such as Power BI, Tableau.

Nice To Haves

  • In-depth knowledge of data lifecycle management, data lineage, and metadata management.
  • Awareness of current and emerging data governance and data management best practices.

Responsibilities

  • Develop, implement, and sustain a comprehensive data quality framework to systematically monitor, validate, and enhance data accuracy and consistency throughout all systems.
  • Develop and maintain scalable data quality solutions utilizing Databricks and Apache Spark, primarily leveraging PySpark.
  • Operationalize the enterprise data governance framework, aligning with stakeholder needs related to data quality, access controls, compliance, privacy, and security.
  • Identify and address data anomalies, inconsistencies, duplicates, and missing values.
  • Conduct periodic audits to ensure ongoing data integrity.
  • Partner with data engineers, architects, product teams, and analysts to define data quality requirements and ensure alignment with business objectives.
  • Develop clear and actionable dashboards and reports (e.g., Power BI, Salesforce) to visualize data quality trends, KPIs, and issue resolution progress.
  • Collaborate with data stewards and product owners to investigate and resolve data quality issues, establishing sustainable remediation processes.
  • Apply strong understanding of data models (e.g., star schema, snowflake, data marts, data lakes) to evaluate and improve data structures and flows.
  • Take ownership of assigned initiatives, break complex challenges into manageable components, and execute plans effectively with minimal supervision.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service