About The Position

Build, test, and support reliable data pipelines, datasets, and data products with guidance from senior engineers. The role turns business and technical requirements into working data solutions for reporting, analytics, AI/ML, and business operations. The Data Engineer II follows team standards, learns approved tools and patterns, supports production work, and uses approved AI tools while carefully reviewing their output.

Requirements

  • Bachelor’s degree in a related field, or equivalent experience.
  • At least 3 years in data engineering, software engineering, data integration, or a similar technical role.
  • Working experience with SQL and Python and exposure to cloud data tools.
  • Experience building or supporting data pipelines, ETL/ELT jobs, datasets, or data products.
  • Basic understanding of data quality, testing, monitoring, source control, and production support practices.
  • Experience or training in AI-assisted development tools, with the ability to review and test AI-generated work.

Nice To Haves

  • Experience with Databricks, Spark, dbt, Airflow, Azure, or AWS.
  • Exposure to medallion architecture, semantic layers, Dataiku, data catalogs, or data observability tools.
  • Experience supporting analytics, reporting, AI/ML, or operational data use cases.

Responsibilities

  • Build, test, deploy, and support batch and streaming data pipelines using Databricks, Spark, SQL, Python/PySpark, dbt, Airflow, or similar tools.
  • Help build reliable data products for reporting, analytics, AI/ML, and business operations.
  • Work with senior engineers to implement Bronze, Silver, and Gold data layers and follow medallion architecture patterns.
  • Build and maintain data ingestion, transformation, and consumption jobs for internal systems and external data sources.
  • Improve pipeline performance, storage use, and compute cost with guidance from senior engineers.
  • Document solutions, job schedules, dependencies, and support steps.
  • Add automated tests, data-quality checks, monitoring, alerts, and clear error handling.
  • Help ensure data is fresh, accurate, and available to business users and downstream systems.
  • Troubleshoot production issues, identify causes, and implement lasting fixes with guidance when needed.
  • Support service levels, job failures, incident response, and routine production maintenance.
  • Use source control, code review, CI/CD, and release practices to move changes safely into production.
  • Follow access, encryption, privacy, retention, metadata, lineage, and stewardship requirements.
  • Handle data securely and follow approved patterns for sensitive data.
  • Work with Security, Privacy, Governance, Architecture, and Platform teams when standards are unclear.
  • Capture basic metadata and lineage details so data products can be understood, trusted, and reused.
  • Learn and use approved AI tools, including Windsurf, Devin, and Databricks Genie where appropriate, for coding, testing, troubleshooting, documentation, and analysis.
  • Use AI tools to draft code patterns, explain errors, create test ideas, and speed up routine engineering work.
  • Review and test AI-generated work before using it, and ask a senior engineer for help when output is unclear.
  • Follow team standards for security, privacy, code review, and responsible AI use.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service