Sr. Data Engineer – Snowflake, ETL, ADO

Mavensoft Technologies.•Denver, CO
•Remote

About The Position

The Sr. Data Engineer will develop and operate data ingestion, transformation, quality, and analytics pipelines for Colorado’s Statewide Longitudinal Data System (SLDS). The role uses Informatica and Snowflake to ingest agency and third-party data into the SLDS common data model, transform raw feeds into harmonized longitudinal records, and maintain analytics-layer models. The engineer will apply identity-matching logic, resolve matching exceptions, monitor scheduled production feeds, investigate failures, reload corrected or late files, reconcile row counts, and rebuild downstream objects. The position is responsible for data-quality checks, layout-change detection, audit trails, privacy protections, and compliance with applicable requirements such as FERPA, COPPA, ADA, and state statutes. It also includes query and warehouse performance optimization, testing and code review, and release promotion across Development, Test, UAT, and Production using Azure DevOps and Azure Test Plans. Work includes development and validation of CDHE course data feeds and, conditionally, postsecondary demographic, Pell Grant eligibility, disability, and PSAT/SAT assessment data. The engineer will transition operational knowledge from an implementation partner, shadow and co-run existing feeds, and take on production operations after meeting a readiness gate. Additional work includes resolving stabilization defects, maintaining and hardening analytics-layer models, improving metrics, profiling dashboard back-end queries, and collaborating with data architecture, analytics, and operations teams. The engagement is a six-month W-2 contract, with a possibility of extension based on project performance and state funding. The posting describes the work arrangement as Remote/Telecommuting, while also stating that the candidate must reside in Colorado for the duration of the engagement and expressing a strong preference for local/Denver Metro candidates.

Requirements

  • At least 5 years of demonstrated experience building, orchestrating, and optimizing complex ETL/ELT pipelines and transformation logic natively within Snowflake.
  • At least 1 year of hands-on experience with Informatica Cloud Data Governance and Catalog (CDGC) for metadata management, data profiling, cataloging, and automated data-quality validation.
  • At least 1 year of experience using Terraform to provision, configure, and maintain cloud infrastructure and resources.
  • Demonstrated proficiency implementing automated build, test, and release-deployment pipelines using Azure DevOps.
  • Expert proficiency with Git and version-control workflows, including branching strategies, pull requests, automated merge checks, and code reviews.
  • Must currently reside in Colorado for the duration of the engagement.

Nice To Haves

  • Experience with public-sector, longitudinal education, and workforce data systems, such as CDE, CDHE, CDLE, CDEC, or the National Student Clearinghouse.
  • Experience with record linkage, entity resolution, and deterministic or probabilistic identity matching across disparate public records.
  • Familiarity with federal and state student/workforce privacy regulations, including FERPA, COPPA, and cell-suppression standards.
  • Experience authoring and executing structured test plans in Azure Test Plans.
  • Local or Denver Metro residence is strongly preferred.

Responsibilities

  • Design, develop, test, and deploy automated ETL/data pipelines in Informatica and Snowflake to ingest partner-agency and third-party data into the SLDS common data model.
  • Transform raw agency feeds into harmonized, linked longitudinal records and analytics-layer data models, following established naming and modeling standards.
  • Run internal SLDS matching logic to link newly ingested records to longitudinal student and workforce profiles; handle exceptions and cross-agency reconciliation.
  • Operate scheduled production feed runs, monitor jobs, resolve failures, reload late or corrected files, reconcile row counts, and rebuild downstream objects.
  • Implement structural, completeness, de-duplication, referential-integrity, and logic validation checks; detect layout changes and maintain audit trails.
  • Apply data privacy protections, suppression rules, and relevant compliance standards.
  • Optimize Snowflake query execution, warehouse compute, and pipeline performance for cost and latency; tune heavily used models and performance hot spots.
  • Follow release processes across Development, Test, UAT, and Production using Azure DevOps and Azure Test Plans; create and execute test cases, conduct peer code reviews, and maintain release change logs.
  • Ingest and validate annual CDHE postsecondary course-level files and build mappings into the SLDS common data model in collaboration with the implementation partner.
  • When applicable, ingest and validate postsecondary demographic, Pell Grant eligibility, disability classification, and PSAT/SAT assessment data, applying privacy requirements and identity matching.
  • Shadow and co-run existing data-feed operations, then execute feed cycles independently to achieve operational handover.
  • Execute recurring feed schedules, troubleshoot jobs, respond to data inquiries and export requests, and produce run, reconciliation, exception, and data-quality records.
  • Resolve data reliability, run-variation, and de-duplication issues from the stabilization backlog; maintain analytics-layer models, reconcile outputs across environments, and enhance metrics.
  • Profile and tune dashboard back-end models and prepare data sources for Tableau dashboards and de-identified IHE outcome files.
  • Collaborate with the Data Architect on data models and pipeline designs, support the Data Scientist/Visualization Designer with new data sources, and coordinate with Operations Engineers on Snowflake compute, permissions, and CI/CD promotion.
  • Create and maintain pipeline code, transformation objects, de-identified extraction scripts, design and mapping specifications, lineage documentation, runbooks, test records, and release logs.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service