Azure Data Engineer

Novalink Solutions LLCJackson, MS
19h

About The Position

Design, build, and maintain Azure-based data pipelines using Synapse Analytics to support MSIS and related education systems.  Develop and optimize ETL/ELT processes to ingest, transform, and validate K–12 education data from multiple source systems.  Implement and manage data models, views, and performance tuning in Azure SQL and Synapse environments.  Monitor, troubleshoot, and resolve data pipeline and performance issues.  Document data flows, transformations, and technical standards.  Collaborate with analysts, reporting teams, and vendors to deliver timely, accurate data for federal and state reporting A minimum of 5 years of experience in the following:  Advanced development and orchestration of data pipelines using Azure Data Factory/Synapse or similar cloud based platforms. (pipelines, triggers, integration runtimes, parameterization). 2 4. Scoring Method Criteria Score Percentage Must equal 100% Cost 30 Required Skills/Experience 25 Preferred Skills/Experience 10 Candidate Interview 35  Data warehousing and analytics engineering using Azure Synapse Analytics or similar cloud based platforms (dedicated and serverless SQL pools).  Strong T-SQL skills, including query optimization, indexing strategies, stored procedures, and performance tuning.  Implementation of ETL/ELT frameworks, including incremental loads, CDC patterns, and error handling.  Integration of structured and semi-structured data (CSV, JSON, XML) from APIs, SFTP, and vendor systems.  Source control and deployment practices using Azure DevOps, Git, and CI/CD pipelines.

Requirements

  • A minimum of 5 years of experience
  • Advanced development and orchestration of data pipelines using Azure Data Factory/Synapse or similar cloud based platforms. (pipelines, triggers, integration runtimes, parameterization).
  • Data warehousing and analytics engineering using Azure Synapse Analytics or similar cloud based platforms (dedicated and serverless SQL pools).
  • Strong T-SQL skills, including query optimization, indexing strategies, stored procedures, and performance tuning.
  • Implementation of ETL/ELT frameworks, including incremental loads, CDC patterns, and error handling.
  • Integration of structured and semi-structured data (CSV, JSON, XML) from APIs, SFTP, and vendor systems.
  • Source control and deployment practices using Azure DevOps, Git, and CI/CD pipelines.

Nice To Haves

  • Experience with student information management systems and K-12 data and reporting
  • Experience with Common Education Data Standards (CEDS)
  • Azure Data Engineer Associate certification

Responsibilities

  • Design, build, and maintain Azure-based data pipelines using Synapse Analytics to support MSIS and related education systems.
  • Develop and optimize ETL/ELT processes to ingest, transform, and validate K–12 education data from multiple source systems.
  • Implement and manage data models, views, and performance tuning in Azure SQL and Synapse environments.
  • Monitor, troubleshoot, and resolve data pipeline and performance issues.
  • Document data flows, transformations, and technical standards.
  • Collaborate with analysts, reporting teams, and vendors to deliver timely, accurate data for federal and state reporting
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service