Azure Data Engineer

Valleysoft

About The Position

ValleySoft is a regional IT services provider delivering enterprise technology solutions and process-focused services to clients worldwide. The Azure Data Engineer contributes to reliable enterprise data capabilities by building solutions that connect systems, improve operational performance, and provide business and analytics teams with trusted information. The role focuses on Azure data engineering, enterprise data integration, governance, production support, and continuous improvement of the Intelligent Data Platform.

Requirements

Hands-on experience delivering Azure data engineering solutions in a mid-level individual contributor capacity.
Hands-on experience with Azure Data Factory, Azure Synapse Analytics, Azure Databricks, or equivalent Azure data engineering technologies.
Advanced SQL development skills, with experience using Python and/or Apache Spark for data engineering and data transformation.
Experience integrating SAP data sources into cloud platforms.
Hands-on experience troubleshooting production data pipelines and supporting Azure data platform operations across L1.5–L3 support tiers, including investigating pipeline failures, resolving data load and transformation issues, and monitoring platform performance and operational health.
Strong understanding of data governance, lineage, metadata management, and data quality concepts.
Understanding of CI/CD principles for reliable data engineering delivery.
Experience collaborating with data engineering and other technical teams on data pipelines, integrations, troubleshooting, and production support.
Experience collaborating with business and analytics teams to understand data requirements and ensure data availability and quality.
Fluency in English.

Nice To Haves

3+ years of Azure data engineering experience.
Experience with incident tracking and root-cause analysis to help prevent recurring production issues.
Hands-on experience configuring or implementing Microsoft Purview or other enterprise data cataloging solutions.
Experience implementing cloud-based governance frameworks.
Hands-on experience with deployment pipelines for Azure data workloads, version control, automated testing, and release and change management.
Experience working in Agile or Scrum teams and following development, testing, deployment, and production support processes.
Experience working with SAP teams, enterprise system owners, and stakeholders responsible for source systems and data governance.

Responsibilities

Build, maintain, and optimize Azure-based data pipelines using Azure Data Factory, Azure Synapse Analytics, Azure Databricks, or equivalent Azure data technologies.
Integrate SAP and other enterprise data sources into Azure using Velocity, Theobald, or similar integration technologies.
Design and optimize scalable data ingestion, transformation, and orchestration solutions.
Implement data governance, lineage, cataloging, and metadata management requirements using Microsoft Purview.
Support data quality management processes in collaboration with Pulse.
Provide L1.5–L3 support for data platform incidents, pipeline failures, and production issues.
Monitor data loads, platform performance, and operational health, and resolve issues proactively.
Collaborate with business, analytics, and data engineering teams to deliver reliable data solutions.
Document data architecture, integration patterns, data flows, and operational procedures.
Implement enhancements and operational improvements across the Intelligent Data Platform.
Apply CI/CD practices and data engineering best practices to improve reliability and maintainability.