Azure Data Engineer - Irving, TX

QTech•Irving, TX

4d•Onsite

About The Position

Azure Data Engineer with strong development experience in Python and containerized environments. You'll be building modular ETL pipelines using APIs and SQL in an Azure-native setup, with a strong focus on data governance, secure service account usage, and automation. This role is perfect for someone passionate about scalable architecture and responsible data practices.

Requirements

5+ years of hands-on experience in data engineering with Python development
Strong in Python (ETL scripting, logging, error handling)
Strong in SQL development and performance tuning
Strong in Azure ecosystem: AKS, Blob, Key Vault, Service Principles, Azure Monitor, etc.
Strong in REST APIs and ingestion from diverse sources
Strong in Docker and container lifecycle management
Strong in Service account management and data security enforcement
Familiar with Terraform, Git, and modern CI/CD best practices
Understanding of data governance, PII/PCI classification, and compliance (SOX, GDPR, etc.)

Responsibilities

Design and implement data ingestion pipelines using Python targeting JDBC/ODBC/API/Batch sources
Create and orchestrate Apache Airflow DAGs using modular/factory-based patterns
Build containerized solutions using Docker, with local dev setups and AKS-based deployment strategies
Work with SQL Server (MI)to extract metadata, define classifications, and manage access control
Use Microsoft Purview for classification, tagging, and metadata management
Configure and manage Azure resources(Blob Storage, Key Vault, Azure Monitor, Functions, AKS)
Develop and deploy using CI/CD pipelines via Azure DevOps
Apply access controls using service accounts, adhering to minimum privilege principles and masking policies
Analyze audit logs and build dashboards for usage tracking and masking compliance
Write reusable code and documentation to support automation and knowledge transfer