Azure Data Architect I

InComm PaymentsAtlanta, GA
2dRemote

About The Position

We are seeking a technically strong Azure Data Architect with deep hands-on expertise in architecting and building enterprise-grade Azure data platforms. This role focuses on designing and optimizing scalable data solutions—particularly in multi‑tenant Azure environments—while closely partnering with business teams to translate requirements into modern, efficient, and maintainable data products. The ideal candidate brings strong knowledge in Azure Synapse (Dedicated & Serverless SQL pools), ADLS Gen2, Spark/PySpark Notebooks, Azure Data Factory, Logic Apps, Automation Accounts, and related Azure-native data services. They will be responsible for engineering robust ingestion, transformation, and orchestration pipelines; implementing sound data governance practices; and ensuring data environments are secure, performant, and scalable. This role blends deep technical acumen across modern data architectures with the ability to collaborate cross-functionally, ensuring the Azure platform delivers measurable business value through trusted, high-quality data pipelines and analytics capabilities. This is a remote US-based position. The majority of the team is on the East Coastof the United States, so Eastern time zone business hours are preferred.

Requirements

  • Strong experience designing and building Azure-based data platforms, including ADLS Gen2, Synapse, ADF, Event Hub, Azure SQL, Databricks, or Fabric.
  • Extensive hands-on experience building enterprise-scale Data Lakes, ingestion frameworks, orchestration pipelines, and distributed compute solutions.
  • Strong proficiency in Python, PySpark, SQL, and Spark-based processing frameworks.
  • Deep understanding of Azure networking, identity, security, RBAC, and managed identities in a multi-tenant environment.
  • Experience building and optimizing data pipelines for batch, near-real-time, and streaming workloads.
  • Strong knowledge of SDLC, DevOps, CI/CD (Azure DevOps), IaC (ARM/Bicep/Terraform), environment promotion strategies, and automated testing.
  • Hands-on experience with Azure Monitor, Log Analytics, Alerts, and operational frameworks.
  • Familiarity with Power BI, Synapse SQL, and serverless analytics for BI workloads.
  • Understanding of cloud cost-optimization and architectural tradeoffs in Azure.
  • Relevant certifications such as Azure Data Engineer Associate, Azure Solutions Architect, or equivalent experience.
  • Bachelor’s degree in computer science, Engineering, or related technical field—or equivalent professional experience.
  • 10+ years in Data & Analytics engineering across enterprise-scale systems.
  • 6+ years architecting or engineering Azure data platforms, including Synapse, ADF, Azure SQL, or Databricks.
  • Experience with operational engineering practices including:
  • Git & version control
  • CI/CD (Azure DevOps)
  • Infrastructure as Code (Bicep/Terraform/ARM)
  • Automated testing
  • Release management
  • Monitoring, logging, and operational support
  • Strong understanding of modern data architectures, including Data Lakes, CDC frameworks, Delta Lake, data warehousing design, and distributed processing.

Nice To Haves

  • Familiarity with Azure AI Services, ML Ops workflows, or integrating ML workloads with Synapse/Databricks.
  • Comfortable implementing data governance, lineage, quality, and cataloging strategies using Purview.
  • Microsoft Certified Azure Data Engineer Associate or Azure Architect.

Responsibilities

  • Design, architect, and implement a scalable, multi‑tenant Azure Data Lake and analytics ecosystem using ADLS Gen2, Synapse Analytics, SQL Dedicated Pool, Serverless SQL, and Delta Lake patterns.
  • Build and optimize end-to-end data pipelines using Azure Data Factory, Synapse Pipelines, Logic Apps, Azure Functions, and Automation Accounts for orchestration and operational tasks.
  • Develop, operationalize, and optimize PySpark / Spark Notebooks running in Synapse or Azure Databricks for large-scale batch and near-real-time data transformations.
  • Architect and implement modern ingestion frameworks using Event Hub, Kafka-on-Azure, and ADF Mapping Data Flows to support streaming and batch workloads.
  • Design secure, governed multi‑tenant environments including tenant-boundaries, RBAC, managed identities, data access policies, and Purview-based metadata governance.
  • Develop well‑structured analytical models (Star, Snowflake, Data Vault) using Synapse, SQL Database, and Serverless SQL endpoints to support BI, reporting, and ad‑hoc analytics.
  • Implement best practices for data quality, cataloging, lineage, security, CI/CD, Infrastructure‑as‑Code, and Azure DevOps‑based deployment workflows.
  • Optimize cloud spend through storage tiering, workload separation, SQL Pool optimization, and serverless query tuning.
  • Administer and tune Azure SQL resources including SQL Dedicated Pools, SQL Database, and Serverless SQL—including T‑SQL development, partitioning, indexing, and performance tuning.
  • Collaborate with cross-functional teams to translate business needs into scalable Azure data platform solutions.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service