Azure Data Engineer
About The Position
Our client is seeking a Senior Azure Data Engineer to support a company-wide cloud transformation. This hands-on role designs and optimizes scalable Azure data solutions for enterprise analytics, applications, and AI use cases. The position is hybrid in Duluth, Georgia, with two onsite days per week, and is contract-to-hire. The engineer will build and optimize data pipelines and lakehouse and warehouse solutions; establish ingestion and data modeling practices; implement quality, governance, and monitoring capabilities; support CI/CD and infrastructure automation; and work with technical and business teams. The role also includes mentoring engineers through design and code reviews.
Requirements
- 7+ years of hands-on data engineering experience within Microsoft Azure.
- Advanced Python, PySpark, SQL, and Spark SQL skills.
- Strong Microsoft Fabric experience.
- Experience with Azure Data Factory, Synapse, and/or Databricks.
- Experience with OneLake, ADLS Gen2, Delta Lake, lakehouse, and data warehouse architectures.
- Strong knowledge of Medallion architecture, dimensional modeling, CDC, and metadata-driven pipelines.
- Experience with Spark performance tuning and SQL optimization.
- Experience with data quality, governance, lineage, CI/CD, automated testing, and production support.
- Strong communication, collaboration, problem-solving, and mentoring skills.
- Bachelor's degree in a related discipline or equivalent professional experience.
Nice To Haves
- Microsoft Fabric Data Engineer Associate (DP-700) certification.
- Experience with Terraform, Bicep, Azure DevOps, or GitHub Actions.
- Experience with Event Hubs, Kafka, streaming, or Fabric Real-Time Intelligence.
- ERP, supply chain, distribution, manufacturing, PIM, or MDM data experience.
- Familiarity with Power BI, Direct Lake, Fabric Mirroring, Azure OpenAI, or RAG.
Responsibilities
- Build scalable ETL/ELT pipelines using Python, PySpark, SQL, Microsoft Fabric, Azure Data Factory, Synapse, and Databricks.
- Develop lakehouse and warehouse solutions using OneLake, ADLS Gen2, Delta Lake, Parquet, and Spark.
- Create batch, incremental, CDC, API, and streaming ingestion processes.
- Design dimensional models, star schemas, SCDs, and curated data products.
- Build reusable frameworks for ingestion, transformation, validation, logging, and error handling.
- Optimize Spark, SQL, storage, and pipeline performance.
- Implement data quality, governance, lineage, monitoring, and observability.
- Support CI/CD, automated testing, and Infrastructure as Code.
- Collaborate with cloud, architecture, BI, security, application, and business teams.
- Mentor engineers through design reviews, code reviews, and best practices.
Benefits
- Medical, dental, and vision benefits, subject to eligibility.
- Critical Illness, Accident, and Hospital coverage, subject to eligibility.
- 401(k) Retirement Plan with pre-tax and Roth post-tax contributions available.
- Life Insurance, including voluntary Life and AD&D for the employee and dependents.
- Short- and long-term disability.
- Health Spending Account (HSA).
- Transportation benefits.
- Employee Assistance Program.
- Time Off/Leave, including PTO, vacation, or sick leave.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
