Data Engineer

American IT Systems • Plano, TX

5d

About The Position

We are seeking a Data Engineer with strong experience with data wrangling and building enterprise data pipelines including ingestion, transformation and management.

Requirements

• 5+ years of experience in Data Engineering roles
• Strong hands-on experience with data ingestion / ETL / ELT tools like Azure Data Factory and data modelling
• Proficient in using Azure Databricks (PySpark/Spark SQL) and medallion architecture
• Experience with other SQL databases, relational databases and NoSQL databases
• Understanding of data lake and data warehouse architectures (e.g., Azure Data Lake, One Lake, Delta Tables)
• Experience working with large-scale structured and semi-structured datasets
• Ability to work with cross-functional teams and translate business requirements into technical solutions

Responsibilities

• Design, develop, and maintain end-to-end data pipelines using data ingestion tools and Azure Databricks
• Implement scalable data ingestion frameworks (batch and incremental) from diverse data sources (APIs, databases, files, cloud storage)
• Build and optimize data transformation logic using Spark (Databricks), SQL, and Python
• Develop and maintain data models supporting analytics, reporting, and machine learning use cases
• Collaborate with analytics teams to enable Power BI datasets and reporting solutions
• Ensure data quality, reliability, and consistency through validation frameworks and monitoring
• Optimize performance of pipelines, storage, and compute resources in Azure
• Implement data governance practices, including lineage, cataloging, and documentation
• Support CI/CD deployment pipelines for data engineering workflows

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed