Data Engineer
QTech•Chicago, MI
•Onsite
About The Position
We are looking for a skilled Data Engineer to join our team. This role focuses on designing scalable data pipelines, building enterprise ETL/ELT solutions, and delivering high-quality data integration across cloud-based platforms.
Requirements
- Strong experience in PySpark.
- Hands-on experience with Microsoft Azure.
- Expertise in Azure Data Factory (ADF).
- Strong knowledge of ETL/ELT development.
- Experience designing scalable data pipelines.
- Strong SQL programming and database optimization skills.
- Experience with Data Warehousing concepts and implementation.
- Experience in data integration and performance tuning.
- Knowledge of cloud-based data engineering best practice.
Nice To Haves
- Experience with Azure Databricks.
- Knowledge of Delta Lake, Spark SQL, and Azure Synapse Analytics.
- Familiarity with CI/CD pipelines and DevOps practices.
- Experience working in Agile/Scrum environments.
Responsibilities
- Design, develop, and optimize scalable data pipelines.
- Build, maintain, and enhance ETL/ELT workflows using Azure Data Factory (ADF).
- Process, transform, and optimize large datasets using PySpark.
- Develop efficient data integration solutions across multiple enterprise systems.
- Create scalable and reliable cloud-based data engineering solutions on Microsoft Azure.
- Optimize SQL queries, data warehouse performance, and data processing workflows.
- Ensure data quality, reliability, consistency, and governance.
- Troubleshoot production issues and optimize pipeline performance.
- Collaborate with cross-functional teams including business analysts, data scientists, and application developers.
- Support continuous improvements in data architecture and engineering best practices.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
No Education Listed
