About The Position
We are looking for an experienced Data Engineer with 4+ years of hands on experience responsible for expanding and optimizing our big data pipelines. You will be working alongside other engineers and developers working on different layers of the data warehouse. Therefore, a commitment to collaborative problem solving, sophisticated design, and the creation of quality products is essential.
Requirements
- Bachelor's degree in Computer Science, Information Technology, Engineering, or a related field (or equivalent work experience).
- 4+ years of overall experience in data engineering & data warehousing domain focusing on building large scale data pipelines
- 2+ years' experience in Big Data Distributed systems such as Microsoft Fabric, Databricks, AWS EMR
- Strong experience in developing data pipelines using PySpark and ETL tools like ADF, Talend
- Proficiency in Python & SQL
- Strong problems solving and critical thinking skills
- Experience of writing effective and maintainable unit and integration tests for ingestion pipelines.
- Working knowledge of CI/CD pipelines for deployments.
- Working knowledge of using code version control repositories like Git.
- Knowledge of security best practices including encryption of sensitive data, encryption at rest and encryption in flight.
Responsibilities
- Collaborate with Big Data Solution Architects to design, prototype, implement, and optimize data ingestion pipelines so that data is shared effectively across various business systems.
- Build & maintain ETL/ELT Ingestion pipelines and analytics solutions using cloud 0technologies.
- Ensure the design, code and procedural aspects of solution are production ready, in terms of operational, security and compliance standards.
- Participate in day-to-day project and production delivery status meetings, and provide technical support for faster resolution of issues.
- Work with Stakeholders and Understand their Requirements
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
