Software Developer - Data Engineer

InfoCentric

5d • Onsite

About The Position

Built ETL packages for large data pipelines, using Python. Build packages and scripts for transformations within Data Warehouses, using Python, Snowflake and either ADF or DBT. Create and provision Cloud environments like Azure or AWS to ensure security, role-based user access and Data Masking for sensitive data. Develop unit test scripts for all the new and existing features using Python and SQL, to deliver reliable and robust IT products to the users. Create documentation of your code using tools including Confluence and GitHub, to create an end-user document and technical document for the users. Perform requirement and risk analysis, which include activities like consulting with stakeholders, gathering business requirements and creating risk reports for the IT projects. Automate IT processes by using Automation and Orchestration tools including Control-M, GIT and Ansible, for continuous integration, testing and deployment of programming code to deliver an IT product effectively. Performing system support activities like auditing systems, planning for upgrades and communicating impacted users to ensure systems are in good health.

Requirements

• At least 5 years experience working in Data Engineering roles
• Excellent communications and client-facing consulting skills
• Exposure in building Cloud based systems on Azure or AWS
• Strong development and scripting experience with Python and SQL
• Exposure in building systems with event streaming, service bus or message queues (Azure Event Hubs/Service Bus, Kafka, RabbitMQ or similar)
• Understanding code testability, experience in build pipelines and DevOps (CI/CD systems, Infrastructure as Code)

Responsibilities

• Built ETL packages for large data pipelines, using Python
• Build packages and scripts for transformations within Data Warehouses, using Python, Snowflake and either ADF or DBT
• Create and provision Cloud environments like Azure or AWS to ensure security, role-based user access and Data Masking for sensitive data
• Develop unit test scripts for all the new and existing features using Python and SQL, to deliver reliable and robust IT products to the users
• Create documentation of your code using tools including Confluence and GitHub, to create an end-user document and technical document for the users
• Perform requirement and risk analysis, which include activities like consulting with stakeholders, gathering business requirements and creating risk reports for the IT projects
• Automate IT processes by using Automation and Orchestration tools including Control-M, GIT and Ansible, for continuous integration, testing and deployment of programming code to deliver an IT product effectively
• Performing system support activities like auditing systems, planning for upgrades and communicating impacted users to ensure systems are in good health

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed