Manager, Enterprise Data Engineer

Vialto Partners • New York, NY

1d • $125,000 - $225,000 • Remote

About The Position

Help organizations to design, develop and implement data pipelines and architectures to support enterprise data initiatives. Support the development and optimization of ETL/ELT processes for data integration from diverse structured and unstructured sources. Ensure data quality, consistency, and governance across the data platform in accordance with organizational standards and compliance requirements. Utilize big data and cloud to build and manage enterprise-grade data solutions. Collaborate with team to support analytics, reporting, and machine learning initiatives with reliable and timely data delivery. Supervise and Coach team.

Requirements

• Bachelor’s degree or foreign equivalent in Management Information Systems, Engineering, Business Administration, or a related field, plus 5 years of progressive, post- bachelor’s related work experience.
• Master’s degree or foreign equivalent in Management Information Systems, Engineering, Business Administration, or a related field, plus 3 years of related work experience.
• At least one year of experience with designing and implementing the architecture for the Enterprise Data Platform, focusing on CI/CD pipelines for applications and integrating Azure Data Factory pipelines to enable seamless data movement between enterprise systems like ADLS and Snowflake.
• At least one year of experience utilizing Python / Power-shell skills to script jobs to automate routine tasks such as scheduled maintenance and dynamic scale up of resources by using Azure Server less services to optimize the cost of running such utilities.
• At least one year of experience ensuring that all the automated build and deploy pipelines (CI/CD) are working without any issues and remediating issues immediately with minimal impact to services.
• At least one year of experience deploying GPT based artificial intelligence models in Azure Open AI service and monitoring the parameters such as token count, cost of operation, also working with other Azure AI tools such as Search Service, Document Intelligence, Text analytics etc.

Responsibilities

• Design, develop and implement data pipelines and architectures to support enterprise data initiatives.
• Support the development and optimization of ETL/ELT processes for data integration from diverse structured and unstructured sources.
• Ensure data quality, consistency, and governance across the data platform in accordance with organizational standards and compliance requirements.
• Utilize big data and cloud to build and manage enterprise-grade data solutions.
• Collaborate with team to support analytics, reporting, and machine learning initiatives with reliable and timely data delivery.
• Supervise and Coach team.

What This Job Offers

• Job Type: Full-time
• Career Level: Manager