Associate Data Movement Engineer (Talend) - Contractor

knightsofcNew Haven, CT
1dHybrid

About The Position

The Knights of Columbus is embarking on the modernization of its core data platforms. We are currently seeking an Associate Data Movement Engineer who can assist us with modernizing our current ETL environment, as well as building new ETL/ELT workflows and data pipelines as we move towards a cloud environment. The Associate Data Movement Engineer will support our data architects, data analysts, and business intelligence developers on various data initiatives. They must be self-directed and comfortable supporting the data requirements of multiple teams and systems. The ideal candidate will also possess experience in the data management domain and be willing to contribute their technical skills and experience towards the development and support of elegant and efficient data processes and systems.

Requirements

  • Minimum of 1 years of relevant experience in data warehousing, business intelligence tools, and the analysis of data.
  • Minimum of 1 year of SQL query development, preferably in multiple database management platforms, and working with normalized relational databases and dimensional data warehouse implementations
  • Proficiency in ETL/ELT concepts and tools (Informatica IICS and PowerCenter preferred)
  • Experience with Airflow for job orchestration and scheduling
  • Exposure to Event Stream Processing (ESP) platforms and real-time data handling
  • Familiarity with incident tracking tools (e.g., ServiceNow, Jira) and CI/CD practices
  • Some experience with cloud-based database technologies is required
  • Working knowledge of data warehousing concepts, structures and ETL best practices
  • Experience using query tools (e.g., AQT, MS Query)
  • Ability to solve problems using analytical thinking skills
  • Bachelor’s degree in computer science, Information Systems, or related field
  • 1+ years of experience in ETL development and production support
  • 1+ years' experience in data warehousing and related domains

Nice To Haves

  • Preferable hands-on experience with Talend and working knowledge of SAP BODI

Responsibilities

  • Complete full life cycle of ETL/ELT development to address business needs or resolve issues including design, mappings, data transformations, scheduling and testing
  • Translate data movement requirements into technical designs
  • Develop data extraction and transmissions to external vendors
  • Develop test plans and perform unit testing. Create supporting documentation for new processes
  • Determine impacts to data warehouse structures and information flows due to changes in business or technical requirements
  • Contribute to architectural decisions to support business processes
  • Provide production support for data solutions
  • Complete RCA and contribute to remediation planning and implementation
  • Perform data quality analysis, report data quality issues and propose solutions for data quality management
  • Prepare effort estimation of software development and unit testing
  • Monitor ETL workflows and streaming jobs across Talend, Airflow, and ESP environments
  • Investigate and resolve data load failures, performance issues, and data quality anomalies
  • Perform RCA and implement corrective and preventive actions
  • Develop and maintain ETL jobs using Talend and support legacy BODI workflows
  • Collaborate with data engineers to optimize pipeline performance
  • Implement data validation, cleansing, and reconciliation logic
  • Work with business analysts to ensure data accuracy and completeness
  • Support data audits and compliance initiatives
  • Manage and enhance job orchestration using Airflow
  • Ensure timely execution of data workflows
  • Automate routine support tasks and improve monitoring capabilities
  • Liaise with business users, application teams, and data architects to resolve issues and gather requirements
  • Maintain detailed documentation of ETL processes, job schedules, and issue logs
  • Contribute to knowledge base and support documentation for recurring issues
  • On Call and/or after hours work required
  • Other related duties as directed
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service