Data Movement Engineer (Talend) - Contractor

knightsofcNew Haven, CT
1dHybrid

About The Position

The Knights of Columbus is embarking on the modernization of its core data platforms. We are currently seeking a Data Movement Engineer who will assist in supporting our current ETL environment and building new ETL/ELT workflows and data pipelines as we transition to a cloud environment. This role will support data architects, analysts, and BI developers on various data initiatives. The ideal candidate will possess strong technical expertise in ETL tools like Talend & Informatica, data warehousing, and cloud technologies, and be comfortable leading complex projects and mentoring team members.

Requirements

  • Minimum of 5 years of relevant experience in data warehousing, business intelligence tools, and data analysis
  • Minimum of 3 years of SQL query development across multiple database platforms (Snowflake, SQL Server, DB2)
  • Expert-level proficiency in Talend Management Console and Talend Open Studio
  • Must work well independently; inquisitive and seek answers to complex questions without being prompted
  • Strong understanding of BODI (Business Objects Data Integrator) code and architecture
  • Proficiency in ETL/ELT concepts and tools (Informatica IICS, Talend, Boomi, PowerCenter)
  • Working knowledge of data warehousing concepts, dimensional modeling, and ETL best practices
  • Experience using query tools (e.g., AQT, DBeaver, MS Query)
  • Familiarity with job scheduling tools (ESP, Airflow, Autosys) and version control systems (Git)
  • Experience in production support environments
  • Effectively participates in teams and moves the team toward completion of goals
  • Experience with ticketing systems (e.g., ServiceNow)
  • Experience working with IBM DB2 in ETL workflows
  • Ability to solve problems using analytical thinking skills
  • Strong communication, organizational and time management skills
  • Strong project management skills to ensure timely delivery
  • Some experience with cloud database technologies
  • Bachelor’s degree in computer science, Information Systems, or related field.
  • 5+ years of experience in ETL development and data integration.

Responsibilities

  • Complete full life cycle of ETL/ELT development including design, mappings, transformations, scheduling, and testing.
  • Translate data movement requirements into technical ETL design.
  • Design, develop, and maintain robust ETL workflows using Talend, Informatica (IICS, PowerCenter), and BODI.
  • Develop data extraction and transmissions to external vendors.
  • Develop test plans and perform unit testing.
  • Determine impacts to data warehouse structures and information flows due to changes in business or technical requirements.
  • Perform design and code reviews in support of organizational standards.
  • Contribute to architectural decisions to support business processes.
  • Perform data quality analysis, report data quality issues and propose solutions for data quality management.
  • Analyze and interpret existing BODI code to support migration or integration efforts.
  • Optimize data extraction, transformation, and loading processes for reliability, performance, and scalability.
  • Develop and optimize complex SQL queries.
  • Ensure ETL jobs are well-documented, version-controlled, and aligned with data architecture standards.
  • Provide production support for ETL and data solutions, including troubleshooting and resolving pipeline issues.
  • Monitor ETL jobs and proactively address failures or performance issues.
  • Lead root cause analysis and resolution of data-related production incidents.
  • Collaborate with other teams to implement fixes and preventive measures.
  • Identify recurring issues and propose long-term solutions.
  • Suggest process and technical improvements to reduce incidents.
  • Implement data validation, cleansing, and reconciliation logic within ETL processes.
  • Support data lineage and impact analysis for downstream systems.
  • Lead the design, development, and maintenance of ETL processes using Talend and other tools.
  • Provide technical leadership, code reviews, and mentorship to junior ETL developers.
  • Coordinate with business stakeholders, data architects, and application teams to gather requirements and deliver solutions.
  • Communicate issue status, impact, and resolution timelines effectively.
  • Contribute to architectural decisions to support business processes.
  • Create supporting documentation for new ETL processes, data flows, and technical specifications.
  • Maintain comprehensive documentation for ETL processes, data mappings, and job schedules.
  • Prepare effort estimations and contribute to architectural decisions.
  • Provide regular updates and reports on ETL performance, issue trends, and improvement initiatives.
  • Experience writing design documents and operational runbooks.
  • On-call and/or after-hours work required.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service