Engineer

TATA Consulting Services•Raleigh, NC

40d•$100,000 - $110,000

About The Position

Qlik Replicate Automation for Data Ingestion role for a professional with 3-7 years of experience generally focuses on the design, development, and maintenance of robust, automated data pipelines using Qlik's suite of tools (Qlik Replicate, Qlik Compose, Qlik Sense, and Qlik Automate). This role requires a strong mix of data engineering skills, Qlik platform expertise, and collaboration with business stakeholders.

Requirements

3-7 years of proven experience working directly with Qlik platforms (Qlik Sense, QlikView, Qlik Data Integration suite) as a developer or data integrator.
Strong proficiency in SQL and experience with relational and non-relational databases.
Solid understanding of data warehousing concepts, ETL processes, and data modeling techniques.
Familiarity with cloud platform (AWS) and Data Platform(Snowflake) and related data services.
Excellent problem-solving, analytical, and troubleshooting skills. Strong communication and collaboration skills to work effectively with cross-functional teams.

Nice To Haves

Experience with other programming/scripting languages (e.g., Python) for advanced automation is a plus.

Responsibilities

Design, develop, and maintain efficient and scalable data integration and ETL/ELT (Extract, Transform, Load/Extract, Load, Transform) pipelines for both batch and real-time data processing.
Utilize Qlik data integration tools (e.g., Qlik Replicate, Qlik Compose) to ingest data from various sources (SQL databases, APIs, cloud platforms, flat files) into target data warehouses or data lakes.
Implement data models (in snowflake schema) using the Qlik associative data model to ensure efficient data storage and retrieval.
Automate data ingestion processes, application reloads, and administrative tasks using Qlik Automate or scripting (e.g., Python) to improve efficiency and reduce manual intervention.
Monitor and optimize data integration processes and Qlik applications for performance, identifying and resolving bottlenecks in data loading and query execution.
Implement data quality frameworks, including validation, monitoring, and alerting systems to ensure data accuracy and consistency.
Collaborate closely with data engineers, analysts, data scientists, and business stakeholders to gather and understand data requirements and deliver solutions that enable actionable insights.
Troubleshoot and resolve data integration issues, providing ongoing support for Qlik solutions.
Document data pipelines, schemas, and business logic for knowledge sharing and efficient onboarding.
Implement data security measures, including encryption, access controls, and audit logging, to ensure compliance with relevant data governance policies.
Manage the data lifecycle, including archival, retention, and deletion policies.