Engineer 5 - Contingent 186737

Innova Solutions USA • Wilmington, DE

274d • $95 - $100

About The Position

Innova Solutions has a client that is immediately hiring for a Software Engineer- Ab Initio & Data Pipelines. As a Software Engineer- (Ab Initio & Data Pipelines), you will serve as a data engineering, particularly with Ab Initio and related technologies. You will consult on the strategy and development of initiatives and resources for highly complex business and technical data needs across Engineering. Your responsibilities will include architecting, developing, and implementing end-to-end scalable data applications and data pipelines, utilizing deep expertise in Ab Initio Co>Op System, GDE, and Ab Initio components that work with messaging systems like Kafka. You will design and implement ETL processes, leveraging Ab Initio for efficient data integration and transformation, and work extensively with Oracle databases and messaging systems such as Kafka or IBM MQ. Additionally, you will implement solutions for converting database objects to JSON format, develop and optimize batch processes for handling large volumes of data, and implement performance tuning strategies for batch processes to ensure efficiency and scalability. You will also design and create asynchronous micro-batches, implementing non-linear batch processing techniques, and implement data solutions by adopting, recommending, and improving CICD, change management, data security, and auditing processes. Familiarity with Unix systems and scripting for data manipulation and automation, as well as leveraging GitHub for version control and collaborative development, is required. Familiarity with Autosys for job scheduling and automation is also preferred.

Requirements

• Experience with Ab Initio Co>Op System, GDE, Unix systems, Ab Initio batch processes and scripting.
• Experience with Oracle messaging systems like Kafka or IBM MQ.
• Experience with Ab Initio components that work with messaging systems like Kafka.
• Experience converting database objects to JSON.
• Experience with dealing with large volumes of data for batch processes.
• Experience with performance tuning batch processes.
• Experience with creating asynchronous micro batches and nonlinear batch processes.
• Familiar with Autosys.
• Familiar or experience with Mainframe.
• Experience in Ab Initio Continuous graphs.

Responsibilities

• Serve as a data engineering, particularly with Ab Initio and related technologies.
• Consult on the strategy and development of initiatives and resources for highly complex business and technical data needs across Engineering.
• Architect, develop, and implement end-to-end scalable data applications and data pipelines.
• Utilize deep expertise in Ab Initio Co>Op System, GDE, and Ab Initio components that work with messaging systems like Kafka.
• Design and implement ETL processes, leveraging Ab Initio for efficient data integration and transformation.
• Work extensively with Oracle databases and messaging systems such as Kafka or IBM MQ.
• Implement solutions for converting database objects to JSON format.
• Develop and optimize batch processes for handling large volumes of data.
• Implement performance tuning strategies for batch processes to ensure efficiency and scalability.
• Design and create asynchronous micro-batches, implementing non-linear batch processing techniques.
• Implement data solutions by adopting, recommending, and improving CICD, change management, data security, and auditing processes.
• Utilize Unix systems and scripting for data manipulation and automation.
• Leverage GitHub for version control and collaborative development.
• Familiarity with Autosys for job scheduling and automation.

Benefits

• Medical & pharmacy coverage
• Dental and vision insurance
• 401(k)
• Health saving account (HSA)
• Flexible spending account (FSA)
• Life Insurance
• Pet Insurance
• Short term and long term Disability
• Accident & Critical illness coverage
• Pre-paid legal & ID theft protection
• Sick time
• Other types of paid leaves (as required by law)
• Employee Assistance Program (EAP)

What This Job Offers

• Job Type: Full-time
• Career Level: Entry Level
• Industry: Professional, Scientific, and Technical Services