Big Data Engineer

HEXAWARE

12d

About The Position

Big Data Engineer Required Experience: 6+ years of Industry Experience with key engagements including Integration Architecture, Solution, Design & end-to-end implementation Responsibilities: • Define the Integration architecture landscape, including technology, information, data, security, and integration • Implement large-scale, innovative IT solutions to drive business transformation. • Define and deliver the Integration Technology aspects of the projects, including the timely production of architectural designs and documentation • Being a key contributor to architect & design Microservice, API Management, process automations & frameworks in project • Working with customers’ business and the Architecture team on large integration transformation programs that include multiple technology streams and complex architecture • Propose, Architecture, design and guide building reusable components, Able to drive the Architecture discussions with the end-customer • Communicating the implementation approach and design methodology to the offshore development team • Participating in a Technical Design Authority to assess and quantify the risks associated with design decisions and communicate these to the relevant parties • Develop technology strategy and planning deliverables to address IT risks and improve the effectiveness of the IT organization, especially in business application integration. • Produce target-state solution architecture, and perform assessments and gap analysis. • Help formulate the overall solution strategy.

Requirements

6+ years of Industry Experience with key engagements including Integration Architecture, Solution, Design & end-to-end implementation
Databricks
Pyspark
Medallion Arch
CTE Queries
Python
ADL
ADF
Azure Cloud Storage & Container Exp
SQL
Stored Procedures
Views
User Defined Functions
SQL Server
Data Analysis Exp

Nice To Haves

Collibra
Alteryx work flow

Responsibilities

Define the Integration architecture landscape, including technology, information, data, security, and integration
Implement large-scale, innovative IT solutions to drive business transformation.
Define and deliver the Integration Technology aspects of the projects, including the timely production of architectural designs and documentation
Being a key contributor to architect & design Microservice, API Management, process automations & frameworks in project
Working with customers’ business and the Architecture team on large integration transformation programs that include multiple technology streams and complex architecture
Propose, Architecture, design and guide building reusable components, Able to drive the Architecture discussions with the end-customer
Communicating the implementation approach and design methodology to the offshore development team
Participating in a Technical Design Authority to assess and quantify the risks associated with design decisions and communicate these to the relevant parties
Develop technology strategy and planning deliverables to address IT risks and improve the effectiveness of the IT organization, especially in business application integration.
Produce target-state solution architecture, and perform assessments and gap analysis.
Help formulate the overall solution strategy.