Senior Data Engineer

Sumitomo Mitsui Banking Corporation•Charlotte, NC

154d•$142,000 - $196,000•Hybrid

About The Position

The Cloud Data Engineer is part of the Data Management’s Design & Development group within the Americas Division Tech and is responsible for building technical architecture for our Azure platform and support the on-prem to cloud migration initiative and cloud consolidation strategy. Role is located in Charlotte, North Caroline with a Hybrid presence in office. Role ObjectivesThe Azure Cloud Engineer strategizes, designs, develops and work with a team of dynamic and passionate data engineers to deliver automated cloud infrastructure and DevOps solutions. The incumbent will play a key role in supporting the growth and scale of our Azure cloud-based technology infrastructure. This role is also responsible for complex interface process development, troubleshooting issues, supporting weekend maintenance and production support of the interface processes development by the Design & Development team. Reports to the ETL Team Leader.

Requirements

Extensive experience on Cloud solutions, specifically in Azure
Experience with Azure cloud services, Azure Data Factory, Gen 2, Azure Databases, Functions, Databricks, etc
Strong knowledge of Python, Java or similar high-level server-side languages
Advanced working SQL knowledge on relational databases, preferably on MS SQL Server and databases on Azure cloud
Experience designing and architecting distributed systems, containerization, Web API’s and gateway management.
Experience with the DevOps lifecycle (git, Jenkins, etc.)
Experience with Jira/Confluence
Experience with REST web services and microservice architecture
Good understanding of ETL/ELT
Databricks Cluster configuration, Unity catalog repository configuration.
10+ years of software development experience in enterprise applications, preferably in the financial services industry and on data-heavy systems.

Nice To Haves

Bachelor’s or Master’s degree in computer science or information systems preferred.

Responsibilities

Designing, developing & deploying cloud data solutions for risk, regulatory, finance & compliance projects and be at the forefront of on-prem to cloud migration initiative.
Indirect leadership and mentorship of junior team members.
Work with business teams, product managers, and other stakeholders to understand business requirements, needs, or process gaps that would be addressed via proposed applications.
Engage with IT systems architects, database administrators, and cyber security team to meet the back-end functionality demands of the application.
Liaise with other technology and development teams as needed to coordinate on the integration of applications with the larger company software ecosystem.
Participate in periodic development meetings to align development priorities and objectives, assign tasks, and share experiences and challenges with applications under development
Build large-scale batch and real-time data pipelines with data processing frameworks in Azure cloud platform.
Partner with architects, engineers, information analysts, business, and technology stakeholders for developing and deploying enterprise grade platforms that enable data-driven solutions.
Provide technical guidance on technology implementation and architectural changes.
Coordinating with platform, APIM, Azure DevOps, and Support.
Analyze and design technical solutions on Azure to address business needs.
Develop, test, and modify software to improve efficiency of data platforms and applications.
Ability to own projects from end to end, working with business stakeholders, IT teams, data stewards, and 3rd party companies to ensure accurate and insightful outcomes.
Integrating data from a variety of sources, assuring that they adhere to data quality and accessibility standards.
Enable streaming data use-cases and standard design patterns in a big data environment.
Review and provide feedback on core code changes and support production deployment