Senior Data Engineer

Sumitomo Mitsui Banking Corporation•Charlotte, NC

6d•Hybrid

About The Position

We are currently seeking a talented and motivated Senior Data Engineer to join our Cloud data solutions team. This role will be responsible for designing, developing & deploying cloud data solutions for risk, regulatory, finance & compliance projects and be at the forefront of on-prem to cloud migration initiative. This role will require indirect leadership and mentorship of junior team members.

Requirements

Extensive experience on Cloud solutions, preferably in Azure
Experience with Azure cloud services, Azure Data Factory, Gen 2, Azure Databases, Functions, Databricks, etc.
Strong knowledge of Python, Java or similar high-level server-side languages
Advanced working SQL knowledge on relational databases, preferably on MS SQL Server and databases on Azure cloud
Experience designing and architecting distributed systems, containerization, Web API’s and gateway management.
Experience with the DevOps lifecycle (git, Jenkins, etc.)
Databricks Cluster configuration, Unity catalog repository configuration.
7+ years of software development experience in enterprise applications, preferably in the financial services industry and on data-heavy systems
Bachelor’s or master’s degree in computer science or information systems preferred.

Responsibilities

Work with business teams, product managers, and other stakeholders to understand business requirements, needs, or process gaps that would be addressed via proposed applications.
Engage with IT systems architects, database administrators, and cyber security team to meet the back-end functionality demands of the application.
Liaise with other technology and development teams as needed to coordinate on the integration of applications with the larger company software ecosystem.
Participate in periodic development meetings to align development priorities and objectives, assign tasks, and share experiences and challenges with applications under development
Build large-scale batch and real-time data pipelines with data processing frameworks in Azure cloud platform.
Partner with architects, engineers, information analysts, business, and technology stakeholders for developing and deploying enterprise grade platforms that enable data-driven solutions.
Provide technical guidance on technology implementation and architectural changes.
Coordinating with platform, APIM, Azure DevOps, and Support.
Develop, test, and modify software to improve efficiency of data platforms and applications.
Ability to own projects from end to end, working with business stakeholders, IT teams, data stewards, and 3rd party companies to ensure accurate and insightful outcomes.
Integrating data from a variety of sources, assuring that they adhere to data quality and accessibility standards.
Enable streaming data use-cases and standard design patterns in a big data environment.
Review and provide feedback on core code changes and support production deployment.