Associate, Data Engineer (multiple positions)
About The Position
SMBC Group is a top-tier global financial group with a 400-year history, headquartered in Tokyo. It offers a diverse range of financial services and has a significant international presence with over 130 offices and 80,000 employees worldwide in nearly 40 countries. Sumitomo Mitsui Financial Group, Inc. (SMFG) is the holding company, and its shares are traded on major stock exchanges. In the Americas, SMBC Group provides commercial and investment banking services to corporate, institutional, and municipal clients, connecting them to local markets and its global network. The anticipated salary range for this role is between $168,000.00 and $175,000.00, with the specific offer based on individual qualifications, experience, and market analysis. The role may also be eligible for an annual discretionary incentive award and offers a competitive portfolio of benefits.
Requirements
- Bachelor’s degree in applied computer science, information systems or a related field.
- 7 years of progressively responsible experience.
- Experience with Azure cloud technologies including Azure Data Factory, Azure Data Lake Storage Gen2, Azure Databases, Azure Functions, API Management, and Databricks Unity Catalog.
- Advanced programming skills in Python, Java, and SQL.
- Experience in ETL/ELT processes.
- Experience in distributed systems design.
- Experience in real-time and batch data pipelines.
- Experience in microservices architecture.
- Experience with RESTful web services.
- Experience with containerization.
- Experience with Web APIs and gateway management.
- Experience with streaming data design patterns.
- Experience with data integration and quality standards.
- Experience with DevOps and collaboration tools such as Jenkins, Git, Jira, and Confluence.
Responsibilities
- Architect and design Azure-based cloud data platforms and solutions.
- Assess business requirements and translate them into scalable, secure Azure technical architectures.
- Design, develop, and deploy cloud data solutions supporting risk, regulatory, finance, and compliance initiatives.
- Build and maintain large-scale batch and real-time data pipelines using Azure services such as Azure Data Factory, Databricks, Azure Functions, Azure Data Lake Gen2, and Azure SQL.
- Develop, test, and optimize software to enhance the performance, scalability, and efficiency of data platforms and applications.
- Configure and manage Databricks clusters and Unity Catalog environments.
- Automate cloud infrastructure provisioning and CI/CD pipelines using tools such as Azure DevOps, Git, and Jenkins.
- Lead and support enterprise-wide system integration using Azure API Management, RESTful microservices, and gateway technologies.
- Contribute to API and gateway strategy, and design distributed, containerized system architectures.
- Review core code changes and support production deployments.
- Integrate data from multiple sources while enforcing data quality, governance, and accessibility standards.
- Collaborate with architects, engineers, analysts, and business stakeholders to deliver enterprise-grade, data-driven platforms.
- Provide technical leadership and guidance on architecture decisions and technology implementations.
- Partner with business teams and product managers to convert functional requirements into detailed technical designs.
- Engage with IT architects, DBAs, and cybersecurity teams to ensure backend functionality, security, and regulatory compliance.
- Coordinate with cross-functional technology teams to ensure seamless application and system integration.
- Provide mentorship and indirect leadership to junior team members.
- Participate in regular development and planning meetings to align priorities, assign work, and share best practices.
- Develop, support, and troubleshoot complex interface processes, driving issues through to resolution.
- Provide production support for deployed interface processes, including participation in weekend maintenance windows as needed.
- Coordinate with infrastructure, scheduling, Azure DevOps, and support teams to deploy changes and resolve operational issues.
Benefits
- Annual discretionary incentive award
- Competitive portfolio of benefits
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Entry Level
