Senior Data Engineer, VP

State Street • Boston, MA

7d • $110,000 - $207,500

About The Position

We are looking for a Senior hands-on Data Engineer for Cloud Data Lake design and development. The candidate should have Financial Services experience in design, architecture and development of large scale enterprise applications using Cloud based Data engineering platforms. This hands-on role will partner with senior-level development managers, architects and business leadership to develop and execute the technology product roadmap. Main Duties and Responsibilities: End to end Cloud Data Lake design & development including data ingestion, data modeling and data distribution. Build data integrations, hand-offs between on-prem/cloud-based systems. Design and develop high volume data ingestion components and solutions to collect data from various sources. Manage and use appropriate tools in the cloud data lake development and deployment. Responsible for developing/implementing cloud infrastructure to support current and future business needs. Participating in technical design, application build, configuration, unit testing, and production deployment. Ensuring all cloud solutions exhibit higher level of cost efficiency, performance, security, scalability, and reliability Required Skills: Development experience in designing, developing and deploying complex applications. Strong tech skillset/experience in PL/SQL, Java/J2EE, Python, Scala, PERL/scripting . Hands on experience with Cloud platforms, preferably using Databricks. Experience in building systems using modern, scalable, resilient, cloud native architectures. Experience in Data Modeling and database design with strong skills in performance tuning. Hands on experience in setting up data pipelines for ELT jobs across multiple data sources. Hands on experience in big-data processing, troubleshooting and resolving database performance issues. Strong knowledge of Cloud Security in AWS/Azure, specifically IAM Roles & Polices, Security Groups and Encryption keys. Experience with optimizing database performance, scalability, ensuring data security and compliance. Experience with event based, micro-batch and batched high volume and high velocity transaction and data processing system. Proficiency with CICD and DevOps. Education & Qualifications Bachelor’s/Master's Degree in a Computer Science, Engineering or Math or equivalent experience 10+ years' experience in professional software design and development. Strong analytical skills, with ability to collect, absorb, and analyze information quickly and independently Proven ability to develop and work with cross functional processes and project timelines Excellent follow-through, attention to detail and time management skills

Requirements

• Development experience in designing, developing and deploying complex applications.
• Strong tech skillset/experience in PL/SQL, Java/J2EE, Python, Scala, PERL/scripting .
• Hands on experience with Cloud platforms, preferably using Databricks.
• Experience in building systems using modern, scalable, resilient, cloud native architectures.
• Experience in Data Modeling and database design with strong skills in performance tuning.
• Hands on experience in setting up data pipelines for ELT jobs across multiple data sources.
• Hands on experience in big-data processing, troubleshooting and resolving database performance issues.
• Strong knowledge of Cloud Security in AWS/Azure, specifically IAM Roles & Polices, Security Groups and Encryption keys.
• Experience with optimizing database performance, scalability, ensuring data security and compliance.
• Experience with event based, micro-batch and batched high volume and high velocity transaction and data processing system.
• Proficiency with CICD and DevOps.
• Bachelor’s/Master's Degree in a Computer Science, Engineering or Math or equivalent experience
• 10+ years' experience in professional software design and development.
• Strong analytical skills, with ability to collect, absorb, and analyze information quickly and independently
• Proven ability to develop and work with cross functional processes and project timelines
• Excellent follow-through, attention to detail and time management skills

Responsibilities

• End to end Cloud Data Lake design & development including data ingestion, data modeling and data distribution.
• Build data integrations, hand-offs between on-prem/cloud-based systems.
• Design and develop high volume data ingestion components and solutions to collect data from various sources.
• Manage and use appropriate tools in the cloud data lake development and deployment.
• Responsible for developing/implementing cloud infrastructure to support current and future business needs.
• Participating in technical design, application build, configuration, unit testing, and production deployment.
• Ensuring all cloud solutions exhibit higher level of cost efficiency, performance, security, scalability, and reliability

Benefits

• Employees are eligible to participate in State Street’s comprehensive benefits program, which includes: our retirement savings plan (401K) with company match; insurance coverage including basic life, medical, dental, vision, long-term disability, and other optional additional coverages; paid-time off including vacation, sick leave, short term disability, and family care responsibilities; access to our Employee Assistance Program; incentive compensation including eligibility for annual performance-based awards (excluding certain sales roles subject to sales incentive plans); and, eligibility for certain tax advantaged savings plans.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level