Principal Data Engineer

Fidelity•Smithfield, RI

19h

About The Position

Architects, crafts, and develops highly scalable distributed data processing systems and software applications. Writes and optimizes SQL queries and stored procedures using SQL, PL/SQL, Java, Python, and Shell scripting languages for development of data pipelines. Incorporates and streamlines test automation into software application builds, using Continuous Integration/Continuous Delivery (Cl/CD) methodologies - Jenkins, Terracore , GitHub and uDeploy . Creates data driven business solutions using data warehousing, mart concepts, and relational databases -- Oracle, SQL Server, and Snowflake on Amazon Web Services (AWS) Cloud. Implements and supports databases in an Amazon Web Services (AWS) Cloud Infrastructure environment. Creates and maintains database schemas and objects such as tables, views, indexes, and triggers for easy access of database systems. Confers with systems analysts and other software engineers/developers to design systems and to obtain information on project limitations and capabilities, performance requirements, and interfaces.

Requirements

Bachelor’s degree in Computer Science , Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and five (5) years of experience as a Principal Data Engineer (or closely related occupation) designing and building highly scalable Business Intelligence (BI) and analytical solutions on Cloud and on-premise platforms in a financial services environment, using Data Warehouse and Mart techniques.
Master’s degree in Computer Science , Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and three (3) years of experience as a Principal Data Engineer (or closely related occupation) designing and building highly scalable Business Intelligence (BI) and analytical solutions on Cloud and on-premise platforms in a financial services environment, using Data Warehouse and Mart techniques.
Demonstrated Expertise (“DE”) designing and building Data Warehouses and performing Extract, Transform, and Load (ETL) development, using Oracle, PL/SQL, Informatica, Control-M, or UNIX; and building and maintaining (CI/CD) pipelines using Terracore (for application code deployment), Jenkins, GitHub, or uDeploy .
DE coordinating and implementing all aspects of the Software Development Lifecycle (SDLC) in support of applications deployment according to financial services standards, security requirements, software development best practices, and Agile methodologies, using JIRA for project management, and programming languages and frameworks (JavaScript, Node.js, and React).
DE developing Cloud-native applications and migrating on-premise data centric applications to Cloud, using Snowflake and AWS; and migrating data to and from Snowflake data stores by designing and implementing performant ETL/Extract Load, and Transform (ELT) pipelines in Cloud environments, using Python, Snowflake, and SnowSQL .
DE developing effective data solutions that meet end user demands on Snowflake, using Spark SQL and Python; and classifying, analyzing, and governing data assets to ensure data quality and compliance, using Alation and Collibra.

Responsibilities

Develops applications on complex projects, components, and subsystems for the division.
Troubleshoots and resolves issues with databases and related systems.
Ensures the delivery of effective, efficient, and high-quality data movement and data integration patterns.
Ensures the scalability, reliability, performance, and security of the databases by performing database tunes and optimization techniques.
Monitors and optimizes database performance by implementing various database designs and models techniques.
Advises senior management on technical strategy.
Acts as a primary liaison for business units to resolve various project/technology issues.
Develops comprehensive documentation for multiple applications or subsystems.
Develops or directs software system tests or validation procedures, programs, or documentation.
Provides technology solutions to daily issues and technical evaluation estimates on technology initiatives.
Mentors junior team members.