Principal Data Engineer

Fidelity•Durham, NC

1d•Hybrid

About The Position

Position Description : Designs large-scale data and analytics solutions on Snowflake Cloud Platform. Provides technical guidance in the implementation and practice of relational database technologies and tools -- Snowflake, Oracle, Sqlserver, and PLSQL. Participates in all aspects of data movement technologies Extract, Transform, and Load (ETL/ELT) processes and schedulers. Migrates on-premises databases to Amazon Web Services (AWS) Cloud and Snowflake using AWS services -- EC2, S3, and EKS. Designs and implements data lake in Snowflake. Creates dimensional models using data modeling tool (Power Designer) adhering standard methodologies and techniques. Primary Responsibilities: Designs, develops, enhances, and tests software applications. Supports batch processes, applications, and data movement technologies. Implements scalable designs and software engineering best practices to develop resilient applications. Assesses current platforms and defines the course of action for modernization. Provides technical vision and leadership by implementing technology solutions to meet business requirements. Collaborates with peers and the leadership team on process improvement ideas, policy, and procedure enhancements. Implements all aspects of data engineering, warehousing, visualization, and integration. Sets up reliable infrastructure -- software applications, hardware, scalable data management systems, and frameworks -- to perform data-related tasks. Automates software delivery pipelines. Works in collaborative teams to deliver high quality data solutions in a multi-developer Agile environment. Performs deep data analysis on multiple database platforms. Develops, creates, and modifies general computer applications software or specialized utility program. Analyzes user needs and develops software solutions. Designs software or customizes software for client use. Analyzes and designs databases within an application area.

Requirements

Bachelor’s degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and five (5) years of experience as a Principal Data Engineer (or closely related occupation) supporting reporting and analytical needs by building trusted sources for data warehouses, using Snowflake and Python.
Or, alternatively, Master’s degree in Computer Science, Engineering, Information Technology, Information Systems, or a closely related field (or foreign education equivalent) and three (3) years of experience as a Principal Data Engineer (or closely related occupation) supporting reporting and analytical needs by building trusted sources for data warehouses, using Snowflake and Python.
Demonstrated Expertise (“DE”) designing and developing data warehouse applications according to business user requirements, using Snowflake, Informatica, Python, and AWS; and maintaining Continuous Integration/Continuous Delivery (CI/CD) pipelines for application code, using Jenkins, Stash, and Concourse.
DE setting up EKS, S3, IAM, CloudWatch, and Docker according to enterprise guidelines on AWS platforms; and developing Unix shell scripts (in non-production environments); and creating Control-M jobs to automate and schedule end-to-end processes.
DE maintaining coding standards, code reviews, and performance tuning of inefficient processes.
DE assessing risk, identifying the scope, creating risk management strategies; and defining modernization plans according to business requirements.

Responsibilities

Designs, develops, enhances, and tests software applications.
Supports batch processes, applications, and data movement technologies.
Implements scalable designs and software engineering best practices to develop resilient applications.
Assesses current platforms and defines the course of action for modernization.
Provides technical vision and leadership by implementing technology solutions to meet business requirements.
Collaborates with peers and the leadership team on process improvement ideas, policy, and procedure enhancements.
Implements all aspects of data engineering, warehousing, visualization, and integration.
Sets up reliable infrastructure -- software applications, hardware, scalable data management systems, and frameworks -- to perform data-related tasks.
Automates software delivery pipelines.
Works in collaborative teams to deliver high quality data solutions in a multi-developer Agile environment.
Performs deep data analysis on multiple database platforms.
Develops, creates, and modifies general computer applications software or specialized utility program.
Analyzes user needs and develops software solutions.
Designs software or customizes software for client use.
Analyzes and designs databases within an application area.