Data Engineer – Big Data Platform

PNC•Pittsburgh, PA

2d•$86,250 - $172,500•Onsite

About The Position

As a Data Engineer within PNC's Technology organization, you will be based in Pittsburgh, PA, Dallas, TX, Cleveland OH or Birmingham, AL. We are seeking a Data Engineer to help support large-scale enterprise big data platforms. This team is responsible for building and evolving modern data solutions that enable analytics across the organization while partnering closely with business stakeholders. Ideal candidates thrive in problem-solving environments, help shape analytical solutions, and contribute to the design of a next-generation, cloud-native data platform.

Requirements

Strong proficiency in relevant programming languages such as Python, Spark, Scala
Strong background and practical experience in SQL development and enterprise database systems (Oracle, Teradata, etc.)
Experience with modern, cloud-native and open-source tools is highly valued: Apache Iceberg, Apache Airflow, Trino
Strong experience in modern data engineering and big data ecosystems / frameworks
Hands-on experience building scalable data platforms and analytical solutions using data lakehouse architectures
Familiarity with cloud platforms (e.g Azure , AWS ) and their data related services
Proven ability to go beyond data movement and contribute to solution design
Strong communication and presence — able to translate between technical and non-technical audiences
Proven ability to bridge the gap between business and engineering teams
Collaborative mindset with experience working across cross-functional teams
Strong problem-solving and critical thinking skills
Customer Focused - Knowledgeable of the values and practices that align customer needs and satisfaction as primary considerations in all business decisions and able to leverage that information in creating customized customer solutions.
Managing Risk - Assessing and effectively managing all of the risks associated with their business objectives and activities to ensure they adhere to and support PNC's Enterprise Risk Management Framework.

Nice To Haves

Analytical Thinking
Big Data
Competitive Advantages
Data Analytics
Data Lakehouse Architecture
Data Mining
Data Science
Machine Learning (ML)
Python (Programming Language)
Structured Query Language (SQL)

Responsibilities

Monitor, maintain, and improve the health and performance of the data platform
Ensure stability, reliability, and scalability of data systems
Implement best practices for platform operations and data engineering standards. Ensure understanding and adherence across technical and business customers
Perform frequent reviews of the data platform architecture and identify areas for automation, optimization, right-sizing, and cost reduction to support health of the environment
Contribute to large-scale transformation initiatives, including: Driving user migration to a unified data platform, Modernizing legacy Hadoop-based systems to cloud-native architectures
Design and build scalable, modern data platforms leveraging: Open-source technologies such as Apache Iceberg, Airflow, and Trino, Data lakehouse architecture for structured, transactional data availability
Partner with business stakeholders to translate analytical needs into technical solutions
Apply modern principles, methodologies and tools to advance business initiatives and capabilities
Act as an internal consultant to internal customers on big data tools and capabilities
Enhance and optimize query performance and data structures to support analytical
Guide stakeholders in understanding how to leverage data for business insights
Define and implement internal process improvements through the development of detailed analytics that provide actionable insights into key business performance metrics
Develops, supports and implements data services for multiple applications to meet business objectives and user requirements.
Uses technical knowledge and industry experience to design, build and maintain technology solutions.
Works closely with users, developers, operations and business partners to define data service requirements and the data preparation process development.
Designs and builds data service infrastructure on multiple data platforms, according to key business processes and the overall workflow.
Develops and implements data solutions for multiple applications to ensure its scalability, availability and maintainability.
Implements data migration and transformation activities/processes to ensure the accuracy and security of data solutions.

Benefits

medical/prescription drug coverage (with a Health Savings Account feature)
dental and vision options
employee and spouse/child life insurance
short and long-term disability protection
401(k) with PNC match
pension and stock purchase plans
dependent care reimbursement account
back-up child/elder care
adoption, surrogacy, and doula reimbursement
educational assistance, including select programs fully paid
a robust wellness program with financial incentives
maternity and/or parental leave
up to 11 paid holidays each year
9 occasional absence days each year, unless otherwise required by law
between 15 to 25 vacation days each year, depending on career level; and years of service