Data Engineer & Insights Analyst

Global Data Consultants • Harrisburg, Pennsylvania

17h

About The Position

GDC IT Solutions is seeking a Data Engineer & Insights Analyst to support the Commonwealth of Pennsylvania’s analytics initiatives and the Pennsylvania Longitudinal Data System (PALDS). The role develops and optimizes enterprise data pipelines, integrates complex datasets, and delivers actionable insights for data-driven decision-making across state government agencies.

The position designs, develops, and maintains scalable data pipelines and cloud-based data solutions that transform disconnected datasets into trusted information. It supports PALDS by integrating data from multiple sources, improving data quality, and developing analytics products that inform education and workforce outcomes, operational improvements, and executive decisions. The successful candidate collaborates with data scientists, research analysts, policy analysts, and other stakeholders to build reliable data environments, support advanced analytics, and optimize the Commonwealth’s longitudinal data architecture.

Requirements

• Advanced SQL knowledge and experience with relational databases, query authoring, and database technologies.
• Experience building, optimizing, and maintaining big data pipelines, data architectures, and complex datasets.
• Advanced experience developing dashboards, reports, analytical models, and decision-support products for executive and non-technical users.
• Experience working with student-level higher education data, including linking education records with employment and wage data to measure outcomes and generate insights.
• Experience manipulating, processing, and extracting value from large, disconnected datasets.
• Experience building data transformation processes and managing data structures, metadata, dependencies, and workloads.
• Experience performing root-cause analysis on internal and external data to answer business questions and identify improvement opportunities.
• Strong analytical skills and experience working with unstructured datasets.
• Working knowledge of message queuing, stream processing, and highly scalable big data storage technologies.
• Strong project management, organizational, and problem-solving skills.
• Experience collaborating with cross-functional teams in a dynamic environment.
• Hands-on experience designing and implementing cloud-based data solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, Kinesis, and Lambda.
• Experience with Apache Airflow, AWS Step Functions, or comparable data orchestration technologies.
• Experience developing analytics environments for predictive modeling, machine learning, advanced statistical analysis, and reproducible research.
• Experience developing data quality controls, pipeline monitoring, automated validation, alerting, and logging frameworks.
• Experience supporting enterprise data modernization, system replacement, and data conversion initiatives.
• Familiarity with data governance, confidential data management, privacy requirements, and interagency data-sharing practices.

Responsibilities

• Design, develop, and maintain scalable data pipeline architectures for enterprise data and analytics initiatives.
• Design and implement cloud-based data solutions using AWS services, including S3, Glue, Redshift, EMR, Athena, Kinesis, and Lambda.
• Build and maintain data orchestration workflows using Apache Airflow, AWS Step Functions, or similar technologies.
• Develop and optimize infrastructure for extracting, transforming, and loading data from multiple sources using SQL and big data technologies.
• Assemble and manage large, complex datasets that meet business requirements.
• Engineer analytical data environments supporting statistical analysis, predictive modeling, machine learning, and evidence-building.
• Develop and maintain pipeline monitoring, alerting, logging, and validation frameworks to ensure data quality and reliability.
• Design and implement data transformation processes, metadata structures, dependency management, and workload management solutions.
• Develop dashboards, reports, analytical models, and decision-support products for executive and non-technical audiences.
• Build analytics tools that provide insights into education and workforce outcomes, operational efficiency, and business performance metrics.
• Partner with data scientists, research analysts, and policy analysts to support reproducible research and statistical modeling.
• Identify and implement process improvements through automation, infrastructure optimization, and scalable data delivery.
• Perform root-cause analysis to identify and resolve data quality issues and improve internal and external data processes.
• Support data conversions associated with system modernization and replacement initiatives.
• Collaborate with executive, data, design, and support teams to address technical issues and enterprise data infrastructure needs.
• Ensure compliance with Commonwealth policies, data governance standards, privacy requirements, security controls, and interagency data-sharing agreements.

Benefits

• Continuing education and industry certifications are supported.
• Medical, dental, prescription, and vision benefits.
• 401(k).
• Short- and long-term disability coverage.
• Group life insurance.
• Holiday and paid-time-off packages.
• Employee events throughout the year, including an annual gala, golf, and lunch barbecues.
• Competitive compensation and a positive work environment.

What This Job Offers

• Job Type: Full-time
• Education Level: No Education Listed