Senior Data Engineer

S R INTERNATIONAL INC

7h•Remote

About The Position

The Commonwealth of Pennsylvania is seeking a Senior Data Engineer & Analytics Consultant to support the Pennsylvania Longitudinal Data System (PALDS). The role transforms complex data into reliable, actionable insights that support program delivery, operational improvements, and executive decision-making across state government agencies. The position designs and develops data pipelines; integrates and transforms data from multiple sources; addresses data quality issues; and builds analytics solutions. It works with large, complex, confidential datasets and supports data modernization, data conversions, and enterprise data architecture initiatives. The role is remote and is scheduled Monday through Friday, 8:00 AM–4:30 PM. The stated engagement duration is November 23, 2026 through December 31, 2026. Interviews are conducted in two rounds: the first via Teams and the second in person in Harrisburg for finalists.

Requirements

At least 5 years of hands-on experience with cloud-based data services, particularly AWS, including S3, EC2, Glue, EMR, RDS, Redshift, Athena, Lambda, and DynamoDB.
At least 5 years of programming or scripting experience with Python, R, Java, C++, or Scala.
At least 5 years of experience with relational and NoSQL databases, including Oracle, MS SQL Server, PostgreSQL, and Cassandra.
At least 5 years of experience with Git, version control systems, and CI/CD pipelines.
At least 5 years of experience in data modeling, including dimensional modeling, Data Vault, and Star/Snowflake schemas.
At least 5 years of experience with data cataloging and metadata management tools such as AWS Glue Data Catalog.
At least 5 years of knowledge of data governance, data lineage, and data quality frameworks.
At least 5 years of experience with REST API design and integration patterns.
At least 5 years of experience with big data technologies such as Hadoop, Spark, and Kafka.
At least 5 years of experience with data pipeline and workflow management tools such as Azkaban, Luigi, and Airflow.
At least 5 years of experience with data integration solutions such as Informatica, MuleSoft, Talend, and TIBCO.
At least 5 years of experience with stream-processing technologies such as Storm and Spark Streaming.
Advanced SQL skills and experience developing and optimizing complex queries.
Experience building and optimizing large-scale data pipelines and analytical datasets.
Experience developing dashboards, reports, analytical models, and executive decision-support products.
Strong analytical, problem-solving, project management, and organizational skills.

Responsibilities

Design, build, and maintain scalable data pipeline architectures.
Develop cloud-based data solutions using AWS services such as S3, Glue, Redshift, EMR, Athena, Kinesis, and Lambda.
Build and maintain data orchestration workflows using Apache Airflow, AWS Step Functions, or similar tools.
Integrate, transform, and process large datasets from multiple sources.
Develop analytical data environments supporting statistical analysis, predictive modeling, and machine learning.
Partner with data scientists, research analysts, and policy analysts to support research and statistical modeling.
Implement ETL processes, data quality checks, validation, monitoring, and alerting frameworks.
Develop dashboards, reports, analytical models, and decision-support tools.
Optimize data infrastructure, automate manual processes, and improve scalability.
Support data modernization, system replacement, and data conversion initiatives.
Ensure compliance with data governance, privacy, security, and Commonwealth data-sharing requirements.
Collaborate with executive, data, design, and support teams to address data infrastructure needs.