Data Engineer, Specialist

Vanguard•Malvern, PA
•Hybrid

About The Position

The Data Engineer designs, builds, and supports scalable, secure, and reusable data solutions for analytics, reporting, operational workloads, and emerging AI/ML use cases. The role spans the full development lifecycle, translating business needs into production-ready data pipelines and applications using AWS, Python, Spark, and SQL. The engineer improves data quality, reliability, performance, monitoring, and engineering standards while partnering with business and technology teams.

Requirements

  • At least 3 years of experience in data engineering, software development, data management, database development, or related technical work.
  • Experience designing and developing production-grade ETL/ELT pipelines and large-scale data-processing solutions.
  • Hands-on experience developing applications and data pipelines using Python and SQL.
  • Experience with distributed data-processing technologies such as Apache Spark or PySpark.
  • Experience developing cloud-based data solutions using AWS services such as S3, Glue, EMR, Lambda, Step Functions, CloudWatch, and IAM, or comparable services.
  • Experience implementing data-quality, monitoring, testing, and operational controls for production data solutions.
  • Undergraduate degree or equivalent combination of education, training, and relevant professional experience.

Nice To Haves

  • Experience with infrastructure as code, including AWS CloudFormation or comparable technologies.
  • Experience supporting data platforms used for AI/ML or advanced analytics workloads.

Responsibilities

  • Design, develop, test, and maintain scalable ETL/ELT pipelines and data-processing solutions for analytics, reporting, operational, and AI/ML workloads.
  • Build cloud-native data solutions using AWS services, including S3, Glue, EMR, Lambda, Step Functions, IAM, CloudWatch, Secrets Manager, and CloudFormation.
  • Develop high-performance data-processing applications using Python, PySpark, Apache Spark, and SQL.
  • Integrate large-scale structured and unstructured data from multiple sources while maintaining data consistency, integrity, and accessibility.
  • Translate business and technical requirements into maintainable solution designs, production code, queries, and reusable data components.
  • Design and implement data-quality validation, reconciliation, monitoring, alerting, and operational controls to improve platform reliability.
  • Troubleshoot data pipelines and applications, identify root causes, and resolve performance, reliability, and data-quality issues.
  • Lead solutions through design, development, testing, deployment, and production support while applying established software and data engineering practices.
  • Partner with business stakeholders, engineers, and technology teams to understand data needs, explain technical considerations, and provide guidance on data solutions.
  • Contribute to engineering standards, documentation, code reviews, knowledge sharing, and adoption of new technologies and platform capabilities.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service