Data Engineer (AWS/ETL)

CADRE GOVERNMENT SOLUTIONS

About The Position

CADRE is seeking a highly skilled Data Engineer specializing in AWS ETL to support an IT modernization program. This role is responsible for designing and operating scalable, secure data pipelines in AWS that enable real-time insights, system interoperability, and improved decision-making across LGY systems.

Requirements

5+ years of experience in data engineering, ETL development, or cloud data platforms.
Strong hands-on experience with AWS data services (Glue, S3, Redshift, Lambda, Athena).
Proficiency in Python, SQL, and data transformation techniques.
Experience with data pipeline orchestration and workflow automation.
Familiarity with DevOps/CI/CD practices in cloud environments.
Experience working in federal or regulated environments is highly desirable.
Bachelor's degree in Computer Science, Data Engineering, or related field (or equivalent experience).

Nice To Haves

AWS certifications such as AWS Certified Data Analytics – Specialty or AWS Certified Solutions Architect.
Experience supporting VA or federal civilian agencies.
Familiarity with big data tools (Apache Spark, Hadoop).
Experience with streaming platforms (Amazon Kinesis, Kafka).
Knowledge of data governance, metadata, and lineage tools.

Responsibilities

Design and implement end-to-end ETL pipelines using AWS services such as Glue, Lambda, Step Functions, and EMR.
Develop both batch and real-time data ingestion pipelines to support reporting, analytics, and operational systems.
Optimize pipelines for performance, reliability, and cost efficiency.
Build and manage data lakes (Amazon S3) and data warehouses (Amazon Redshift).
Utilize query and analytics tools such as Amazon Athena.
Define data structures, transformation logic, and partitioning strategies.
Enable integration across VA systems, Salesforce platforms, and external financial systems.
Develop API-driven and event-based ingestion pipelines.
Ensure interoperability across enterprise data ecosystems.
Integrate pipelines into CI/CD workflows using tools such as AWS CodePipeline, Git, and Jenkins.
Implement Infrastructure as Code (IaC) using CloudFormation or Terraform.
Automate deployment, testing, and monitoring processes.
Ensure all data pipelines align with federal security standards (NIST 800-53, FedRAMP, VA policies).
Implement encryption, access controls, and audit logging.
Support Authority to Operate (ATO) processes and continuous compliance monitoring.
Develop monitoring and alerting systems using Amazon CloudWatch and logging frameworks.
Troubleshoot pipeline failures and ensure high availability.
Optimize system performance and resource utilization.