AWS Data Engineering Advisor
Engie•Houston, TX
•Hybrid
About The Position
We are looking for an AWS Data Engineering Advisor to build applications and accelerate delivery using Agentic AI coding. As the Data Engineering Advisor, you will report to Senior Data Architect, you will focus on developing production-ready software, integrating AI agents into engineering workflows, and using AWS services to deliver secure, scalable solutions.
Requirements
- Bachelor’s degree in Computer Science, Information Technology, MIS, or a related discipline, or an equivalent combination of education and relevant experience
- A minimum of 7 years of data engineering experience, with strong AWS implementation depth
- Strong Python skills for data engineering and pipeline development
- Hands-on experience with S3, Glue, Athena, IAM, Secrets Manager, and CloudWatch
- Experience with Spark/PySpark and large-scale data processing
- Experience writing and optimizing SQL for analytical workloads
- Experience with Parquet-based lake design, partitioning, and performance tuning
- Experience with containerized data workloads (Docker) and orchestration on AWS Batch and ECS
- Familiarity with streaming concepts and Kinesis-based ingestion
- Strong software engineering practices, including modular code, testing, code reviews, and CI/CD awareness
- Ability to troubleshoot production data pipelines and drive root-cause resolution
Responsibilities
- Build and maintain robust ETL/ELT pipelines in Python on AWS
- Develop ingestion workflows from external systems, for example Snowflake and APIs, into S3-based data lake zones
- Implement and optimize data processing with AWS Glue (Spark/PySpark), Athena SQL, and Parquet/Iceberg table patterns
- Create and maintain streaming data workflows using Amazon Kinesis
- Manage schema validation, data quality checks, partitioning strategy, and metadata consistency
- Build reusable utility libraries for AWS interactions, including sessions, Secrets Manager, S3, Athena, and Glue
- Implement config-driven pipeline execution and operational controls using services like DynamoDB
- Own deployment and runtime operations for containerized workloads on AWS Batch and ECS with ECR
- Ensure observability through structured logs, run summaries, retry logic, and alerting hooks
- Partner with analytics, platform, and business teams to deliver reliable datasets and SLA-backed pipelines
Benefits
- medical
- dental
- vision
- life insurance
- employer-paid short-term and long-term disability insurance
- ESPP
- generous paid time off
- wellness days
- holidays
- leave programs
- 401(k) Retirement Savings Plan with a company match
- supplemental benefits for full time employees that enhance emotional and physical well-being through all stages of life from family forming to caregiver benefits
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
