AWS Senior Data Engineer

EXL•Jersey City, NJ

1d•$150,000 - $170,000

About The Position

We are seeking a talented AWS Data Engineer to join the Data Engineering team. The role designs, develops, and maintains scalable data pipelines and architectures in AWS, collaborating with data scientists, analysts, and business stakeholders to deliver robust data solutions. The position also oversees organizational data engineering solutions, leads high-impact initiatives, ensures alignment with organizational goals, and provides executive guidance. The engineer builds end-to-end data solutions across ingestion, storage, integration, processing, and access, with a focus on data lakes and warehouses. Work includes developing and maintaining ETL/ELT processes and pipelines, implementing serverless and streaming solutions, migrating data to AWS, and contributing to architecture, system design, testing, code reviews, and CI/CD. The role also identifies and resolves performance issues, optimizes cost and reliability, evaluates new technologies, and works with cross-functional teams throughout the software development cycle.

Requirements

Bachelor’s degree in Computer Science, Software Engineering, MIS, or an equivalent combination of education and experience.
8+ years of experience implementing and supporting data lakes, data warehouses, and data applications on AWS for large enterprises.
Strong programming experience with Python, Shell scripting, and SQL.
Solid experience with AWS CloudFormation, S3, Athena, Glue, EMR/Spark, RDS, Redshift, DynamoDB, Lambda, Step Functions, IAM, KMS, and Secrets Manager.
Experience in serverless application development and data pipeline orchestration.
Experience in system analysis, design, development, and implementation of AWS data ingestion pipelines.
Knowledge of ETL/ELT, data modeling, and big data technologies.
Familiarity with data warehousing concepts and cloud-based architecture.
Strong problem-solving skills and attention to detail.
Excellent communication and teamwork abilities.

Nice To Haves

Experience with additional AWS services such as API Gateway, ElasticSearch, and SQS.
Experience with infrastructure-as-code tools such as Terraform and CloudFormation.
Experience with DevOps practices and CI/CD pipelines.
Experience implementing end-to-end streaming solutions using Amazon Kinesis, SQS, and Kafka.
AWS Solutions Architect or AWS Developer Certification.
Understanding of Lakehouse/data cloud architecture.
Knowledge of data governance and compliance standards.

Responsibilities

Design, build, and maintain efficient, reusable, and reliable architecture and code for data pipelines and data applications on AWS.
Build data ingestion pipelines from on-premises environments to AWS and within AWS using services such as Glue, Redshift, S3, Lambda, EMR/Spark, Kinesis, and SQS.
Develop and manage ETL/ELT processes to collect, process, and store data from multiple sources while ensuring data quality, integrity, and security.
Architect and implement end-to-end AWS data solutions for ingestion, storage, integration, processing, and access, focusing on data lakes and data warehouses.
Participate in architecture and system design discussions for high-scale data engineering projects.
Perform hands-on development and unit testing, and participate in code reviews.
Implement serverless applications using AWS Lambda, API Gateway, Step Functions, and other AWS technologies.
Migrate data from relational databases, file systems, and APIs to AWS data lakes, S3, RDS, Aurora, and Redshift.
Implement high-velocity streaming solutions using Amazon Kinesis, SQS, and Kafka.
Architect and implement CI/CD strategies for enterprise data platforms.
Collaborate with product, operations, QA, and cross-functional teams throughout the software development cycle.
Monitor new technology developments, create proofs of concept, and onboard technologies for real-world use cases.
Identify and resolve performance issues and optimize for cost, reliability, and scalability.
Oversee organizational data engineering solutions, lead high-impact initiatives, ensure alignment with organizational goals, and provide executive guidance.