Data Engineer

Agama Solutions • Pleasanton, CA

1d

About The Position

This role focuses on building modern data pipelines, including ingestion, profiling, integration, summarization/aggregation, logging, and DAGs. The Data Engineer will also be responsible for building data quality frameworks and performing exploratory data analysis. Experience with cloud-based data warehousing and data lake platforms is essential.

Requirements

• Bachelor's degree or equivalent experience in computer science, applied math, physics, engineering, statistics, economics or related field.
• 3+ years of industry experience in Data Engineering
• 3+ years of work experience including hands-on technical experience with SQL, Python, PySpark, Jupyter Notebook, database design, and ETL processes
• Proven experience on building modern data pipelines - Ingestion, Profiling, Integration, Summarization / Aggregation, Logging, DAG
• Strong experience building Data Quality frameworks and performing Exploratory Data Analysis (EDA)
• Proven hands-on experience with cloud-based data warehousing / data lake platforms such as AWS S3, GitRepo, Lambda

Responsibilities

• Build modern data pipelines (Ingestion, Profiling, Integration, Summarization / Aggregation, Logging, DAG)
• Build Data Quality frameworks
• Perform Exploratory Data Analysis (EDA)

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level