Data Engineer
INSPYR Solutions•Cupertino, CA
•Remote
About The Position
We are seeking a Junior Data Engineer to support a confidential project within the Health sector. This role will focus on modernizing data pipelines, optimizing metric computation, and enabling scalable analytics through cloud-based solutions.
Requirements
- 3+ years experience as a Data Engineer supporting complex environments
- Hands-on experience with AWS services, specifically Athena and managed Airflow for using Python
- Familiarity with Github
- Familiarity with Apache Spark
- Strong programming skills in SQL, Python and Pandas for writing code
- AI Agentic Coding experience, to support day-to-day productivity for production at scale
- Claude Code, Gemini, Copilot, or any similar tool will suffice.
Nice To Haves
- Experience with CI/CD tools such as Concourse CI or similar pipelines
- Familiarity with AWS Glue
- Experience with medical care delivery data
- Skill creating and integrating custom MCPs
Responsibilities
- Airflow pipeline overhaul
- Build out of Athena Operator support for Airflow jobs
- Custom SQL hidden in QuickSight moved under source control
- Compute moved to AWS Athena where possible
- Correct operators used for Python jobs
- Rebuild of Airflow testing process to remove need for separate Airflow testing for query-only updates
- Metric job optimization
- AI-driven scan of code to look for improvement opportunities
- Investigation of whether and when to use Spark
- Automated metrics extraction
- AI-based sweep of code to build text-based metrics descriptors
- Generation of v1 metrics catalog pulling from metric descriptors
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Entry Level
Education Level
No Education Listed
