Data Engineer - AWS/Databricks - REMOTE
About The Position
This position is posted by Jobgether on behalf of a partner company. We are currently looking for a Data Engineer - AWS/Databricks. In this role, you will leverage your expertise in building and maintaining scalable data pipelines and cloud-native solutions. You will play a critical role in optimizing data platforms for various federal clients, ensuring robust data integration and efficient workflows. Your contributions will significantly impact the enterprise's data modernization efforts, fostering effective data enablement and decision-making across teams. The ideal candidate will have a passion for innovation and a drive for excellence in data engineering.
Requirements
- 10+ years of experience in data engineering and Agile analytics.
- 5+ years of experience architecting and maintaining complex data products at enterprise scale.
- 3+ years of experience with structured and unstructured data processing.
- 3+ years of experience building scalable ETL and ELT workflows.
- 3+ years of experience with AWS and Databricks for enterprise data solutions.
- Experience with data quality and validation frameworks.
- BA or BS degree.
- US Citizen with ability to obtain and maintain US Suitability.
Responsibilities
- Build and maintain scalable PySpark-based data pipelines in Databricks notebooks.
- Design and implement Delta Lake tables optimized for ACID compliance and query performance.
- Develop robust ETL and ELT workflows integrating multiple source systems into a data warehouse architecture.
- Leverage Spark SQL and DataFrame APIs to implement business rules and aggregation logic.
- Collaborate with data architects to implement cloud-native data solutions on AWS.
- Optimize pipeline performance through intelligent partitioning and adaptive query tuning.
- Deploy and version data engineering assets using Git-integrated workflows and CI/CD tools.
- Monitor pipeline health and optimize cost-performance tradeoffs.
- Conduct technical discovery of legacy systems and design end-to-end data flows.
- Implement governance practices including metadata tagging and data quality validation.
Benefits
- Innovative excellence in a recognized workplace.
- Competitive compensation and benefits packages.
- Opportunities for personal growth through tailored training and mentorship.
- Exceptional customer feedback and visibility in the industry.
- A collaborative culture that encourages teamwork.
- Commitment to diversity and inclusion in the workplace.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
11-50 employees
