Specialist - Data Engineering
About The Position
Seeking a Specialist with 5 to 7 years of experience in AWS Databricks to design develop and manage data solutions leveraging AWS S3 and Databricks platforms Design and implement scalable data pipelines and ETL processes using AWS S3 and Databricks Collaborate with crossfunctional teams to integrate data solutions aligned with business requirements Optimize data storage and retrieval strategies on AWS S3 for performance and cost efficiency Develop and maintain notebooks and scripts in Databricks to support data transformation and analytics Monitor and troubleshoot data workflows and ensure data quality and reliability Stay updated with the latest AWS and Databricks features and best practices to enhance data platform capabilities
Requirements
- RDS
- Redshift
- AWS EMR
- AWS Glue
- AWS S3
- Databricks
Responsibilities
- Lead the development and deployment of data processing solutions on AWS Databricks
- Manage and maintain AWS S3 storage buckets including data lifecycle and security policies
- Collaborate with data engineers data scientists and business stakeholders to gather and translate requirements
- Implement data governance and compliance standards within the data platform
- Provide technical guidance and mentorship to junior team members on AWS Databricks technologies
- Conduct performance tuning and cost optimization of data workloads
- Participate in code reviews documentation and knowledge sharing sessions
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Industry
Professional, Scientific, and Technical Services
Education Level
No Education Listed
