Senior Specialist - Data Engineering

LTIMindtree • Ny, NY

42d

About The Position

Seeking a Senior Specialist with 7 to 11 years of experience in AWS Databricks to design develop and manage advanced data solutions using AWS S3 and Databricks platforms

Requirements

• Design and implement scalable and efficient data pipelines and ETL processes leveraging AWS S3 and Databricks
• Collaborate with crossfunctional teams to integrate data solutions that meet complex business requirements
• Optimize data storage and retrieval strategies on AWS S3 to enhance performance and reduce costs
• Develop and maintain Databricks notebooks and scripts to support data transformation analytics and reporting
• Monitor data workflows to ensure high data quality accuracy and reliability
• Stay current with new AWS and Databricks features tools and best practices to continuously improve data platform capabilities
• RDS
• Redshift
• AWS EMR
• AWS Glue
• AWS S3
• Databricks

Responsibilities

• Lead the design development and deployment of data processing solutions on AWS Databricks
• Manage and maintain AWS S3 storage buckets including implementing data lifecycle policies and security controls
• Collaborate closely with data engineers data scientists and business stakeholders to gather analyze and translate requirements into technical solutions
• Implement and enforce data governance compliance and security standards within the data platform
• Provide technical leadership mentorship and guidance to junior team members on AWS Databricks technologies and best practices
• Conduct performance tuning and cost optimization of data workloads to ensure efficient resource utilization
• Participate actively in code reviews documentation and knowledge sharing sessions to promote team excellence

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Industry: Professional, Scientific, and Technical Services
• Education Level: No Education Listed