DataBricks Data engineer

Cognizant Technology Solutions • Columbus, OH

143d • $110,000 - $130,000

About The Position

We are seeking a highly experienced Sr Data Engineer to join our dynamic team. The ideal candidate will bring deep expertise in Databricks, cloud data engineering, and modern data architecture, with a strong focus on Databricks Unity Catalog, Delta Live Tables, and Amazon S3.

Requirements

• 8-10 years of experience in data engineering roles.
• Mandatory skills: Databricks SQL, Python and PySpark, Amazon S3, Databricks Unity Catalog.

Responsibilities

• Use Databricks SQL to analyze large datasets and deliver actionable insights.
• Develop and maintain Delta Live Pipelines for efficient, real-time data processing and analytics.
• Manage Amazon S3-based data lakes, ensuring data integrity, security, and accessibility.
• Build robust data processing applications using Python and PySpark to meet evolving business needs.
• Manage Databricks Delta Lake to ensure data consistency and reliability across platforms.
• Integrate and orchestrate Databricks Workflows to streamline data pipelines and automation.
• Collaborate with cross-functional teams to translate business requirements into technical solutions.
• Provide technical leadership and best practices in data engineering and architecture.
• Ensure compliance with data security and industry regulations.
• Monitor and optimize system performance for high availability and efficiency.
• Stay current with emerging technologies and trends in data engineering and cloud platforms.

Benefits

• Medical/Dental/Vision/Life Insurance
• Paid holidays plus Paid Time Off
• 401(k) plan and contributions
• Long-term/Short-term Disability
• Paid Parental Leave
• Employee Stock Purchase Plan

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Industry: Professional, Scientific, and Technical Services