DataBricks Data engineer

Cognizant Technology Solutions-posted 3 months ago
$110,000 - $130,000/Yr
Full-time • Senior
Columbus, OH
Professional, Scientific, and Technical Services
Resume
Match Score
Upload and Match ResumeTrack Jobs with Teal

We are seeking a highly experienced Sr Data Engineer to join our dynamic team. The ideal candidate will bring deep expertise in Databricks, cloud data engineering, and modern data architecture, with a strong focus on Databricks Unity Catalog, Delta Live Tables, and Amazon S3.

  • Use Databricks SQL to analyze large datasets and deliver actionable insights.
  • Develop and maintain Delta Live Pipelines for efficient, real-time data processing and analytics.
  • Manage Amazon S3-based data lakes, ensuring data integrity, security, and accessibility.
  • Build robust data processing applications using Python and PySpark to meet evolving business needs.
  • Manage Databricks Delta Lake to ensure data consistency and reliability across platforms.
  • Integrate and orchestrate Databricks Workflows to streamline data pipelines and automation.
  • Collaborate with cross-functional teams to translate business requirements into technical solutions.
  • Provide technical leadership and best practices in data engineering and architecture.
  • Ensure compliance with data security and industry regulations.
  • Monitor and optimize system performance for high availability and efficiency.
  • Stay current with emerging technologies and trends in data engineering and cloud platforms.
  • 8-10 years of experience in data engineering roles.
  • Mandatory skills: Databricks SQL, Python and PySpark, Amazon S3, Databricks Unity Catalog.
  • Medical/Dental/Vision/Life Insurance
  • Paid holidays plus Paid Time Off
  • 401(k) plan and contributions
  • Long-term/Short-term Disability
  • Paid Parental Leave
  • Employee Stock Purchase Plan
Track Jobs with Teal

Job Search Resources

•
AI Resume Builder
•
Data Engineer Resume Examples
•
Data Engineer Cover Letter Examples

Tools

Career Hubs

Guides

Company

© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service