Databricks Engineer Sr

Sequoia Connect

2d • Hybrid

About The Position

Our client represents the connected world, offering innovative and customer-centric information technology experiences, enabling Enterprises, Associates, and Society to Rise™. They are a USD 6 billion company with 163,000+ professionals across 90 countries, helping 1279 global customers, including Fortune 500 companies. They focus on leveraging next-generation technologies, including 5G, Blockchain, Metaverse, Quantum Computing, Cybersecurity, Artificial Intelligence, and more, on enabling end-to-end digital transformation for global customers. Our client is one of the fastest-growing brands and among the top 7 IT service providers globally. Our client has consistently emerged as a leader in sustainability and is recognized amongst the ‘2021 Global 100 Most sustainable corporations in the World by Corporate Knights. We are currently searching for a Databricks Engineer Sr : Responsibilities: Develop and fine-tune data processing pipelines specifically within the Databricks ecosystem. Implement performance optimization techniques to ensure efficient data flow and processing speeds. Integrate data solutions by collaborating closely with data science and analytics teams. Support data architecture initiatives that leverage Databricks technologies and scalable cloud structures. Resolve operational and performance issues , providing high-level support to maintain system reliability. Establish and enforce data governance and security protocols to ensure regulatory compliance. Lead knowledge transfer sessions , documenting technical processes and training team members on best practices. Requirements: Proven experience as a Senior Data Engineer with a focus on Databricks . Expertise in developing and optimizing complex data pipelines (ETL/ELT). Strong understanding of data architecture and integration with analytics/data science workflows. Solid knowledge of data governance , security protocols, and compliance standards. Proficiency in troubleshooting and resolving critical performance bottlenecks in distributed systems. Excellent communication skills for technical documentation and team mentorship. Desired: Experience with Spark (PySpark/Scala) optimization. Familiarity with Unity Catalog for governance and security. Knowledge of Delta Lake architecture and implementation. Languages Advanced Oral English. Native Spanish. Note: On-site | Hybrid | Fully remote | Temporarily remote due to COVID-19 | Work-from-home flexibility. <-- Select only one If you meet these qualifications and are pursuing new challenges, Start your application to join an award-winning employer. Explore all our job openings | Sequoia Career’s Page: https://www.sequoia-connect.com/careers/ . Requirements: Proven experience as a Senior Data Engineer with a focus on Databricks . Expertise in developing and optimizing complex data pipelines (ETL/ELT). Strong understanding of data architecture and integration with analytics/data science workflows. Solid knowledge of data governance , security protocols, and compliance standards. Proficiency in troubleshooting and resolving critical performance bottlenecks in distributed systems. Excellent communication skills for technical documentation and team mentorship.

Requirements

• Proven experience as a Senior Data Engineer with a focus on Databricks .
• Expertise in developing and optimizing complex data pipelines (ETL/ELT).
• Strong understanding of data architecture and integration with analytics/data science workflows.
• Solid knowledge of data governance , security protocols, and compliance standards.
• Proficiency in troubleshooting and resolving critical performance bottlenecks in distributed systems.
• Excellent communication skills for technical documentation and team mentorship.

Nice To Haves

• Experience with Spark (PySpark/Scala) optimization.
• Familiarity with Unity Catalog for governance and security.
• Knowledge of Delta Lake architecture and implementation.
• Languages Advanced Oral English.
• Native Spanish.

Responsibilities

• Develop and fine-tune data processing pipelines specifically within the Databricks ecosystem.
• Implement performance optimization techniques to ensure efficient data flow and processing speeds.
• Integrate data solutions by collaborating closely with data science and analytics teams.
• Support data architecture initiatives that leverage Databricks technologies and scalable cloud structures.
• Resolve operational and performance issues , providing high-level support to maintain system reliability.
• Establish and enforce data governance and security protocols to ensure regulatory compliance.
• Lead knowledge transfer sessions , documenting technical processes and training team members on best practices.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed