Senior Data Engineer

Quantiphi

7d

About The Position

As a Senior Data Engineer, you will play a key role in designing, building, and maintaining scalable data pipelines that power analytics, insights, and business decision-making. You will work across both batch and streaming architectures, leveraging PySpark, SQL, and modern data engineering frameworks to deliver reliable, high-performance data solutions.

Requirements

• 8+ years of experience in data engineering or a related field.
• Strong expertise in PySpark, SQL, and data modeling for high-volume datasets.
• Hands-on experience building and optimizing data pipelines in AWS or GCP environments.
• Track record of working with complex source systems and developing accurate extraction and transformation logic.
• Proven experience in mentoring engineers, performing code reviews, and leading technical design discussions.
• Solid understanding of distributed computing, data partitioning, and performance tuning.

Nice To Haves

• Expert-level knowledge of Azure and Databricks architecture, including Lakehouse patterns and the Medallion Framework.
• Familiarity with Delta Lake, orchestration tools, or Unity Catalog.
• Experience with CI/CD for data pipelines and automated testing frameworks.

Responsibilities

• Design, develop, and maintain scalable batch and streaming data pipelines using PySpark, SQL, and modern data engineering frameworks.
• Perform deep-dive analysis into complex source systems to define extraction patterns, transformation logic, and integration workflows.
• Implement data models optimized for analytics, performance, and operational excellence.
• Build and manage data systems across AWS or GCP cloud environments, ensuring reliability, scalability, and cost efficiency.
• Lead and participate in design reviews, provide mentorship to junior engineers, and take ownership of code quality and engineering best practices.
• Collaborate with cross-functional teams including architects, analysts, product, and platform engineers to deliver high-quality data solutions.
• Troubleshoot performance bottlenecks, optimize data processing workflows, and improve pipeline robustness.

Benefits

• Join a high-growth, AI-first digital engineering and transformation company
• Work with Fortune 500 clients and cutting-edge market disruptors
• Collaborate with a talented, dynamic, and driven team
• Gain exposure to the latest technologies in AI, ML, cloud, and data engineering

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed
• Number of Employees: 1,001-5,000 employees