Lead Spark Scala Engineer

TCS • Austin, TX

1d

About The Position

We are seeking a Lead Spark Scala Engineer with strong expertise in Apache Spark and Scala to design, build, and optimize large‑scale data platforms. The ideal candidate must have prior Apple experience and proven ability to lead technical execution, manage distributed systems, and drive strategic initiatives across complex data environments.

Requirements

• Strong experience in Apache Spark with Scala.
• Hands‑on expertise with Scala DataFrame APIs.
• Knowledge of AWS/S3, Iceberg, Git.
• Strong SQL and data modeling skills.
• Experience building/managing applications for large‑scale data platforms.
• Skilled at troubleshooting distributed systems.
• Strong understanding of technical concepts and ability to think strategically.
• Prior Apple experience (mandatory).
• Familiarity with using a Mac laptop.
• Excellent communication and project management skills.
• 6–8 years of experience in Spark/Scala engineering.
• Proven track record in large‑scale data platform development.
• Prior Apple project experience is mandatory.

Nice To Haves

• Experience with data analytics and interpretation beyond data movement.
• Ability to identify how data transformations impact downstream analytics and metrics.
• Strong strategic thinking and ability to handle fast‑paced, ambiguous projects with multiple stakeholders.

Responsibilities

• Design and develop Spark applications using Scala DataFrame APIs.
• Build and manage applications for large‑scale data platforms including storage, ingestion, governance, and performance optimization.
• Troubleshoot and resolve complex issues in distributed systems.
• Collaborate with cross‑functional teams to deliver on status reporting, roadmap reviews, quarterly engineering reviews, and newsletters.
• Drive technical execution and ensure alignment with strategic objectives.
• Analyze and interpret data transformations, ensuring accuracy and consistency in analytics and metrics.
• Provide leadership in project management, communication, and stakeholder engagement.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed