Scala Developer

American IT Systems • New York City, NY

4d • Hybrid

About The Position

Genpact is seeking a Scala Developer for a 6-month contract position in NYC, NY. This role requires a minimum of 3 days onsite per week. The developer will be responsible for developing, testing, and maintaining scalable data processing pipelines using Scala and Apache Spark. They will implement data transformation and ETL workflows, utilize Python for data processing and scripting, and optimize Spark application performance. The role also involves participating in code reviews, design discussions, and documenting solutions.

Requirements

• Strong experience in Scala and Apache Spark (Spark Core, Spark SQL, DataFrames, RDDs).
• Proficiency in Python for data manipulation, scripting, and automation.
• Proven experience with distributed computing concepts and large-scale data processing.
• Knowledge of ETL development, data warehousing, and data modeling techniques.
• Excellent communication and collaboration skills.

Nice To Haves

• Familiarity with Big Data ecosystems such as Hadoop, Hive, Kafka, or HBase.
• Experience with cloud platforms such as AWS, GCP, or Azure (particularly with Spark services).
• Familiarity with streaming data processing using Spark Streaming or Structured Streaming.
• Knowledge of data governance, security, and compliance practices.
• Basic understanding of machine learning workflows.

Responsibilities

• Develop, test, and maintain scalable data processing pipelines using Scala and Apache Spark.
• Implement data transformation and ETL workflows to handle structured and unstructured data.
• Utilize Python for data processing, scripting, and integrating Spark workflows.
• Optimize performance of Spark applications through tuning, partitioning, and caching strategies.
• Participate in code reviews, design discussions, and ensure adherence to best practices.
• Document workflows, architecture, and solutions for internal knowledge sharing.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: No Education Listed