Principal Software Engineer

Publicis Groupe - Saratoga, CA

Full-time - Principal

Saratoga, CA

5,001-10,000 employees

Professional, Scientific, and Technical Services

About the position

The Principal Software Engineer at Epsilon will play a crucial role in designing, developing, and optimizing data processing solutions that enable marketers to create data-driven, omnichannel consumer experiences. This position involves working with cutting-edge technology and collaborating with cross-functional teams to deliver innovative online data solutions, contributing significantly to Epsilon's success in the digital marketing space.

Responsibilities

• Design, develop, and support online data solutions.
• Collaborate with business managers to create innovative solutions.
• Implement and optimize data processing solutions using Scala, Spark, and Hadoop.
• Deploy big data solutions on on-premises and cloud infrastructure.
• Build, schedule, and maintain workflows.
• Perform data integration and transformation, troubleshoot issues, and document processes.
• Communicate technical concepts clearly across multiple countries and time zones.
• Mentor junior staff.

Requirements

• 12+ years of experience in Scala programming language.
• Extensive experience with Apache Spark for Big Data processing.
• Proficiency in performance tuning of Spark jobs and optimizing resource usage.
• In-depth understanding of the Hadoop ecosystem, including HDFS, YARN, and MapReduce.
• Expertise in designing and implementing scalable, fault-tolerant data pipelines.
• Hands-on experience with Python for developing infrastructure modules.
• Solid grasp of database systems and SQL for handling large datasets.
• Familiarity with design patterns and best practices for data modeling and partitioning strategies.
• Experience with GIT or equivalent source control and understanding of testing frameworks.

Nice-to-haves

• Experience with Databricks for unified data analytics.
• Proficiency in using the ELK stack for real-time search and log analysis.
• Background in analytics for deriving actionable insights from large datasets.
• Experience with data visualization tools like Tableau, Power BI, or Grafana.
• Familiarity with Docker and Kubernetes for containerization and orchestration.

Benefits

• Flexible work environment
• Professional development opportunities
• Health and wellness programs
• Diversity and inclusion initiatives
• Employee recognition programs