Sr. Software Engineer - Big Data
About The Position
LiveRamp is hiring a Sr. Software Engineer for its Identity Engineering team, which maintains a graph processing engine connecting trillions of consumer and device identifiers. The role focuses on processing this large-scale graph efficiently and delivering product requests and enhancements related to scalability, modernization, performance, cost, security, legal compliance, reliability, and quality. The engineer will work on initiatives such as architectural refreshes and proofs of concept for batch data processing, developing REST APIs, and migrating applications to Spark and SingleStore. The goal is to improve processing speed, scalability, maintainability, and cost-effectiveness. The role involves leading complex problems, collaborating with teammates and cross-functional partners, modernizing applications, and delivering high-quality software with privacy and security as priorities.
Requirements
- At least 6 years of professional software development experience, primarily focused on big data technologies.
- At least 3 years of experience writing and optimizing large-scale batch processing using Spark, Hadoop, or similar technologies.
- At least 3 years of Java and SQL programming experience.
- At least 2 years of experience using cloud platforms such as GCP, AWS, Azure, or similar technologies.
- Experience with technologies such as Docker, Terraform, and/or Kubernetes.
- A team-oriented, startup-minded approach, with qualities including being smart, ethical, friendly, hardworking, and productive.
Nice To Haves
- Experience with GCP products such as BigTable, BigQuery, Dataproc, and PubSub, or data tools such as Kafka, Hive, or Apache Beam.
- Experience with development tools such as Terraform, Kubernetes, Helm, or Gradle.
- Experience designing and implementing interfaces and infrastructure for large-scale systems and RESTful APIs.
Responsibilities
- Break complex problems into essential components, then design and implement solutions focused on delivered value.
- Deliver solutions in collaboration with the team and cross-functional teams.
- Modernize applications to be modular and scalable using current technology stacks.
- Collaborate with product managers and other engineers to deliver high-quality software.
- Apply privacy- and security-first principles while favoring rapid delivery and iteration.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
