Staff Data Platform Engineer

Rivian and VW Group TechnologyIrvine, CA

About The Position

Rivian and Volkswagen Group Technologies is a joint venture between two industry leaders with a clear vision for automotive’s next chapter. From operating systems to zonal controllers to cloud and connectivity solutions, we’re addressing the challenges of electric vehicles through technology that will set the standards for software-defined vehicles around the world. The road to the future is uncharted. By combining our expertise across connectivity, AI, security and more, we’ll map a new way forward. Working together, we’ll create a future that’s more connected, more intelligent, more sustainable for everyone. RV Tech is seeking a strong Data Platform Engineer to architect and scale the infrastructure powering the next generation of software-defined electric vehicles. In this role, you will be responsible for the design and optimization of our core data processing and analytics infrastructure, with a specific emphasis on multi-region Databricks orchestration. You will partner with cross-functional teams to deliver robust, industry-leading solutions that move the automotive world forward. We value proactive problem-solvers who thrive in autonomous roles and are passionate about building performant, scalable systems.

Requirements

  • Education: Bachelor's or Master's degree in Computer Science, Data Science, or a related field.
  • Experience: 3+ years of hands-on experience in a similar role, with a proven track record of building and maintaining large-scale data processing systems.
  • Databricks Platform Expertise: Solid understanding of the Databricks platform and core concepts such as Delta, Spark, Unity Catalog, data governance, and workspace administration.
  • Terraform and DevOps Background: History of using Terraform to manage large scale systems via Infrastructure as Code, and utilizing other technologies to build and maintain CI/CD pipelines.
  • Problem-Solving Skills: Exceptional analytical and problem-solving skills, with the ability to break down complex problems into manageable components.
  • Communication & Collaboration: Excellent communication and interpersonal skills, with the ability to collaborate effectively with cross-functional teams around the globe.
  • Cloud Computing: Experience working with cloud-based technologies (e.g., AWS, GCP, Azure)

Nice To Haves

  • PySpark Expertise: Background designing scalable data pipelines using the Spark ecosystem (e.g., Spark SQL, Spark Streaming).
  • AWS proficiency: Familiarity with core services such as IAM permissions, VPC networking, EC2 compute, and S3 storage.

Responsibilities

  • Infrastructure Management: Design, deploy, and maintain our data platform infrastructure using Terraform and other Infrastructure as Code (IaC) principles.
  • Databricks Platform Expertise: Manage and optimize our Databricks platform, ensuring it remains secure, performant, and cost-effective at a global scale.
  • System Design & Architecture: Lead the technical design of data systems, considering factors like scalability, reliability, and performance. You'll be expected to make informed decisions that align with our long-term architectural vision.
  • Stakeholder Collaboration: Communicate effectively with data producers, data consumers, and business leaders to gather requirements, provide technical guidance, and ensure the data platform meets their technical and legal needs.
  • Troubleshooting & Issue Resolution: Proactively identify and resolve issues that may arise with the Databricks platform.
  • Staying Ahead of the Curve: Stay up-to-date with the latest advancements in big data technologies, cloud computing, and DevOps practices.

Benefits

  • Total compensation packages for this position include base salary, eligibility for an annual performance bonus, and eligibility for equity.
  • Benefit offerings include Flex Time Off, retirement savings plans as well as medical, vision and dental coverage.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service