Data Engineer, Infrastructure FinOps

Anduril IndustriesCosta Mesa, CA
2d

About The Position

Anduril’s Infrastructure Engineering organization provides the digital foundations for all aspects of our business. We are evolving into a more data-driven approach for designing, building, and managing the critical infrastructure that ingests, transforms, and serves massive datasets to power analytics, machine learning, and intelligent applications. We are seeking a highly skilled Data Engineer with a strong software engineering foundation to help build and scale our next-generation data platform. This is a high-impact role where you will have the autonomy to architect robust systems that unlock critical business insights from complex, large-scale data

Requirements

  • 5+ years of experience in a data engineering or a similar software engineering role, ideally building data products in a fast-paced environment.
  • Strong programming proficiency in Python.
  • Hands-on expertise with at least one major cloud data platform such as Google BigQuery, Databricks, or an enterprise data system like Palantir Foundry.
  • Expert-level SQL and query optimization skills on large-scale datasets.
  • Solid understanding of data modeling concepts, ETL/ELT design patterns, and data warehousing/lakehouse principles.
  • Experience with a major cloud environment (GCP, AWS, Azure), including its security ecosystem and containerization technologies (Docker, Kubernetes).
  • Must be eligible to obtain and maintain a US Top Secret security clearance.

Nice To Haves

  • Hands-on experience with data orchestration and transformation tools like Spark, PySpark, and dbt.
  • Experience with Infrastructure as Code (e.g., Terraform, CloudFormation) for managing data resources.
  • Knowledge of real-time data streaming technologies (e.g., Kafka, Flink, Pub/Sub).
  • Experience implementing CI/CD pipelines for data applications (e.g., GitHub Actions, Jenkins).
  • Experience with or a strong interest in learning how to develop data services and data products using modern software architecture and API design principles.
  • Familiarity with data visualization tools, such as Tableau

Responsibilities

  • Design and Build Scalable Data Pipelines: Architect, develop, and maintain robust and efficient ETL/ELT pipelines to process petabyte-scale data from a wide variety of sources using platforms like Google BigQuery , Databricks, and Palantir Foundry .
  • Apply Software Engineering Principles: Treat data infrastructure as a software product. Develop reusable frameworks, libraries, and tools to accelerate data pipeline development and ensure reliability , using best practices like version control, code reviews, and CI/CD.
  • Architect and Model Data: Design and implement well-structured, performant data models and schemas in our data warehouse and data lakehouse environments, optimized for both analytical querying and application use.
  • Ensure Data Quality and Reliability: Implement comprehensive data quality checks, monitoring, and alerting to proactively identify and resolve data issues. Troubleshoot and optimize performance bottlenecks in data processing and storage layers.
  • Be a Force Multiplier: Collaborate closely with data scientists, analysts, software engineers, and business stakeholders

Benefits

  • Healthcare Benefits US Roles: Comprehensive medical, dental, and vision plans at little to no cost to you. UK & AUS Roles: We cover full cost of medical insurance premiums for you and your dependents. IE Roles: We offer an annual contribution toward your private health insurance for you and your dependents.
  • Income Protection : Anduril covers life and disability insurance for all employees.
  • Generous time off : Highly competitive PTO plans with a holiday hiatus in December. Caregiver & Wellness Leave is available to care for family members, bond with a new baby, or address your own medical needs.
  • Family Planning & Parenting Support: Coverage for fertility treatments (e.g., IVF, preservation), adoption, and gestational carriers, along with resources to support you and your partner from planning to parenting.
  • Mental Health Resources: Access free mental health resources 24/7, including therapy and life coaching. Additional work-life services, such as legal and financial support, are also available.
  • Professional Development: Annual reimbursement for professional development
  • Commuter Benefits: Company-funded commuter benefits based on your region.
  • Relocation Assistance: Available depending on role eligibility.
  • Retirement Savings Plan US Roles: Traditional 401(k), Roth, and after-tax (mega backdoor Roth) options. UK & IE Roles: Pension plan with employer match. AUS Roles: Superannuation plan.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service