Data Engineer (GCP)

EquinixDallas, TX
5d

About The Position

As a key member of the Data Team at Equinix, we are seeking an experienced GCP Data Engineer who will lead end-to-end development of complex Data Engineering use cases and drive the evolution of Equinix's Data Lake platform. You will design and build enterprise-scale data infrastructure and analytics solutions on Google Cloud Platform while providing technical mentorship to the data engineering team. The ideal candidate combines deep technical expertise in cloud-native data technologies with proven leadership skills and a passion for building robust, scalable data platforms that drive strategic business insights.

Requirements

  • GCP Services: 5+ years hands-on experience with BigQuery (advanced SQL, scripting, ML integration), Cloud Dataflow, Cloud Composer, Cloud Storage, Pub/Sub, and Vertex AI
  • Programming: Expert-level Python/Java programming, proficiency in Python/Scala for Spark development
  • Advanced Technologies: Deep experience with Apache Beam, Airflow, Kubernetes, Docker, and distributed computing
  • Infrastructure: Extensive experience with Terraform, CI/CD pipelines, and cloud infrastructure management
  • Database Systems: Advanced knowledge of both relational and NoSQL databases, data modeling, and performance optimization
  • Bachelor’s or master’s degree in computer science, Engineering, or related field
  • 5+ years of data engineering experience with 4+ years specifically on Google Cloud Platform
  • Proven track record of delivering complex, enterprise-scale data solutions
  • Experience with data governance, compliance, and security frameworks
  • Excellent written and verbal communication skills with ability to present to executives
  • Experience working with cross-functional projects and managing stakeholder relationships
  • Proven ability to translate business requirements into technical solutions
  • Google Cloud Professional Data Engineer certification

Nice To Haves

  • Experience with MLOps, feature stores, and machine learning pipeline development
  • Knowledge of data science workflows and statistical analysis
  • Experience with BI tools (Looker, Tableau) and advanced analytics platforms

Responsibilities

  • Participate in design and implementation of enterprise-scale data pipelines and platform architecture for End-to-End data products.
  • Develop fault-tolerant, petabyte-scale data processing systems using advanced GCP services
  • Evaluate and recommend new technologies, tools, and architectural approaches
  • Build complex ETL/ELT workflows using Cloud Dataflow, Composer, Dataform/dbt, BigQuery and custom solutions
  • Implement sophisticated real-time streaming architectures with Cloud Pub/Sub, Kafka and Apache Beam
  • Design and optimize data processing workflows for performance, cost, and reliability
  • Develop advanced data transformation logic and custom processing functions
  • Implement data architectures and microservices-based data platforms
  • Design multi-environment deployment strategies and automated scaling solutions
  • Establish monitoring, alerting, and observability frameworks across the data platform
  • Lead code reviews and establish quality assurance processes
  • Provide technical guidance on complex problem-solving and optimization techniques
  • Facilitate knowledge sharing sessions and technical training programs
  • Collaborate with hiring managers on technical interviews and team expansion
  • Implement comprehensive data governance frameworks and compliance controls
  • Design fine-grained access controls and data classification systems
  • Establish automated data quality monitoring and lineage tracking
  • Ensure GDPR, SOX, and other regulatory compliance across data workflows
  • Implement privacy-preserving techniques and data anonymization strategies
  • Translate complex business requirements into scalable technical solutions
  • Coordinate cross-functional initiatives involving multiple engineering teams

Benefits

  • Employee Assistance Program: An Employee Assistance program is available to all employees.
  • Insurance: You may enroll in health, life, disability and voluntary plans that are designed for you and your eligible family members.
  • Retirement: You and Equinix may contribute to a retirement plan to help you plan for your financial future.
  • Paid Time Off (PTO) and Paid Holidays: You will receive an accrued amount of PTO each pay period along with various paid holidays for you to rest and recharge.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service