About The Position

The Senior Data Engineer will join the Data Platform organization, focusing on infrastructure capacity planning, forecasting, utilization analytics, and cost optimization. The role involves designing, developing, and maintaining scalable data pipelines and analytical data models that integrate infrastructure telemetry, cloud consumption, workload demand, and financial data. This position supports data-driven infrastructure investment decisions by providing visibility into compute, GPU, TPU, storage, and cloud resource utilization; forecasting future capacity requirements; and identifying cost optimization opportunities. The engineer will collaborate with Infrastructure Engineering, Data Science, Finance, Procurement, and Business Operations to build reliable data products for strategic capacity planning. The role is remote in Brazil, Mexico, Chile, or Colombia, with Pacific Hours coverage from 8:00 AM to 5:00 PM PST.

Requirements

  • 10+ years of experience.
  • Strong proficiency in SQL, including complex queries, joins, window functions, and query optimization.
  • Proficiency in Python for data processing, automation, and analytical workflows.
  • Experience with Pandas, PySpark, or similar data processing frameworks.
  • Hands-on experience building scalable ETL/ELT pipelines.
  • Strong understanding of data warehousing, data modeling, and distributed data processing.
  • Experience with Apache Spark, Airflow, Kafka, Trino, or similar technologies.
  • Knowledge of data quality frameworks, pipeline monitoring, and data governance.
  • Experience working with AWS, Google Cloud Platform, or Microsoft Azure.
  • Understanding of cloud billing, resource utilization, and consumption datasets.
  • Knowledge of compute, storage, networking, and infrastructure resource metrics.
  • Understanding of capacity management, resource utilization, and demand forecasting.
  • Experience analyzing historical trends and predicting future resource requirements.
  • Knowledge of time-series forecasting, statistical modeling, and scenario analysis.
  • Ability to identify infrastructure bottlenecks and resource optimization opportunities.
  • Experience with Tableau, Power BI, Looker, or similar visualization tools.
  • Ability to develop operational dashboards and executive-level reporting.
  • Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, Statistics, Mathematics, or a related quantitative discipline; equivalent practical experience in Data Engineering, Infrastructure Analytics, or Capacity Planning will also be considered.
  • Strong problem-solving skills, ownership, attention to detail, and ability to collaborate across engineering and business teams.

Nice To Haves

  • Familiarity with GPU/TPU infrastructure and AI/ML workload consumption.
  • Experience in cloud infrastructure analytics or FinOps.
  • Exposure to GPU/TPU capacity planning and AI/ML infrastructure.
  • Understanding of machine learning inference workloads and compute economics.
  • Experience working with large-scale infrastructure telemetry datasets.
  • Knowledge of infrastructure cost allocation and unit economics.
  • Experience supporting financial forecasting, budgeting, or procurement decisions.

Responsibilities

  • Design, develop, and maintain scalable ETL/ELT pipelines that ingest, process, and transform infrastructure and cloud consumption data.
  • Integrate data from cloud billing systems, infrastructure telemetry, workload management platforms, and financial systems.
  • Develop optimized data models and analytical datasets for infrastructure utilization, capacity tracking, and cost reporting.
  • Implement data validation, reconciliation, monitoring, and quality checks to ensure data accuracy and reliability.
  • Optimize pipelines for performance, scalability, and operational efficiency.
  • Develop data-driven solutions to monitor and forecast infrastructure capacity requirements.
  • Analyze utilization trends across GPU, TPU, CPU, memory, and storage resources.
  • Build forecasting models to predict future compute demand based on workload growth and business requirements.
  • Identify capacity constraints, resource bottlenecks, underutilization, and infrastructure risks.
  • Support capacity planning through demand forecasting, scenario analysis, and capacity optimization.
  • Develop dashboards and reporting to track available capacity, committed capacity, utilization, and projected demand.
  • Analyze cloud infrastructure consumption and billing data across cloud platforms.
  • Develop cost attribution models for infrastructure spending across workloads, teams, and business units.
  • Calculate infrastructure cost metrics, including cost per GPU hour, CPU hour, workload/job, inference request, and million tokens.
  • Identify cost optimization opportunities such as idle resources, underutilized infrastructure, and inefficient capacity commitments.
  • Partner with Finance and Procurement to reconcile infrastructure costs and support financial planning.
  • Design and maintain dimensional and analytical data models for infrastructure capacity and financial reporting.
  • Develop reusable datasets and metrics for operational and strategic decision-making.
  • Perform root-cause analysis of utilization anomalies, cost fluctuations, and capacity deviations.
  • Build automated reports and dashboards that provide actionable stakeholder insights.
  • Ensure consistency between operational telemetry, consumption records, and financial reporting.
  • Work with Infrastructure Engineering to understand workload patterns, infrastructure architecture, and capacity requirements.
  • Collaborate with Finance and Procurement on infrastructure budgeting, cloud commitments, and cost forecasting.
  • Partner with Data Science and Machine Learning teams to understand AI/ML workload requirements and compute consumption patterns.
  • Translate technical and financial data into meaningful insights and recommendations for leadership.
© 2026 Teal Labs, Inc
Privacy PolicyTerms of Service