Data Engineer II

MicrosoftRedmond, WA

About The Position

The Copilot and Platform Ecosystem (CAPE) team at Microsoft is responsible for enabling customer and partner success through Copilot and collaborative solutions that drive measurable business value at scale. The CAPE team is hiring a Data Engineer II to join their Data & Engineering team, which builds and operates the data pipelines, platforms, and reliability foundations that power leadership reporting, Copilot insights, agent experiences, and operational decision-making across M365 Copilot, Copilot in Teams, and Microsoft Teams. In this role, the Data Engineer II will design, build, and maintain scalable data pipelines that ingest, transform, and serve high-volume telemetry and business data. The position involves working closely with Data Scientists, Product Managers, and Engineers to ensure data is trusted, explainable, fresh, and cost-efficient, enabling downstream analytics, alerts, dashboards, and agents. Microsoft's mission is to empower every person and every organization on the planet to achieve more, fostering a culture of inclusion, growth mindset, innovation, respect, integrity, and accountability.

Requirements

  • Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering.
  • OR equivalent experience.
  • Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
  • This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice To Haves

  • 5+ years of experience in data engineering or software engineering.
  • Experience with Azure data platforms such as Azure Data Explorer (Kusto) or Cosmos DB.
  • Experience supporting analytics, reporting, or data science workloads.
  • Familiarity with orchestration, monitoring, and alerting for production data systems.
  • Strong ownership and operational accountability.
  • Experience building and maintaining data pipelines using SQL or programmatic tooling.
  • Experience working with cloud-based data platforms.
  • Understanding of data quality, validation, and operational reliability concepts.

Responsibilities

  • Partner with stakeholders to define and document data requirements (access, cadence, ownership) and assess feasibility and total cost of ownership (TCO).
  • Define data contracts and ownership boundaries with upstream system owners.
  • Design and maintain scalable data pipelines that ingest and load data into analytical platforms (e.g., Azure Data Explorer/Kusto).
  • Implement data validation and quality checks to meet SLAs for accuracy, completeness, freshness, and reliability.
  • Build orchestration and automation for dependable, repeatable data movement.
  • Transform and model data (joins, aggregations, enrichment) to power downstream datasets, dashboards, alerts, and agent experiences; contribute through code reviews and shared tooling.
  • Operationalize pipelines with monitoring, troubleshooting/runbooks, root-cause analysis, performance/cost optimization, and compliance/governance (classification, tagging, lineage, and access control).
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service