Data Engineer II

Microsoft•Redmond, WA

About The Position

The Copilot and Platform Ecosystem (CAPE) team at Microsoft is responsible for enabling customer and partner success through Copilot and collaborative solutions that drive measurable business value at scale. CAPE is hiring a Data Engineer II to join our Data & Engineering team, where we build and operate the data pipelines, platforms, and reliability foundations that power leadership reporting, Copilot insights, agent experiences, and operational decision-making across M365 Copilot, Copilot in Teams, and Microsoft Teams. In this role, you will design, build, and maintain scalable data pipelines that ingest, transform, and serve high-volume telemetry and business data. You will work closely with Data Scientists, Product Managers, and Engineers to ensure data is trusted, explainable, fresh, and cost-efficient, enabling downstream analytics, alerts, dashboards, and agents. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees, we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.

Requirements

Master's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 1+ year(s) experience in business analytics, data science, software development, data modeling, or data engineering.
OR Bachelor's Degree in Computer Science, Math, Software Engineering, Computer Engineering, or related field AND 2+ years experience in business analytics, data science, software development, data modeling, or data engineering.
OR equivalent experience.
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role.
These requirements include but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice To Haves

5+ years of experience in data engineering or software engineering.
Experience with Azure data platforms such as Azure Data Explorer (Kusto) or Cosmos DB.
Experience supporting analytics, reporting, or data science workloads.
Familiarity with orchestration, monitoring, and alerting for production data systems.
Strong ownership and operational accountability.
Experience building and maintaining data pipelines using SQL or programmatic tooling.
Experience working with cloud-based data platforms.
Understanding of data quality, validation, and operational reliability concepts.

Responsibilities

Partner with stakeholders to define and document data requirements (access, cadence, ownership) and assess feasibility and total cost of ownership (TCO).
Define data contracts and ownership boundaries with upstream system owners.
Design and maintain scalable data pipelines that ingest and load data into analytical platforms (e.g., Azure Data Explorer/Kusto).
Implement data validation and quality checks to meet SLAs for accuracy, completeness, freshness, and reliability.
Build orchestration and automation for dependable, repeatable data movement.
Transform and model data (joins, aggregations, enrichment) to power downstream datasets, dashboards, alerts, and agent experiences; contribute through code reviews and shared tooling.
Operationalize pipelines with monitoring, troubleshooting/runbooks, root-cause analysis, performance/cost optimization, and compliance/governance (classification, tagging, lineage, and access control).