Principle Software Engineer

Microsoft•Redmond, WA

About The Position

Microsoft is a company where passionate innovators come to collaborate, envision what can be and take their careers further. This is a world of more possibilities, more innovation, more openness, and the sky is the limit thinking in a cloud-enabled world. Microsoft’s Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics, and business intelligence. The products our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture. Within Azure Data, the Microsoft Fabric platform team builds and maintains the operating system and provides customers a unified data stack to run an entire data estate. The platform provides a unified experience, unified governance, enables a unified business model and a unified architecture. The Fabric Data & Telemetry team is part of the Fabric Platform. It is responsible for all platform capabilities in support of “observability” – From telemetry creation (APIs, event repositories, etc.), through routing and storage, to eventual consumption tools and data models. This observability is critical for the service and business and supports pillars such as live-site monitoring, diagnostics, analytics for operations and product development, and ensuring Fabric customers have high quality data for their own observability needs. The charter of the team is to provide Fabric stakeholders, partners and clients with world-class data for running the Service and Business. The team and its members work across different codebases, disciplines, platform components and observability pillars. In particular, the team is required to function within the service core, applying classic cloud and software engineering practices and tools, as well as a core-data team, applying (big) data-engineering and analytical practices and tools. As a software Engineer on the [YA1.1]team, you will play a key role in shaping the future of our platform. Using the latest Azure technologies, you will design and build scalable telemetry infrastructure and instrumentation services, create data pipelines and facilitate the access of the telemetry data to our users, create tools that help team self-serve their data needs, and act as an advisor for partner team to guide them on how to instrument their internal and external telemetry events , you will create job monitoring and notification services for data pipelines, and streamline daily operations through automation. As a Principal Software Engineer on the team, you will serve as the technical lead for our data platform, driving architectural direction and long term strategy while solving complex scalability challenges across distributed processing systems. You will act as the connective layer between infrastructure and data engineering teams, ensuring our telemetry platform, pipelines, and services operate reliably and efficiently at massive scale. You will design and guide the implementation of high performance, cost efficient big data solutions, advise partner teams on optimal data models and architectural patterns, and influence engineering decisions across the organization through deep technical expertise and strong cross team collaboration. We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served.

Requirements

Bachelor's Degree in Computer Science or related technical field AND 6+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check:
This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Nice To Haves

Master's Degree in Computer Science or related technical field AND 8+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Bachelor's Degree in Computer Science or related technical field AND 12+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Experience with big data technologies such as: Hadoop, Hive, Spark.
6+ years of experience in software engineering, with proven proficiency in C#, [YA1] Java, or equivalent.
6+ years of experience working and building distributed cloud services using Azure or similar technology stacks.
Experience with big data technologies such as: Hadoop, Hive, Spark.
Experience with data modeling and data pipeline design.

Responsibilities

Drive the architectural vision and technical strategy for high quality APIs, SDKs, and large scale data pipelines, ensuring the platform can support massive volume data collection, transformation, and consumption for analytics and AI workloads.
Design and guide the development of frameworks to validate data quality and completeness, detect anomalies, enhance data pipeline resiliency, and support unit and integration testing.
You will lead the design and implementation of end-to-end software features—including development, unit testing, CI/CD, and monitoring—using agile practices in close collaboration across stakeholders, Product Management, and partner teams.
Serve as the SME for key components in the telemetry pipeline, providing technical leadership and advocating for improvements ensuring the accuracy, efficiency, and scalability of data collection and processing.
Deliver high quality features and data pipelines by leveraging industry best practice and using cutting edge technologies including Fabric/Azure-Data stack.
You will anticipate data governance needs, designing data modeling and handling procedures to ensure compliance with all applicable laws and policies.
You will implement and enforce security and access control measures to protect sensitive resources and data.
Be part of the on-call rotation for maintaining service health.
You will mentor junior engineers, lead technical discussions, and drive best practices in software engineering.
Embody our culture and values