Senior Software Engineer

MicrosoftRedmond, WA
76d

About The Position

Security represents the most critical priorities for our customers in a world awash in digital threats, regulatory scrutiny, and estate complexity. Microsoft Security aspires to make the world a safer place for all. We want to reshape security and empower every user, customer, and developer with a security cloud that protects them with end to end, simplified solutions. The Microsoft Security organization accelerates Microsoft’s mission and bold ambitions to ensure that our company and industry is securing digital technology platforms, devices, and clouds in our customers’ heterogeneous environments, as well as ensuring the security of our own internal estate. Our culture is centered on embracing a growth mindset, a theme of inspiring excellence, and encouraging teams and leaders to bring their best each day. In doing so, we create life-changing innovations that impact billions of lives around the world. The Platform Job Service is the core compute orchestration layer for Microsoft Sentinel Graph (MSG), designed to abstract and unify job execution across diverse engines like Spark, KQL, Azure Synapse, Fabric, and Azure Data Explorer. The team is building a highly scalable, reliable, and available infrastructure that supports a wide variety of job types—ranging from enrichment pipelines to behavioral analytics and system-level operations. PJS enables declarative job submission, where users define what they want to achieve (e.g., run a Spark job with specific parameters) without worrying about how it gets executed. The system dynamically selects the appropriate compute backend, manages dependencies, schedules execution, and provides real-time monitoring and historical analytics.

Requirements

  • Proven experience in software engineering and system design.
  • Strong knowledge of compute orchestration and job execution frameworks.
  • Experience with Spark, KQL, Azure Synapse, Fabric, and Azure Data Explorer.

Nice To Haves

  • Experience in building scalable and reliable infrastructure.
  • Familiarity with security best practices in software development.

Responsibilities

  • Design, build, and secure the compute orchestration infrastructure that powers job execution across Spark, KQL, and other engines.
  • Impact the scalability, reliability, and security posture of Sentinel Graph’s data processing backbone.
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service