Senior Software Engineer

Microsoft • Redmond, WA

8d

About The Position

The Data and Insight team in Microsoft’s Search Foundation organization processes petabyte-scale Bing and MSN logs and provides insights into experiments. The team also supports the grounding business with real-time signals and insights, and protects Bing Search through offline bot-protection analysis and model training. This role builds scalable data analytics and insights platforms, works with mission-critical analytical data, and generates real-time insights using a combination of Azure and open-source technologies. The engineer is expected to learn and apply new technologies, resolve challenging technical problems, and maintain high standards for system performance and reliability. The position also involves leveraging AI across software development and data processing.

Requirements

• Bachelor’s degree in Computer Science or a related technical field and 4+ years of technical engineering experience coding in languages such as C, C++, C#, Java, JavaScript, or Python, or equivalent experience.
• Hands-on experience with at least one data-processing technology such as Spark or Flink and a message-queue technology such as Kafka or EventHub.
• Hands-on experience with data storage technology such as HDFS or Azure Blob.
• Fluent verbal and written English communication.
• 6+ years of backend service development experience.
• 2+ years of batch or streaming data-processing experience at petabyte scale.
• Expertise in Spark or Flink for processing petabyte-scale data daily.
• Experience optimizing data-pipeline performance.
• Experience using AI in data processing and data validation.

Nice To Haves

• 6+ years of experience in one or more coding languages such as C#, C++, or Java.
• Experience in a cloud environment such as Azure.
• Experience leveraging AI in coding or testing.
• Experience with data compliance or governance.

Responsibilities

• Design, build, and own data-processing architecture and systems for data and analytics pipelines, dashboards, and metrics using Azure and open-source technologies.
• Build core datasets and scalable, fault-tolerant pipelines.
• Develop data anomaly detection and data-quality checks, and optimize pipelines for compute and storage while meeting dataset quality and SLA requirements.
• Understand and apply data compliance and data governance requirements.
• Collaborate with cross-functional partners, including data scientists and product managers, to develop end-to-end data assets that improve products.
• Use AI technology in coding, testing, data processing, and data validation.
• Process mission-critical analytical data at large scale and support the grounding business with real-time insights.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior