Senior Software Engineer
About The Position
The Data and Insight team in Search Foundation organization leverages open-source technology to process our petabyte scale data of Bing and MSN logs and provide comprehensive insight into experiments. The team also supports the grounding business with Realtime signals and insight information and protects the Bing search through offline bot protection analysis and model training. Microsoft’s mission is to empower every person and every organization on the planet to achieve more. As employees we come together with a growth mindset, innovate to empower others, and collaborate to realize our shared goals. Each day we build on our values of respect, integrity, and accountability to create a culture of inclusion where everyone can thrive at work and beyond.
Requirements
- Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
Nice To Haves
- 6+ years of experience in one or more coding languages (C#, C++, Java)
- Familiar at least one data process technology like Spark, Flink, and message queue technology like Kafka, EventHub
- Have experience on cloud environment like Azure
- Have experience on data storage technology like HDFS, Azure blob etc
- Have experience in leveraging AI technology in coding or testing work.
- Fluence verbal and written English communication.
- 6+ years’ experience in backend service development, 2+ years’ experience in batch or streaming data processing to process the PiB level data.
- Domain expert on Spark or Flink to handle PiB level data every day.
- Experience in data pipeline performance optimization
- Experience to use AI in data processing and data validation
- Data compliance or governance experience is a plus
Responsibilities
- Design, build and own the optimal data processing architecture and systems for new data and analytics pipelines, dashboards and metrics leveraging Azure and open-source technologies
- Build core datasets as well as scalable and fault-tolerant pipelines
- Build data anomaly detection, data quality checks, and optimize pipelines for ideal compute and storage systems while guaranteeing high quality and SLA datasets
- Understand the data compliance and data governance
- Collaborate with cross functional partners including data scientists and product managers to design and develop end-end data assets that help improve our products.
- Hand on at least one data process technology like Spark, Flink, and message queue technology like Kafka, EventHub
- Hand on data storage technology like HDFS, Azure blob etc
- Leverage AI technology in coding/testing/Data processing/data validation.
Benefits
- Certain roles may be eligible for benefits and other compensation.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
