Member of Technical Staff - Full Stack Software Engineer

Microsoft•Mountain View, CA

2d•Hybrid

About The Position

Microsoft AI is looking for a Member of Technical Staff – Full Stack Software Engineer to help build the next wave of capabilities for our personalized AI assistant, Copilot. At Microsoft AI, we push boundaries to deliver exceptional products and services that empower users to be more productive and efficient. If you are passionate about innovation and want to shape the future of AI, this is your opportunity. In this role, you will work across all four stages of our evaluation platform: data sampling, AI data collection and processing, data analysis and evaluation, and insight generation. You will contribute across the full stack—from backend databases and middle-tier services to browser automation, statistical analysis, and dashboard creation. Expect to dive into prompt engineering and leverage cutting-edge AI tools to drive meaningful impact. This engineering position offers exposure to a wide range of technologies and surfaces, including desktop, web, and mobile. You will collaborate closely with teams across Microsoft AI to assess Copilot’s relevance, performance, trustworthiness, and visual appeal. Our platform supports desktop and mobile automation and UX studies—enabling scenarios like multi-turn conversations with voice input on iOS and Android apps. The possibilities are endless. By applying for this position, you are required to be local to Redmond, WA or Mountain View, CA locations and in office 4 days a week.

Requirements

Bachelor's Degree in Computer Science or related technical field AND 4+ years technical engineering experience with coding in languages including, but not limited to C#, Java, or Python OR equivalent experience.

Nice To Haves

2+ years’ experience with SQL, PostgreSQL or MySQL
2+ years' experience building scalable services on top of public cloud infrastructure like Azure, AWS, or GCP.
Extensive use datastores like RDBMS, key-value stores, etc.
Experience with Development & Debugging with dev environments like Visual Studio or Visual Studio Code
HTML, CSS, JavaScript, ASP.NET, REST, jQuery
Familiarity with browser automation tools like Selenium, Puppeteer or Playwright
Familiarity with mobile automation tools like Appium
Familiarity with LLMs and AI ChatBots
Prompt Engineering
Azure DevOps, GIT
Azure Open AI, Azure Foundry
Experience in leading technical projects and supporting architectural decisions with data.

Responsibilities

Expertise in experimentation methodologies, including A/B evaluation, data sampling, measurement techniques, evaluation design, and data analysis.
Demonstrating strategic vision by understanding organizational goals, translating metrics into actionable insights, and enhancing product quality.
Designing pipeline architecture to ensure rapid iteration and scalability.
Conducting post-analysis of labeled data and developing dashboards to visualize insights.
Collaborating closely with the product team to enhance quality and address gaps.
Embody our Culture and Values.