Software Engineer II - AI Engineering

Microsoft • Vancouver, BC

19h • CA$85,800 - CA$169,300

About The Position

Microsoft's Azure Data engineering team is leading the transformation of analytics in the world of data with products like databases, data integration, big data analytics, messaging & real-time analytics and business intelligence. The products in our portfolio include Microsoft Fabric, Azure SQL DB, Azure Cosmos DB, Azure PostgreSQL, Azure Data Factory, Azure Synapse Analytics, Azure Service Bus, Azure Event Grid, and Power BI. Our mission is to build the data platform for the age of AI, powering a new class of data-first applications and driving a data culture. We do not just value differences or different perspectives. We seek them out and invite them in so we can tap into the collective power of everyone in the company. As a result, our customers are better served.

Requirements

• Bachelor's Degree in Computer Science or related technical field AND 2+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience
• Bachelor's Degree in Computer Science or related technical field AND 3+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR Master's Degree in Computer Science or related technical field AND 1+ years technical engineering experience with coding in languages including, but not limited to, C, C++, C#, Java, JavaScript, or Python OR equivalent experience.
• Experience building production-grade Python services, libraries, or distributed systems; strong software engineering fundamentals (design, testing, performance, maintainability)
• Hands-on experience with Apache Spark/PySpark and data engineering patterns for large-scale structured and unstructured data
• Solid understanding of modern LLM systems and AI Engineering: prompting, grounding/RAG, tool/function calling, agent orchestration, and evaluation methodologies
• Experience operationalizing AI/ML features: monitoring, telemetry, experimentation (A/B), rollout strategies, and cost/latency optimization
• Familiarity with cloud-native engineering on Azure (compute, storage, networking) and secure, compliant data handling
• Experience collaborating across disciplines (PM, design, research, partner teams) to deliver customer-facing AI capabilities
• Ability to meet Microsoft, customer and/or government security screening requirements are required for this role. These requirements include, but are not limited to the following specialized security screenings: Microsoft Cloud Background Check: This position will be required to pass the Microsoft Cloud background check upon hire/transfer and every two years thereafter.

Responsibilities

• Design, build, and ship scalable backend services and/or libraries in Python that power Fabric Data Engineering and Data Science experiences
• Develop LLM-enabled capabilities (prompting patterns, tool/function calling, RAG/grounding, orchestration/agents) with strong attention to latency, reliability, and cost
• Build robust data pipelines and distributed compute solutions (Spark/PySpark) to support model/data workflows, feature generation, and large-scale analytics
• Define evaluation strategies for LLM features (offline/online metrics, quality gates, safety checks), and implement telemetry/monitoring to continuously improve quality
• Apply Responsible AI and security/privacy best practices (data handling, governance, access controls) when integrating AI into customer-facing products
• Collaborate with Product Managers and partner engineering teams to translate scenarios into clear technical designs and incremental deliverables
• Maintain and operate services in production, participate in on-call/incident response, and drive improvements in operational excellence
• Review code and designs, mentor peers through constructive feedback, and contribute to engineering best practices across the team
• Embody our culture and values

Benefits

• Microsoft is an equal opportunity employer. All qualified applicants will receive consideration for employment without regard to age, ancestry, color, family or medical care leave, gender identity or expression, genetic information, marital status, medical condition, national origin, physical or mental disability, political affiliation, protected veteran status, race, religion, sex (including pregnancy), sexual orientation, or any other characteristic protected by applicable laws, regulations, and ordinances. If you need assistance and/or reasonable accommodation due to a disability during the application or the recruiting process, please send a request via the Accommodation request form (Accessibility | Microsoft Careers).

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level