Principal Microsoft Data & AI Engineer
About The Position
This role is for a Principal Microsoft Data & AI Engineer who will be responsible for designing, building, testing, deploying, and supporting scalable data ingestion, transformation, and integration solutions. The engineer will develop reusable ETL/ELT pipelines for governed analytical data stores and semantic models, write and optimize advanced SQL, and design various data models supporting Power BI, Excel, and AI-assisted analysis. The position involves integrating diverse data sources, profiling data, building curated datasets, and using generative AI tools for development assistance while ensuring compliance with governance, privacy, security, risk, and compliance requirements.
Requirements
- Experience in Microsoft Fabric Lakehouse, Warehouse, Data Factory, Dataflows Gen2, notebooks, semantic models.
- Experience in Azure SQL, Azure Data Lake Storage, Azure Data Factory.
- Experience with Python, PySpark, PowerShell, or other data transformation/automation languages.
- Experience with Power BI (semantic models, DAX, Power Query, performance optimization, executive reporting).
- Experience with Power Apps / Power Automate.
- Experience with Databricks, Delta Lake, Spark, Medallion architecture, or comparable lakehouse experience.
- Experience supporting both BI and AI-based analysis.
- Experience in APIs, JSON, XML, HTML parsing, browser automation, or web data extraction.
- Experience with confidential/sensitive data in regulated environments.
- Experience with GitHub, Azure DevOps, CI/CD, automated testing.
Responsibilities
- Design, build, test, deploy, and support scalable data ingestion, transformation, and integration solutions using Microsoft SQL Server and Microsoft Fabric.
- Develop reusable ETL/ELT pipelines for governed analytical data stores and semantic models.
- Write and optimize advanced SQL (complex queries, stored procedures, performance-tuned routines).
- Design relational, dimensional, semantic, and analytical data models supporting Power BI, Excel, and AI-assisted analysis.
- Integrate structured, semi-structured, and unstructured data from diverse sources (databases, Excel, APIs, reports, web-based inputs).
- Profile data, identify quality issues, and implement remediation or monitoring controls.
- Build curated, analysis-ready datasets and semantic models for analysts and AI tools.
- Use approved generative AI tools to assist with SQL/code development, documentation, testing, and troubleshooting.
- Validate AI-generated outputs to ensure accuracy and compliance.
- Translate business needs into clear technical designs and usable data products.
- Follow applicable governance, privacy, security, risk, and compliance requirements.
Benefits
- Medical & pharmacy coverage
- Dental/vision insurance
- 401(k)
- Health saving account (HSA)
- Flexible spending account (FSA)
- Life Insurance
- Pet Insurance
- Short term and Long term Disability
- Accident & Critical illness coverage
- Pre-paid legal & ID theft protection
- Sick time
- other types of paid leaves (as required by law)
- Employee Assistance Program (EAP)
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Principal
Education Level
No Education Listed
