Sr. BI Data Engineer

Boston Beer•Boston, MA

About The Position

As a Senior BI Data Engineer, you will design, build, and optimize enterprise-scale data solutions that support analytics and business decision-making across Boston Beer. You will work hands-on with Databricks, Azure data services, and modern data engineering practices to deliver reliable, scalable, high-performing data products. You will partner with stakeholders across multiple business functions and help drive platform modernization, engineering excellence, and technical innovation. The role includes designing and supporting Databricks Lakehouse pipelines; leading complex technical initiatives; improving production reliability and maintainability; developing reusable engineering frameworks; administering Databricks platform capabilities; managing production workflows; implementing CI/CD processes; and optimizing data pipelines, compute, and storage. You will collaborate with stakeholders and analytics teams, modernize legacy SQL Server solutions, and mentor engineers through technical guidance and reviews. Work is in a standard office environment, with occasional travel as needed for business objectives and team collaboration.

Requirements

Bachelor's degree in Computer Science, a closely related field, or equivalent practical experience.
At least 7 years of experience in data engineering, data warehousing, data integration, analytics engineering, or related technology roles.
At least 3 years of hands-on Databricks development experience supporting production environments.
Strong expertise with Databricks Lakehouse, Apache Spark, Delta Lake, Databricks Workflows, Unity Catalog, and distributed data processing.
Experience with Microsoft Azure data services, including Azure Data Factory, Azure Data Lake Storage, and Azure Key Vault.
Advanced SQL and Python skills, with experience building, operating, and optimizing complex ETL/ELT pipelines and analytical data models.
Experience with modern DevOps and data engineering practices, including Git-based development, automated testing, CI/CD, orchestration, monitoring, security, governance, and production support.
Demonstrated ability to lead technical solution design, evaluate technical trade-offs, and independently deliver complex data initiatives.
Strong communication and collaboration skills, with experience providing technical guidance to engineering teams.

Nice To Haves

Experience with advanced Databricks capabilities, including Databricks Asset Bundles, workspace administration, platform configuration, and governance.
Experience with Power BI semantic modeling, reporting enablement, and analytics consumption patterns.
Experience modernizing legacy SQL Server data solutions to cloud-based platforms.
Familiarity with AI, machine learning, feature engineering, or model-ready data products.
Knowledge of SAP, Salesforce, Supply Chain, Manufacturing, or consumer packaged goods business processes.

Responsibilities

Design, build, and support scalable Databricks Lakehouse data pipelines using Apache Spark, Delta Lake, SQL, and Python.
Lead technical design and delivery for complex data initiatives spanning multiple systems, platforms, and business functions.
Diagnose production issues, conduct root cause analysis, evaluate technical alternatives, and implement improvements to reliability, scalability, and maintainability.
Develop reusable frameworks and engineering practices for data ingestion, transformation, orchestration, testing, monitoring, data quality, and production support.
Administer and support Databricks capabilities, including workspace configuration, Unity Catalog, permissions management, and data governance.
Design and manage production workflows, including scheduling, dependency management, monitoring, alerting, and failure recovery.
Implement CI/CD processes using Azure DevOps, Git-based development workflows, and Databricks Asset Bundles.
Collaborate with business stakeholders, analytics teams, and technology partners to define requirements and deliver data solutions.
Optimize data pipelines, compute resources, and storage for performance, observability, reliability, and cost efficiency, while supporting modernization of legacy SQL Server solutions.
Mentor engineers, conduct code and design reviews, and contribute to continuous improvements in engineering standards and practices.
Work in a standard office environment and travel occasionally as needed to support business objectives and team collaboration.