Senior Data Engineer, Berxi

Berkshire Hathaway Specialty Insurance • Boston, MA

159d • $120,000 - $160,000

About The Position

Berxi has an exciting opportunity for a Senior Data Engineer to join its Platform Engineering team in Boston, MA, driving the design, automation, and scaling of our cloud-native data platform. As a Senior Data Engineer, you’ll work closely with engineering and business leaders to design and build data integration solutions that drive enterprise analytics and decision-making. You’ll leverage cloud technologies, CI/CD pipelines, and Power BI to deliver scalable, high-performance data solutions. The ideal candidate excels in ETL programming, data integration, and data modeling, enabling self-service analytics and ensuring data accessibility, governance, and integrity. You’ll be part of an agile team, participating in Scrum ceremonies and deliver continuous value to stakeholders.

Requirements

• 7+ years of professional experience in data engineering and BI, with a focus on Azure technologies.
• Deep expertise in SQL Server (2016+), Azure Data Factory, Databricks, and NoSQL databases.
• Strong experience in ingesting and integrating data from APIs, JSON, XML, CSV, XLS, and other formats.
• Experience with configuration-driven data ingestion and transformation processes.
• Strong understanding of Lakehouse architecture, data warehousing concepts, and dimensional modeling.
• Experience with Power BI, SSRS, and/or Microsoft Fabric for reporting and analytics.
• Hands-on experience with CI/CD tools (ADO/GitHub Actions/CircleCI) and DataOps practices.
• Familiarity with data quality, data observability, data governance, cataloging, and MDM tools.
• Proficient in Agile methodologies; experience with Scrum ceremonies, sprint planning, and backlog management, burndown metrics, and incremental delivery.
• Excellent collaboration, communication, and mentoring skills, including working with offshore teams.
• Proactive, self-driven, and committed to continuous learning and improvement.
• Positive influence on a team of skilled data engineers.

Responsibilities

• Collaborate with a small team of data engineers, driving excellence in data platform evolution.
• Promote a culture of innovation, accountability, and continuous improvement.
• Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, and SQL Server (T-SQL).
• Implement configuration-driven ingestion processes for batch and near real-time data.
• Ingest, transform, and integrate data from diverse sources (APIs, JSON, CSV, XLS, etc.) using industry best practices.
• Analyze, design, and document data models (ERDs), create data dictionaries and data flow diagrams as part of pipeline development.
• Design and implement Lakehouse solutions leveraging Medallion architecture.
• Develop and maintain SSRS and Power BI datasets and reports.
• Oversee the health, scalability, and security of the Azure-based data platform.
• Support and enhance data governance, cataloging, and MDM initiatives.
• Ensure data security, privacy, and compliance best practices are followed.
• Manage access controls, data lineage, and metadata to support data discoverability and compliance.
• Continuously evaluate and improve data engineering processes for efficiency, automation, and reliability.
• Develop and maintain CI/CD pipelines using GitHub Actions or CircleCI.
• Implement and refine monitoring, alerting, and observability for data pipelines and platform health.
• Collaborate with cross-functional teams to identify and eliminate process bottlenecks.
• Optimize data pipelines and platform components for performance, scalability, and cost-effectiveness.
• Evaluate and implement data quality and observability tools to ensure data reliability and accessibility.
• Work closely with the data product manager, program manager, engineering manager, and scrum master to define and deliver data products based on priorities.
• Participate in sprint planning, backlog refinement, and Agile ceremonies.
• Collaborate with offshore and cross-functional teams to deliver high-quality solutions.
• Refine user stories and requirements to ensure clarity and actionability.
• Participate in new teammate onboarding, provide guidance and mentorship to junior engineers and facilitate regular feedback sessions, career development planning, and technical upskilling.
• Stay current with industry trends, emerging technologies, and best practices in data engineering.

Benefits

• Comprehensive Health, Dental and Vision benefits
• Disability Insurance (both short-term and long-term)
• Life Insurance (for you and your family)
• Accidental Death & Dismemberment Insurance (for you and your family)
• Flexible Spending Accounts
• Health Reimbursement Account
• Employee Assistance Program
• Retirement Savings 401(k) Plan with Company Match
• Generous holiday and Paid Time Off
• Tuition Reimbursement
• Paid Parental Leave

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Bachelor's degree