Berkshire Hathaway Specialty Insurance-posted 3 months ago
$120,000 - $160,000/Yr
Full-time • Senior
Boston, MA

Berxi has an exciting opportunity for a Senior Data Engineer to join its Platform Engineering team in Boston, MA, driving the design, automation, and scaling of our cloud-native data platform. As a Senior Data Engineer, you’ll work closely with engineering and business leaders to design and build data integration solutions that drive enterprise analytics and decision-making. You’ll leverage cloud technologies, CI/CD pipelines, and Power BI to deliver scalable, high-performance data solutions. The ideal candidate excels in ETL programming, data integration, and data modeling, enabling self-service analytics and ensuring data accessibility, governance, and integrity. You’ll be part of an agile team, participating in Scrum ceremonies and deliver continuous value to stakeholders.

  • Collaborate with a small team of data engineers, driving excellence in data platform evolution.
  • Promote a culture of innovation, accountability, and continuous improvement.
  • Design, develop, and maintain scalable data pipelines using Azure Data Factory, Databricks, and SQL Server (T-SQL).
  • Implement configuration-driven ingestion processes for batch and near real-time data.
  • Ingest, transform, and integrate data from diverse sources (APIs, JSON, CSV, XLS, etc.) using industry best practices.
  • Analyze, design, and document data models (ERDs), create data dictionaries and data flow diagrams as part of pipeline development.
  • Design and implement Lakehouse solutions leveraging Medallion architecture.
  • Develop and maintain SSRS and Power BI datasets and reports.
  • Oversee the health, scalability, and security of the Azure-based data platform.
  • Support and enhance data governance, cataloging, and MDM initiatives.
  • Ensure data security, privacy, and compliance best practices are followed.
  • Manage access controls, data lineage, and metadata to support data discoverability and compliance.
  • Continuously evaluate and improve data engineering processes for efficiency, automation, and reliability.
  • Develop and maintain CI/CD pipelines using GitHub Actions or CircleCI.
  • Implement and refine monitoring, alerting, and observability for data pipelines and platform health.
  • Collaborate with cross-functional teams to identify and eliminate process bottlenecks.
  • Optimize data pipelines and platform components for performance, scalability, and cost-effectiveness.
  • Evaluate and implement data quality and observability tools to ensure data reliability and accessibility.
  • Work closely with the data product manager, program manager, engineering manager, and scrum master to define and deliver data products based on priorities.
  • Participate in sprint planning, backlog refinement, and Agile ceremonies.
  • Collaborate with offshore and cross-functional teams to deliver high-quality solutions.
  • Refine user stories and requirements to ensure clarity and actionability.
  • Participate in new teammate onboarding, provide guidance and mentorship to junior engineers and facilitate regular feedback sessions, career development planning, and technical upskilling.
  • Stay current with industry trends, emerging technologies, and best practices in data engineering.
  • 7+ years of professional experience in data engineering and BI, with a focus on Azure technologies.
  • Deep expertise in SQL Server (2016+), Azure Data Factory, Databricks, and NoSQL databases.
  • Strong experience in ingesting and integrating data from APIs, JSON, XML, CSV, XLS, and other formats.
  • Experience with configuration-driven data ingestion and transformation processes.
  • Strong understanding of Lakehouse architecture, data warehousing concepts, and dimensional modeling.
  • Experience with Power BI, SSRS, and/or Microsoft Fabric for reporting and analytics.
  • Hands-on experience with CI/CD tools (ADO/GitHub Actions/CircleCI) and DataOps practices.
  • Familiarity with data quality, data observability, data governance, cataloging, and MDM tools.
  • Proficient in Agile methodologies; experience with Scrum ceremonies, sprint planning, and backlog management, burndown metrics, and incremental delivery.
  • Excellent collaboration, communication, and mentoring skills, including working with offshore teams.
  • Proactive, self-driven, and committed to continuous learning and improvement.
  • Positive influence on a team of skilled data engineers.
  • Comprehensive Health, Dental and Vision benefits
  • Disability Insurance (both short-term and long-term)
  • Life Insurance (for you and your family)
  • Accidental Death & Dismemberment Insurance (for you and your family)
  • Flexible Spending Accounts
  • Health Reimbursement Account
  • Employee Assistance Program
  • Retirement Savings 401(k) Plan with Company Match
  • Generous holiday and Paid Time Off
  • Tuition Reimbursement
  • Paid Parental Leave
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service