Senior Data Engineer (REMOTE OR MA BASED)
About The Position
Our technology team is currently seeking a Senior Data Engineer to join our growing team in our Worcester, MA office or remote work arrangement. This is a full-time, exempt position. This role will primarily become proficient with all internal & external data produced and consumed by Hanover’s Core Commercial and Specialty businesses. This role will be driving larger complex projects independently as well as mentoring less experienced engineers. The Senior Data Engineer will collaborate with business partners and cross-functional teams on data and reporting requests. The assignments will become broader in nature, usually requiring originality and ingenuity. This role will be accountable for successful outcomes related to designing, developing, implementing, optimizing, and maintaining data integrations, pipelines and solutions.
Requirements
- Bachelor’s degree or higher in Data Science, Mathematics, Statistics, Computer Science, Information Systems, Business Information Technology, or equivalent
- 5 plus years professional experience in data engineering, data architecture, and/or data integration
- Advanced proficiency in SQL and Python
- Experience working with Azure, AWS, GCP, or other cloud
- Strong problem-solving, communication, and collaboration skills
- Critical thinking and attention to detail
- Must be eligible to work in the United States without requiring sponsorship now or in the future (ie. US Citizen or green card holder)
Nice To Haves
- Microsoft DP-203 or DP-700 certification
- Experience in optimizing data pipelines for scale, performance, reliability, and cost efficiency
- PowerBI experience
- Azure DevOps experience
- Azure Synapse Analytics and/or Microsoft Fabric experience
- Masters in Data Science, Mathematics, Statistics, Computer Science, Information Systems, Business Information Technology, or equivalent
- Actuarial or pricing experience within insurance industry
Responsibilities
- Complete data integration, data warehouse design, and build scalable ETL pipelines
- Display data engineering best practices for data storage, integration, transformation, and access within cloud and on-premises platforms
- Have a strong understanding of Medallion Architecture and Data Lake best practices
- Have knowledge of data modeling, governance, and security best practices
- Ensure data security and compliance within industry standards
- Have familiarity with integration connectors (APIs, File, SFTP/FTPS, Streaming Data, DB Connectors, SOAP, REST)
- Develop and maintain documentation for data integration and ETL solutions
- Build solutions within Azure Data Services (Azure Synapse Analytics, Azure SQL Database, Azure Data Lake Storage)
- Create solutions using pySpark/SparkSQL, and Delta Tables
- Create documentation for data processes
- Collaborate with data scientists, analysts, and stakeholders
- Coach, mentor, and serve as technical guidance for junior team members
- Work within agile development methodologies and use DevOps best practices
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
