Senior Data Engineer (REMOTE OR HYBRID MA)
About The Position
Our technology team is currently seeking a Senior Data Engineer to join our growing team in our Worcester, MA office or remote work arrangement. POSITION OVERVIEW: Data engineering is the aspect of data science that focuses on practical applications of data collection and analysis. This role will primarily involve becoming proficient with all internal and external data produced and consumed by THG. This role will be driving larger, more complicated projects independently as well as mentoring less experienced engineers. The Senior Data Engineer will collaborate with business partners and assume a data/tech lead role on cross-functional teams delivering data/reporting solutions. The assignments will usually require originality and ingenuity.This role will be accountable for successful outcomes related to designing, developing, implementing, optimizing, and maintaining data integrations, pipelines, and solutions. This is a full-time, exempt position.
Requirements
- Bachelor’s degree or higher in Data Science, Mathematics, Statistics, Computer Science, Information Systems, Business Information Technology, or equivalent.
- 5 plus years professional experience in data engineering, data architecture, data integration.
- Must be eligible to work in the United States without requiring sponsorship now or in the future (i.e., US Citizen or green card holder).
Nice To Haves
- Microsoft DP-203 or DP-700 certification.
- Microsoft Fabric experience
- Power BI experience.
- Master’s degree in data science, Mathematics, Statistics, Computer Science, Information Systems, Business Information Technology, or equivalent.
Responsibilities
- Proven experience in data engineering and best practices for data storage, integration, transformation, and access within Azure and on-premises platforms.
- Proven expertise in designing and implementing data solutions utilizing Azure Resources (Azure Data Factory, Azure Synapse, ADLS, etc).
- Strong experience with data integration, ETL processes, and data warehousing.
- Advanced proficiency in SQL, Python, and PowerShell.
- Proven knowledge of data modeling, governance, and data engineering best practices and patterns.
- Hands-on experience with optimizing data ingestion pipelines and notebooks for scale, performance, reliability, and cost efficiency.
- Familiarity with integration connectors (APIs, File, SFTP/FTPS, Streaming Data, DB Connectors, SOAP, REST).
- Strong problem-solving, communication, and collaboration skills.
- Ability to create documentation for data processes and solutions.
- Ensure data security and compliance with industry standards.
- Experienced in agile development methodologies and DevOps best practices.
- Git/Github experience for CI/CD.
- Coaching, mentoring, and technical guidance for junior team members.
- Analytical skills for profiling and analyzing large data sets.
- Critical thinking and attention to detail.
- Debugging skills for data solution issues.
- Collaborate with data scientists, analysts, and stakeholders.
- Monitor and maintain data pipelines.
- Design, develop, and test data mapping with transformation rules.
- Ensure data quality and reliability.
- Develop and maintain documentation for data integration and ETL solutions.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Number of Employees
501-1,000 employees
