Data Engineer - Boston,MA

QTech • Boston, MA

14h • Onsite

About The Position

The Data Engineer will be responsible for designing, building, and monitoring ETL/ELT pipelines for scalable data processing. This role involves automating data ingestion using APIs and scripting tools, implementing automated health checks and pipeline monitoring systems, and working with technologies such as Python, SQL, Snowflake SQL, and Databricks. The engineer will also develop and maintain comprehensive documentation, ensure seamless integration with MyPrice systems, fully implement and validate DataSpecs requirements, deliver LIG file export and quote functionality, and clear all backlog items within 6 months.

Requirements

• Proficiency in Python
• Proficiency in SQL
• Proficiency in Snowflake SQL
• Proficiency in Databricks
• Experience with API integration
• Experience with scripting tools
• Experience with ETL/ELT pipeline development and monitoring
• Ability to develop and maintain technical documentation
• Ability to ensure seamless system integration
• Ability to implement and validate requirements
• Ability to deliver specific file export and functionality

Responsibilities

• Design, build, and monitor ETL/ELT pipelines for scalable data processing.
• Automate data ingestion using APIs and scripting tools.
• Implement automated health checks and pipeline monitoring systems.
• Develop and maintain documentation including: Architectural and technical diagrams, Job schedules, Excel files detailing databases, tables, field descriptions, and business logic, Validation methodologies.
• Ensure seamless integration with MyPrice systems.
• Fully implement and validate DataSpecs requirements.
• Deliver LIG file export and quote functionality.
• Clear all backlog items within 6 months.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level
• Education Level: No Education Listed