Data Engineer

DMV IT Service • Boston, MA

81d

About The Position

The Lead Data Engineer will be responsible for designing, developing, and maintaining scalable data engineering and analytics solutions. This role involves building and optimizing data pipelines, ensuring data integrity and reliability, and collaborating with cross-functional teams to deliver high-quality investment data.

Requirements

• Bachelor’s degree in Computer Science or a related field.
• At least 5 years of experience in designing and developing complex data-driven applications.
• 2–4 years of hands-on experience with SQL, including advanced SQL development.
• Strong background in ETL/ELT processes, data integration, data warehousing, and analytics architecture.
• Proficiency with Snowflake and other cloud-native databases is highly desirable.
• Development experience on cloud platforms such as Microsoft Azure, Google Cloud Platform (GCP), or Amazon Web Services (AWS).
• Strong knowledge of Agile SDLC, DevOps practices, and modern cloud technologies.
• Familiarity with data management architectures such as UDM, data mesh, event-driven architecture, and real-time data streaming.
• Experience in financial services with knowledge of financial instruments, transactions, and positions is a plus.
• Excellent communication and interpersonal skills with the ability to lead cross-functional collaboration.

Responsibilities

• Design, build, and manage end-to-end data pipelines to support the Investment Data Management Office (IDMO).
• Lead and contribute to development activities aligned with strategic program objectives.
• Develop and maintain pipelines sourcing data from internal and external providers.
• Continuously improve data quality, efficiency, resilience, monitoring, and controls.
• Troubleshoot complex system issues to identify and resolve root causes.
• Collaborate with platform leads to design, implement, and deploy new data platform components.
• Work with data architects to define and implement a unified data model.
• Partner with integration architects to upgrade and enhance ingestion and delivery tools.
• Integrate transformation, validation, and orchestration tools to strengthen data engineering and analytics capabilities.
• Provide technical support during system outages and incidents.

What This Job Offers

• Career Level: Senior
• Education Level: Bachelor's degree