Data Engineer

Qode•Washington, PA

2d•$100,000 - $140,000•Hybrid

About The Position

We are seeking a skilled Data Engineer to join our Wealth Management team. The role involves developing data-related solutions and software, working with relational databases, and leveraging cloud technologies, particularly within the Microsoft Azure stack. The ideal candidate will have extensive experience in ETL/ELT processes, database technologies, programming languages, and IT infrastructure standards. This position requires a Bachelor's degree and a minimum of 5 years of relevant experience. The role involves designing, building, and deploying data pipelines, managing data storage models, and providing operational support. Additionally, the Data Engineer will collaborate with business intelligence and IT teams, coordinate security and monitoring, and mentor junior personnel.

Requirements

Bachelor's degree in Computer Science, Information Technology, or other relevant field
5+ years' experience developing data-related solutions and software
5+ years of experience working with relational databases and applying it in various applications, including within the Microsoft Azure platform
2+ years of experience with multiple cloud technologies in the Microsoft Stack (Azure IaaS and PaaS) along with familiarity with alternative cloud technologies
2+ years of experience designing and development on-premises and cloud-based (Azure) infrastructure and platform components
2+ years of hands-on development and deployment experience with Azure cloud using T-SQL, Azure SQL, Azure Storage, Azure Data Factory, Azure Synapse, Cosmos DB, GitHub, Azure DevOps, and CI/CD pipelines
Advanced knowledge of Extract/Transform/Load (ETL) and/or Extract/Load/Transform (ELT) tools, including both batch and real-time data transmission applications such as SSIS, Informatica, Kafka, Spark, MuleSoft, or equivalent software
Advanced knowledge of database technologies such as Microsoft SQL Server, Oracle, or NoSQL databases
Advanced knowledge of multiple programming languages, such as Python, SQL, Scala, or similar
Advanced knowledge of IT infrastructure standards and tools, such as application performance monitoring, IT service management, or DevOps software

Responsibilities

Use Agile practices to elicit and refine requirements through an iterative process of planning, defining acceptance criteria, prioritizing, developing and delivering enterprise data asset solutions in collaboration with business intelligence teams or other IT teams
Develop, configure, customize and manage integration tools, databases, warehouses and analytical systems
Design, build, and deploy data extraction, transformation, and loading processes and pipelines from various sources including databases, APIs, and data files
Develop and deploy structured, semi-structured, and unstructured data storage models and dimensional data models on various platforms to meet business requirements
Coordinate security, application monitoring, development tooling, and related capabilities with responsible teams
Provide operational support and incident management for data pipelines and data flows, including proactively updating internal clients and relevant parties on status changes and issues encountered
Author and maintain accurate and up-to-date documentation for processes, procedures, and technical designs
Coach junior data and business intelligence personnel across the company, including developing material and guiding junior personnel on their technical skill growth