Data Engineer

Excelsior • Albany, NY

9d • Hybrid

About The Position

The Data Engineer is an integral part of the Information Technology Services department (ITS), reporting to the Director of Business Intelligence (BI). The role will be involved in efforts to ensure the accuracy, integrity, and security of data within the BI system that supports data processing and analysis needs. Interaction with stakeholders such as data governance workgroups, machine learning engineers, integration data pipeline builders, and BI developers is a key aspect of the role. The role involves designing, building, and maintaining test pipelines, data transformation or systems performance logs, and metadata or data catalogs. The Data Engineer is responsible for ensuring accurate and complete data collection, per business requirements, KPIs, and SLAs or SLOs. Gaining a thorough understanding of the data maintained in the enterprise data warehouse is mandatory. Advocating for data quality across teams is essential. This is a full-time role with at least two required days at the Excelsior home office in Albany, NY. The remaining days can be worked from home. The Data Engineer will play a significant role in shaping the data operations strategy and infrastructure of the University.

Requirements

• Bachelor's degree in computer science, information technology, systems engineering, database management, or related field
• 8 years of experience writing and troubleshooting complex SQL queries (PL/SQL and TSQL) and Python or R data frame functions.
• Strong understanding of relational database systems and data warehousing concepts.
• Strong analytical, research, and critical thinking.
• Experience in creating data quality requirements analysis documentation.

Nice To Haves

• Experience with reporting tools (Power BI, QlikView, or QlikSense).
• Ability to work with a diverse group of stakeholders in a collaborative manner and communicate effectively.
• Excellent organizational skills

Responsibilities

• Work with data analysts, data governance workgroups, and other stakeholders to understand their needs and translate them into technical requirements.
• Maintain a strong understanding of business workflows, processes, and events, and relate this understanding to how these are captured in transactional systems.
• Develop and implement strategies to ensure data is clean and reliable.
• Design and execute tests to validate data transformations, migrations, and storage within the data warehouse environment.
• Identify any errors or inconsistencies in the enterprise data warehouse.
• Write technical documentation and term definitions in the Data Governance Platform.
• Implement data governance and ensure data integrity across all BI initiatives.

What This Job Offers

• Job Type: Full-time
• Career Level: Mid Level