Snr Data engineer

RBC • Vancouver, BC

2d

About The Position

In this role as a Senior Data Engineer, you will be responsible for development deliverables for the Finance Data Platform. The Platform, leverages Airflow and Databricks and serves as the central repository of finance related datasets, with capabilities including the ingestion of positional/trade, sub-ledger, general-ledger trial balances, and reference data; as well as data enrichment, adjustment, reconciliation, analytics and reporting functions.

Requirements

• Total Experience 5+ years’ , with at least 3 years experience with Spark (Scala/Python) , Big Data ,Databricks, Airflow ,DBT
• Solid experience (as evidenced by resume) with Apache Hadoop/Hive ETL/data-pipelines or other big-data platform technology/tools Cloudera
• Solid experience (as evidenced by resume) with SQL, Oracle/PL-SQL or any ANSI-compliant RDBMS platform preferred.
• Experience on Windows/Unix/Linux OS.
• Undergraduate degree/diploma in computer science/engineering or related technology discipline.
• Solid communication and time management skills.

Nice To Haves

• Demonstrable experience with DevOps tools/technologies, including continuous integration/delivery tools and technologies such as GitHub, Jenkins, Synk, JIRA, Confluence, Airflow
• Demonstrable experience with containerization tools and technologies such as Docker, Kubernetes, Redhat OpenShift Container Platform (OCP).
• Experience with Capital Markets or other financial technology services’ middle/back office environments.
• Experience with/exposure to cloud technology platforms such as PCF (on-prem), AWS. Azure (off-prem).
• Experience with/exposure to Business Intelligence (BI)/Analytics/Reporting tools, such as Tableau, Datameer, Power BI, Presto, Snowflake, Apache Superset, etc.
• Experience with/exposure with Test driven development (TDD) and automated unit testing.

Responsibilities

• Work with the Product Owner, Product Manager, and Development Lead to understand and determine best mix of development and technical solutions to meet business requirements and project objectives.
• Work on detailed design and development phases of project initiatives; identifying, tracking and resolving technical issues.
• Ensure design/development solutions are aligned to the data/architecture strategy.
• Ensure adequate technical/reference documentation and training is in place.
• Provide assistance to the application support team in troubleshooting and resolving production issues.
• Coordinate with the Quality Engineering team on all aspects of testing and verification, ensuring quality assurance testing is performed for all changes.
• Impart knowledge, benefit of experience, and mentoring to other members of the team.

What This Job Offers

• Job Type: Full-time
• Career Level: Senior
• Education Level: Associate degree