Lead Data Engineer
RBC•Toronto, ON
•Onsite
About The Position
We are seeking a Lead Data Engineer to build and maintain scalable data pipelines supporting analytics and reporting. The engineer will follow end-to-end process standards and guidelines to ensure accurate and efficient build out of data pipeline architecture within project timeframes.
Requirements
- 3+ years of hands-on data engineering experience.
- Strong technical proficiency in Python: Production-quality code for data pipelines, automation, and scripting, including PySpark.
- Strong technical proficiency in SQL: Advanced query writing, optimization, indexing, stored procedures.
- Strong technical proficiency in ETL: Utilizing DataFrames for building programmatic ETL data pipelines.
- Strong technical proficiency in AWS: S3, Glue, Lambda, Redshift, Cloudwatch.
- Strong technical proficiency in Snowflake: Data warehousing, virtual warehouses, clustering, security.
- Strong technical proficiency in dbt: Model development, testing, documentation, incremental builds.
- Familiarity with data orchestration tools (Airflow).
- Demonstrated ability to work independently, take ownership, and drive projects to completion.
- Excellent problem-solving skills and attention to detail.
Nice To Haves
- Knowledge of data streaming platforms or queues (Apache Kafka, AWS Kinesis, RabbitMQ)
- Experience in building Kotlin, Spring boot and Java applications.
- Familiarity with Parquet formatting to maximize I/O performance and storage efficiency across data lakes.
Responsibilities
- Design, implement and maintain data ingestion and transformation pipelines.
- Build transformation models and data pipelines using dbt.
- Develop optimized SQL transformations for large datasets.
- Implement data quality checks and validation logic within ETL pipelines.
- Monitor data pipelines and troubleshoot production issues.
- Collaborate with data analysts and architects to design scalable data models.
- Document data lineage, transformations, and technical architecture.
- Participate in Agile development processes and code reviews.
Benefits
- bonuses
- flexible benefits
- competitive compensation
- commissions
- stock where applicable
- Leaders who support your development through coaching and managing opportunities
- Ability to make a difference and lasting impact
- Work in a dynamic, collaborative, progressive, and high-performing team
- A world-class training program in financial services
- Flexible work/life balance options
- Opportunities to do challenging work
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Upload and Match Resume
What This Job Offers
Job Type
Full-time
Career Level
Senior
Education Level
No Education Listed
