Data Engineer

WestJet Group•Calgary, AB

15d•Onsite

About The Position

WestJet is seeking a highly skilled, motivated and experienced Data Engineer reporting into our Airline Ops Integrations Team. In Airline Operations we build and maintain a range of critical software applications and integrations that ensure our people and planes get guests to their destinations. We specialize in all types of airline operational data from flights to maintenance to crew. The individual we’re looking for is meticulous when it comes to data quality and is driven to perfection in their entire data engineering process, from planning and ingestion right through to delivery. They live and breathe data, and their sense of achievement and satisfaction is attained by rolling up their sleeves and producing quality results day in and day out. This individual also loves programming, and Python is second nature to them. This position will have a large impact on the team and ultimately the data that is driven all the way from the source to the application development teams and the organization, therefore curiosity, plasticity, adaptability and self-motivation are fundamental requirements.

Requirements

Bachelor's degree in Computer Science, Engineering, Statistics, Mathematics, or related field
5+ years of experience working in very large data warehouse environments
Experience building critical real-world solutions in Airline, transportation, logistics or similarly complex organizations
5+ years of demonstrated SQL development
3+ years of Data Warehouse experience in a project environment
2+ years of experience building data pipelines and Data Lake/Lakehouse solutions using Apache Spark/ PySpark leveraging Databricks or similar technologies
Experience with MQ and/or Kafka or similar enterprise messaging
Experience and proficiency with Data dimensional modeling, data analysis and data mining
Expert in writing SQL Scripts, using window functions, and Query optimization
Experience with Custom File Formats, setting up Ingestion Monitoring
Experience with ETL, ELT, and data warehouse automation tools
Experience writing Test Automation, and manual testing
Experience handling PII Data and applying data masking
Experience conducting large scale data analysis to support business decision making
Experience in designing and delivering cross functional data solutions
Experience with WhereScape and Snowflake
Experience with languages such as Python, Bash, PowerShell
Experience with Enterprise data migration and multi-source data ingestion
Experience with Jira or Azure DevOps
Knowledge of security by design methodologies applied to technology and security services
Experience with cloud-based computing services and data warehouses like Snowflake, Azure, or similar
Strong data related analytical, critical thinking, and problem-solving skills
Strong ability to develop meaningful, repeatable, and consistent quality checks throughout the development process
Excellent oral and written communication skills including the ability to communicate effectively with both technical and non-technical stakeholders
Proven ability to meet tight deadlines, multi-task, and prioritize workload

Nice To Haves

Azure Data Engineering or Snowflake certifications considered a plus

Responsibilities

Participate in development planning and execute engineering tasks in alignment with the broader Data Delivery strategy
Apply established data engineering standards and methods to ensure compliance, and take ownership of assigned deliverables within a data engineering project
Utilize approved programming tools and techniques, provide technical support for existing tools, and adhere strictly to team-based standards
Actively participate in a communal learning and knowledge-sharing culture, collaborating with peers and offering support to junior team members
Produce detailed designs and document work using required standards, methods, and tools, including prototyping tools where appropriate
Write, analyze, and refactor code and scripts to maintain and improve system robustness, resilience, and stability
Translate logical designs into physical designs
Lead reviews of own work and that of colleagues’
Ensure that assigned daily support activities are dealt with in a successful and timely manner
Design, implement and test cloud computing solutions using Snowflake
Create, monitor, and optimize ETL/ELT processes and migrate on-premises solutions to Snowflake
Develop, test, and monitor distributed data processing pipelines using Apache Spark within the Databricks environment, applying standard performance tuning techniques to optimize job execution
Write clean, efficient, and maintainable Python code for data ingestion, transformation, and automation tasks, ensuring adherence to the team's established version control and testing standards
Ensure delivery meets requirements and service-level expectations
Set up manual and automated testing and test all your results to ensure quality and speed
Lead workshops, presentations, and training that provide skill and knowledge development for the team
Work with operational partners to ensure the supportability of new features/products and to provide timely technical support and fixes to production applications
Regularly make decisions under minimal guidance that have a significant impact on the organization’s financial and business operations
Communicate with stakeholders effectively, frequently and responsively to their concerns, issues, feedback, and questions.