RQ10840 - Software Developer - ETL - Senior

Maarut•Toronto, ON

About The Position

The Software Developer - ETL - Senior will be responsible for designing, implementing, and continuously expanding data pipelines through extraction, transformation, and loading activities. This role requires translating technical system specifications into functional, tested applications, including developing detailed programming specifications, writing and generating code, compiling data-driven programs, and conducting unit tests. The position also involves resolving and troubleshooting technical problems that arise during software operation, providing technical assistance in implementation, conversion, and migration.

Requirements

Experience in programming and analysis; specialized software package support at the specified experience level.
Experience in structured methodologies for the development, design, implementation and maintenance of applications.
Experience in design, code, test, debug and document applications.
Experience in the use of object and/or third generation language development tools.
Experience in one or more programming languages.
Experience in application design, latest design patterns, deployment and troubleshooting.
Experience with relational and hierarchical database technologies.
Experience in the use of information retrieval packages using query languages.
Experience with one or more communications protocols.
Experience in structured methodologies for the design, development, implementation and maintenance of applications.
Experience eliciting and documenting information from diverse business area stakeholders and subject matter experts.
Excellent analytical, problem-solving and decision-making skills; verbal and written communication skills; interpersonal and negotiation skills.
A team player with a track record for meeting deadlines.
Knowledge and experience in gathering requirements and business process knowledge in order to transform the data in a way that’s geared towards the needs of end users.
Knowledge and experience maintaining and improving already existing processes.
Knowledge and experience ensuring that the data architecture is scalable and maintainable.
Knowledge and experience working with the business in designing and delivering correct, high quality data.
Experience investigating data to identify potential issues within ETL pipelines, notify end-users and propose adequate solutions.
Experience preparing detailed documentation for further reference.
5+ years of experience with Data warehousing design and development with focus on extracting, transforming data coming from various data sources and loading into star/snowflake schemas.
5+ years of experience with Design, build, automate and optimize complex data ETL/ELT processes using PL/SQL and equivalent.
5+ years of experience with Writing complex procedures/pkg/views/scripts to do data de-normalization, data extraction, data transformation(cleansing), and data loading.
5+ years of experience with Creating data assets (denormalized) from highly normalized Oracle database, and load the data asset to another type of DBMS (Microsoft SQL DBs, Postgress, etc.).
5+ years of experience with Relational databases (Oracle, MySQL, SQL Server), data modelling (relational & dimensional), advanced SQL, query optimization, data replication, administration.
5+ years of experience with Advanced SQL skills (PL/SQL, TSQL).
5+ years of experience with Scripting languages (Python, Unix shell).
5+ years of experience with Cloud technologies (Azure, Google, AWS).
5+ years of experience with Advanced skills and hands-on experience with Azure SQL Server and Azure Data Factory.
5+ years of experience with Proficient in creating Data Factory pipelines for copy activity and custom Azure development.
5+ years of experience with PL/SQL for data extraction, transformation, and loading, initial setup and other ETL experience management and support, such as troubleshooting, performance tuning, failover and recovery.
5+ years of experience with Elasticsearch for search/reporting, tuning for performance optimization.
5+ years of experience with Working knowledge of issue tracking system JIRA, Azure DevOps.
5+ years of experience with Using Git hub for version control and data model changes.
5+ years of experience with Oracle Enterprise Manager (OEM Cloud 12c, OEM 11g Grid), Oracle Names Server, Oracle Net Service, Oracle Connection Manager, and Oracle Advanced Security, Oracle RAC, Oracle Network, Names Server, Data Guard, Oracle Exadata, Oracle Warehouse Builder (OWB).
5+ years of experience with PL/SQL Programming for database change tracking and data warehousing.
5+ years of experience with Data migration and data integration across different platforms (Windows to UNIX, Windows to Windows, UNIX to UNIX).
5+ years of experience with Recovery (Restore) and refresh production and Dev/UAT/Test using RMAN to SAN storage.
5+ years of experience with Technical analysis, program code, detailed programming and reports specifications, program design, writing and /or generating code, and conducting unit tests.
5+ years of experience with Software in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways.
5+ years of experience with Developing and maintaining system design models, technical documentation and specifications.
5+ years of experience with Conducting technical evaluation and assessment of options for technical design issues, application figuration aspects and integration capabilities, related tools and utilities, gap analysis of integration components to technical requirements/specifications/documentation.
5+ years of experience with Provide Business intelligence and data analytics, data warehouse design, dimensional data modeling, relational data modeling development and support.
5+ years of experience with Conduct research and assessment of options for technical design issues.
5+ years of experience with Contributing to design/development project plans, including work breakdown and resources estimates.
5+ years of experience with Working with the business analysts to translate the business requirements and functional specifications into an application design appropriate to meet the business and operational/IT needs.
5+ years of experience with Working with technical systems specifications and translating them into working, tested applications for large, complex, mission critical applications.
5+ years of experience with Work with Quality Assurance (QA) to code, test, and debug extensions/tools integration services.
5+ years of experience with Analysis, design and development work on complex, multi-tier web-based applications, micro-services architecture, and off-the-shelf solutions.
5+ years of experience with Proven technical leadership skills with ability to identify areas for improvement, and recommend solutions.
5+ years of experience with Undertaking proof of technology with test data to simulate application load and performance tuning related applications.
5+ years of experience with Providing software expertise in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways.
5+ years of experience with Providing application programming support for incident management, application functionality sustainment, performance tuning and technical documentation.
5+ years of experience with Web database performance optimization.
5+ years of experience with Ensuring compliance with architecture framework and system standards, and Agile Development Methodology.
5+ years of experience with Software Development Lifecycle (SDLC) end-to-end Agile/scrum and Waterfall methodologies.
5+ years of experience with Knowledge and experience with leading-edge technologies, design criteria including usability, security, and privacy or web and mobile applications.
Experience working with inter-jurisdiction projects between federal/provincial/municipal governments.
Knowledge of the provincial Environmental services and the legislative framework that governs the data.
Experience with data migration and integration of with different Environmental systems.
Knowledge of OPS Enterprise Architecture artifacts (or similar), processes and practices, and ability to produce technical documentation that comply with industry-standard practices.
Experience adopting and adhering to OPS Unified I&IT Project Methodology, OPS Enterprise Architecture and OPS Gating process, and OPS Standard Systems Development Methodologies.
Exceptional analytical, problem solving and decision-making skills.
Demonstrated strong interpersonal, verbal and written communication skills.
Demonstrated troubleshooting and critical thinking experience.
Demonstrated ability to apply strong listening skills to facilitate issue resolution.
Effective consulting skills to engage with all stakeholders with proven track record for building strong working relationships.
Excellent customer service skills, including tact and diplomacy to ensure client needs are managed effectively.
Highly motivated, flexible, detail-oriented and creative team player with perseverance, excellent organization and multitasking abilities, and a proven track record for meeting strict deadlines.

Nice To Haves

Knowledge and experience with programming Internet-ready applications.
Knowledge and experience in rapid application development (RAD) and Agile methodologies.
Knowledge and understanding of Information Management principles, concepts, policies and practices.
Experience with middleware and gateways.
Experience reviewing, analyzing, and modifying product installation scripts including encoding, testing, debugging.
Ability to provide post-implementation support and resolve any post-implementation technical issues.
Experience conducting design walkthrough sessions with project team.
Knowledge and understanding of Accessibility for Ontarians with Disability Act (AODA) and related regulations and standards.
Ability to provide user and system documentation as required.

Responsibilities

Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities.
Translate technical systems specifications into working, tested applications. This includes developing detailed programming specifications, writing and/or generating code, compiling data-driven programs, maintaining, and conducting unit tests.
Resolve and troubleshoot technical problems which arise during the use and operation of software packages, including technical assistance in implementation, conversion and migrations.
Gather requirements and utilize business process knowledge to transform data according to end-user needs.
Maintain and improve existing processes.
Ensure that the data architecture is scalable and maintainable.
Work with the business in designing and delivering correct, high-quality data.
Investigate data to identify potential issues within ETL pipelines, notify end-users, and propose adequate solutions.
Prepare detailed documentation for further reference.
Collaborate with IT Professionals throughout the Software Development Life Cycle.
Design, code, test, debug, and document applications.
Use object and/or third generation language development tools.
Design, develop, implement, and maintain applications using structured methodologies.
Design, implement, and maintain applications using structured methodologies.
Elicit and document information from diverse business area stakeholders and subject matter experts.
Design, build, automate, and optimize complex data ETL/ELT processes using PL/SQL and equivalent.
Write complex procedures/pkg/views/scripts to do data de-normalization, data extraction, data transformation (cleansing), and data loading.
Create data assets (denormalized) from highly normalized Oracle databases and load them into other DBMS (Microsoft SQL DBs, Postgress, etc.).
Perform data de-normalization, data extraction, data transformation (cleansing), and data loading.
Optimize complex data ETL/ELT processes.
Automate complex data ETL/ELT processes.
Build complex data ETL/ELT processes.
Design complex data ETL/ELT processes.
Optimize relational databases (Oracle, MySQL, SQL Server).
Perform data modeling (relational & dimensional).
Write advanced SQL queries.
Optimize queries.
Perform data replication.
Administer relational databases.
Write advanced SQL (PL/SQL, TSQL).
Use scripting languages (Python, Unix shell).
Utilize cloud technologies (Azure, Google, AWS).
Perform advanced skills and hands-on experience with Azure SQL Server and Azure Data Factory.
Create Data Factory pipelines for copy activity and custom Azure development.
Use PL/SQL for data extraction, transformation, and loading.
Provide initial setup and other ETL experience management and support, such as troubleshooting, performance tuning, failover and recovery.
Tune Elasticsearch for search/reporting and performance optimization.
Work with issue tracking systems JIRA, Azure DevOps.
Use Git hub for version control and data model changes.
Utilize Oracle Enterprise Manager (OEM Cloud 12c, OEM 11g Grid), Oracle Names Server, Oracle Net Service, Oracle Connection Manager, and Oracle Advanced Security, Oracle RAC, Oracle Network, Names Server, Data Guard, Oracle Exadata, Oracle Warehouse Builder (OWB).
Use PL/SQL Programming for database change tracking and data warehousing.
Perform data migration and data integration across different platforms (Windows to UNIX, Windows to Windows, UNIX to UNIX).
Perform recovery (restore) and refresh production and Dev/UAT/Test using RMAN to SAN storage.
Perform technical analysis.
Develop program code, detailed programming and reports specifications.
Design programs.
Write and/or generate code.
Conduct unit tests.
Support software on various computing platforms, operating systems, database technology, communication protocols, middleware and gateways.
Develop and maintain system design models, technical documentation, and specifications.
Conduct technical evaluation and assessment of options for technical design issues, application configuration aspects, and integration capabilities, related tools and utilities, gap analysis of integration components to technical requirements/specifications/documentation.
Provide Business intelligence and data analytics.
Design data warehouses.
Develop dimensional data modeling.
Develop relational data modeling.
Support data warehouses and data models.
Conduct research and assessment of options for technical design issues.
Contribute to design/development project plans, including work breakdown and resource estimates.
Work with business analysts to translate business requirements and functional specifications into application designs.
Translate technical systems specifications into working, tested applications for large, complex, mission-critical applications.
Work with Quality Assurance (QA) to code, test, and debug extensions/tools integration services.
Perform analysis, design, and development work on complex, multi-tier web-based applications, micro-services architecture, and off-the-shelf solutions.
Identify areas for improvement and recommend solutions.
Undertake proof of technology with test data to simulate application load and performance tuning.
Provide software expertise in various computing platforms, operating systems, database technology, communication protocols, middleware and gateways.
Provide application programming support for incident management, application functionality sustainment, performance tuning, and technical documentation.
Optimize web database performance.
Ensure compliance with architecture framework and system standards, and Agile Development Methodology.
Participate in Software Development Lifecycle (SDLC) end-to-end Agile/scrum and Waterfall methodologies.
Utilize leading-edge technologies, design criteria including usability, security, and privacy for web and mobile applications.
Work with inter-jurisdiction projects between federal/provincial/municipal governments.
Understand the provincial Environmental services and the legislative framework that governs the data.
Perform data migration and integration with different Environmental systems.
Understand OPS Enterprise Architecture artifacts (or similar), processes and practices.
Produce technical documentation that complies with industry-standard practices.
Adopt and adhere to OPS Unified I&IT Project Methodology, OPS Enterprise Architecture and OPS Gating process, and OPS Standard Systems Development Methodologies.
Apply strong listening skills to facilitate issue resolution.
Engage with all stakeholders using effective consulting skills.
Build strong working relationships.
Manage client needs effectively.
Meet strict deadlines.