Computer Programmer III
About The Position
The primary purpose of Computer Programmer III – Data Engineer is to perform data engineering work in support of capital or long term technology project implementations and requires strong knowledge and skills relating to data ingestion, data storage, processing, modeling, data lake and data warehouse design and implementation, building data pipelines, data integration, data testing, and data orchestration. The incumbent will perform complex programming and analysis work and /or configure, adapt and alter data structures, stores and pipelines for multiple applications built in many development languages to meet complex requirements. The Computer Programmer III – Data Engineer will also work as a project leader in a supervisory capacity with other data specialists and engineers, incorporating best technology solutions and showing leadership in the development of new data integration and ETL/ELT programming and development standards. The Computer Programmer III – Data Engineer works closely with Computer Programmer/ Analyst staff and other members of the Team to achieve the overall objectives of the City, Technology Services (TS), and the public. The Programmer shares knowledge and experience of computer techniques to provide solutions to technical and procedural problems. The incumbent exercises considerable independence of judgement in all technical aspects of work.
Requirements
- Completion of Grade 12 with courses in related subjects.
- Proven experience in data engineering including ETL/ELT development for a range of environments, platforms and tools
- Extensive experience developing solutions with ETL/ELT tools such as SSIS, FME, Azure Data Factory and Azure Synapse Pipelines
- Considerable experience developing data warehousing and data lake solutions
- Considerable experience developing in the SQL environment and cloud based proprietary vendor technologies such as Snowflake, Azure SQL data warehouse, Azure Synapse and others
- Considerable experience working with Microsoft SQL Server
- Considerable experience using DataOps methodologies, patterns and practices
- Strong background with the data development lifecycle, and common models (Kimball, etc.) with familiarity in best data management practices including dimensional modelling and semantic modeling.
- Working knowledge of computer programming including knowledge of one or more programming languages (e.g. C#, python), the software development life cycle, and development methodologies
- Excellent leadership skills and ability to develop and mentor others
- Ability to develop, document, review and revise work and strategic plans
- Strong analytical and problem solving skills
- Keeps up to date with developments in programming techniques, languages, software, architectural patterns, etc.
- Ability to manage projects, multiple priorities and respond to requests in a timely manner
- Ability to establish and maintain effective working relationships, and communicate well with both internally and externally with technical and non-technical staff
- Ability to handle business critical and sensitive information
- Demonstrated ability to work under pressure, manage multiple priorities and respond to requests in a timely manner
Nice To Haves
- Preference is given to candidates that have a bachelor degree or higher in Computer Science or a related discipline, or equivalent.
Responsibilities
- Acts as an expert technical resource for data ingestion and pipelines (ETL/ELT development), data modeling, data lake and data warehouse design and implementation and preparing data for analysis efforts with data from multiple platforms, applications and technologies
- Analyzes highly complex business requirements and suggests solutions that will meet the functional and non-functional requirements including cost, security, and existing investments
- Generates technical specifications to design or redesign data warehouse, data lake and other enterprise components and applications associated with data delivery
- Leverages industry best practices to design, test, implement and support solutions
- Assures quality, security and compliance requirements are met for supported areas
- Develops ETL/ELT in the context of a project, while ensuring alignment to current and developing architecture
- Prepares Technical Design and Specification documents
- Creates implementation instructions and supports deployments
- Conducts design and peer reviews including individual and team unit testing
- Oversees technical issues and the work of other developers
- Works with TS teams to review problems, define and test solutions
- Participates in the development of architectural framework and design
- Evaluates and introduces new tools and techniques to the development team
- Proactively identifies areas for improvement, seek solutions and make recommendations
- Consults with managerial, engineering, business, and technical personnel to clarify program intent, requirements, identify problems, and suggest changes
- Performs or directs revision, repair, or expansion of existing IT systems to increase operating efficiency or adapt to new requirements
- Assists in the training and development of other members of the team and in the orientation of systems analysis
- Other duties/responsibilities as assigned
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Mid Level
Education Level
High school or GED
