Senior Data Analytics Engineer (Snowflake/DBT) (1043) - Controller's Office - (168332)

City and County of San Francisco•San Francisco, CA

4d•$159,120 - $200,226

About The Position

The Controller's Office is undertaking a multi-year project to migrate its Reports and Analytics solution into a unified Snowflake-based platform. This BI Platform Change project aims to provide departments with secure, streamlined access to PeopleSoft data, thereby enhancing efficiency, governance, and standardizing data sharing across the city. This modern framework is designed to replace outdated processes, supporting transparency, accountability, collaboration, improved service delivery, strategic growth, and public trust. This Senior Technology Engineer position will be a key member of the BI Platform Change project, collaborating with the SF Reports & Analytics Team, Functional Teams, and other City and County staff. The role involves both functional (business process and systems analysis) and technical (report, query and dashboard development, data extract, load and transformation, metadata modeling, tuning, and troubleshooting) tasks. The position will be instrumental in designing, building, and managing the new business intelligence platform using tools such as dbt, sql, and others, with a Snowflake database as both the source and target.

Requirements

An associate degree in computer science, computer engineering, information systems, or a closely related field from an accredited college or university OR its equivalent in terms of total course credits/units [i.e., at least sixty (60) semester or ninety (90) quarter credits/units with a minimum of twenty (20) semester or thirty (30) quarter credits/units in one of the fields above or a closely-related field].
Three (3) year of experience analyzing, installing, configuring, enhancing, and/or maintaining the components of a system or platform.
One year of additional experience as described above may be substituted for the required degree; or Completion of the 1010 Information Systems Trainee Program may be substituted for the required degree.
Applicants must meet minimum qualification requirements by the final filing date unless otherwise noted.

Nice To Haves

Three (3) years of experience in the information systems field, including system analysis, business process design, development and implementation of business application solutions or IT project management.
Two (2) years of hands-on experience administering and developing on Snowflake managed cloud data platform and with Oracle databases
Two (2) years of Demonstrated expertise in writing advanced, performant SQL, and using dbt for SQL-based data transformation and modeling
Experience with layered data architecture (staging, intermediate, marts) using dbt best practices to support analytics and reporting use cases including parameterized and dynamic dbt models using Jinja templating to support reusable transformations across multiple datasets and environments
Hands-on experience in GitHub for code change management and collaboration with other team members
Hands on experience with Snowflake data warehouse functionality including Snowflake masking native features, Snowpipe, SnowSQL, Snowpark and Snowflake optimization configuration
Strong skills in Python (with libraries like pandas, PySpark) for data processing and automation
Experience in building and deploying data pipelines using orchestration tools
Hands-on experience in real-time data streaming technologies (Snowpipe, GoldenGate)
Experience building and deploying data pipelines using orchestration tools
Experience with CI/CD & DevOps a plus
Experience in development of APIs to interface PeopleSoft data with other enterprise applications
Deep understanding of data warehouse concepts, data modeling, and modern ETL principles
Understanding of data governance, data security, and data privacy principles
Understanding of PeopleSoft applications such as PeopleSoft Financials and Supply Chain Management (FSCM) or PeopleSoft Capital Human Resources (HCM) experience performing data analysis, design and testing.
Understanding of OBIA 11g (with ODI 11g), including the following: Oracle ODI Load Plans from PeopleSoft 9.2 FSCM (GL, AP, AR, BI, Contracts, PO, Project Costing) and HCM (Human Resources, Position Management, Time and Labor, Payroll)
Working with DBAs, BI Dev, PeopleSoft, and Security teams to improve performance and data quality using Agile sessions
Working knowledge of business process flows used to support a complex accounting system, and experience in developing and executing application test plans.
Desirable experience of building AI agents
Strong problem-solving skills with ability to design practical and effective data solutions
Excellent verbal and written communication skills, including the ability to explain technical concepts to non-technical stakeholders
A collaborative mindset with enthusiasm to work across diverse, cross-functional teams
Commitment to equity, transparency, and ethical data use
Passion for public service using data to improve government services

Responsibilities

Exercise judgement, decisiveness and creativity in designing, planning, troubleshooting and integration of large complex systems or networks based on the potential benefits and/or consequences.
Analyze the interrelationships of business processes, complex financial data and systems to develop reporting requirements and data structures.
Perform fit/gap analysis to evaluate reporting and data needs.
Define and implement application configuration settings.
Collaborate with the project team on transition plans for re-engineered business processes.
Analyze and test security roles and permissions.
Write functional and technical specifications.
Design and build solutions based on detailed specifications.
Develop and execute system and user acceptance test plans and evaluating test results.
Develop and provide support and training for users in person, on the phone and in workshops.
Write business and system process and technical documentation.
Identify, manage and escalate issues and risks throughout software development life cycle.
Perform other duties as assigned.