City Year-posted 4 months ago
Full-time • Mid Level
1,001-5,000 employees

The Senior Data Engineer works closely with local City Year data experts, school district IT professionals and a multitude of partners to manage ingestion of data from many sources. Our ideal candidate is professionally experienced in all things Azure and familiar with dev ops. They will use their Azure experience, especially with Azure Data Factories and Databricks, to lead the end-to-end development and implementation of modern ETL/ELT data pipelines for our team. This candidate will be excited to promote the effective use of timely and accurate k-12 education data and empower front-line practitioners with the information needed to have greater impact on the students we serve. The Senior Data Engineer reports to the Director of Data Management and Reporting.

  • Be our resident Azure expert and trusted advisor for Azure.
  • Own the design, development, and implementation of modern data pipelines, data factories and data streams.
  • Lead the planning and then implement the data platform services including sizing, configuration, and needs assessment.
  • Own the management and development of various third-party data integrations.
  • Lead development of frameworks, and data architectures for large-scale data processing that ensure timely and accurate processing of data into and among City Year’s systems.
  • Influence and make recommendations on the technical direction for the team by leveraging your prior experiences and your knowledge of emerging technologies and approaches.
  • Lead our team in identifying and promoting data management best practices.
  • Conduct full technical discovery, identify pain points, gather business and technical requirements, and explain the 'as is' and 'to be' scenarios to fully understand user stories from stakeholders and users.
  • Lead and participate in deep architectural discussions to build confidence and ensure customer success when building new solutions and migrating existing data applications on the Azure platform.
  • Serve as a leader in bridging the gap between technical and non-technical staff in understanding our data and its processing at City Year.
  • Own the implementation and use of ETL and data management best practices, devops, ci/cd, and deployment strategies to ensure product quality, agility, robustness, and recoverability.
  • Partner with districts and internal customers to understand their requirements and implement data solutions.
  • Create integrations between internal systems and support them operationally.
  • Teach others in the DMAR team about Azure, databricks and best practices to ensure all services and technology implemented can be supported by others on the team.
  • At least 3+ years of professional experience in the following: Working in an Azure environment on ETL/ELT projects, Azure DevOps, Azure Databricks, Azure Data Factories, SQL, Python, Relational databases.
  • Working with heterogeneous datasets/formats from many vendors, providers, and platforms.
  • Data Architecture experience.
  • Have experience and demonstrated ability to successfully integrate and manage data across disparate information systems.
  • Excellent written and verbal communication skills, especially the ability to express complex technical information in understandable and rigorously accurate terms.
  • Attention to detail while working on multiple projects at once.
  • Demonstrated success and effectiveness working in and promoting a rapidly changing, collaborative, and time-critical work environment.
  • Some experience with Databricks Lakehouse with Microsoft Fabric with archiving and backup solutions in Microsoft Azure in a role at a school district, Charter Management Organization (CMO), or Ed-tech company.
  • Commitment to continuous improvement and City Year’s mission.
  • You love learning new things. You're curious and ask good questions. You solicit feedback from others, accept it with grace, and act on it.
  • Full-time employees will be eligible for all benefits including vacation, sick days and organization holidays.
  • Medical, dental, vision, life, accidental death and dismemberment and disability coverage.
  • Flexible Spending Accounts (FSA), and other benefits including 401(k) plan(s).
© 2024 Teal Labs, Inc
Privacy PolicyTerms of Service