SENIOR DATA ENGINEER - 72004170
About The Position
The Senior Data Engineer supports the Office of the State Chief Data Officer (OSCDO) by leading the technical design and development of data pipelines, integrations, and data services that enable secure access to data across distributed agency systems. The role contributes to state efforts to streamline data sharing, promote interoperability, reduce duplicate data, and improve business efficiencies across the State of Florida’s Enterprise Data Community. The position develops secure, maintainable integration solutions using Python, SQL, Snowflake, and AWS. Work includes data virtualization and federated access, APIs and backend data services, ETL/ELT processes, secure file transfers, database architecture support, and reusable integration patterns. The engineer coordinates with Enterprise Architecture, supports enterprise identity and access management efforts, documents interfaces and operational procedures, builds business intelligence visualizations, collaborates on requirements and design reviews, and mentors newer team members. This is an in-office position in Tallahassee, Florida.
Requirements
- Bachelor’s degree or six years of experience in Computer Engineering, Computer Science, Statistics, Mathematics, Information Systems, Information Technology, or another quantitative field.
- Advanced proficiency in Python and SQL for data integration, transformation, querying, and automation.
- Familiarity with structured, semi-structured, and unstructured datasets.
- Experience designing and developing data pipelines, APIs, and backend data services.
- Knowledge of data virtualization, federated query approaches, and distributed data architectures.
- Knowledge of performance optimization for data delivery and process automation.
- Proficiency in business intelligence software.
- Ability to analyze current data, identify gaps and issues, and recommend prioritized actions and improvements.
- Knowledge of Agile delivery practices and ability to apply iterative development methods in collaborative, multi-team environments.
- Proficiency in building and modifying interactive dashboards.
- Problem-solving and critical-thinking skills.
- Ability to communicate effectively with different stakeholders.
Nice To Haves
- Experience with Git or other source code repositories.
- Experience developing and implementing data pipeline integrations in multiple environments.
- Experience contributing to data mesh or data fabric architectures.
- Experience managing technical metadata, data lineage, and schema changes.
- Experience with Snowflake and other database software.
- Experience in AWS environments.
- Experience integrating Single Sign On and Identity Access Management tools.
Responsibilities
- Lead technical support for the State Chief Data Officer’s interoperability initiatives.
- Develop data virtualization and federated access solutions connecting agency data sources while minimizing unnecessary data movement and duplication.
- Use Python and SQL to develop maintainable integration code, queries, transformations, and automated data-processing workflows.
- Implement data engineering solutions using Snowflake and AWS for data access, integration, processing, and delivery.
- Incorporate validation, logging, monitoring, error handling, and performance optimization into data pipelines and services.
- Lead the design and architecture of integration frameworks supporting secure data exchanges from varied enterprise sources.
- Coordinate with the Enterprise Architecture team to align solution designs with enterprise standards, security requirements, and agency system constraints.
- Evaluate data virtualization, federated queries, and data movement approaches to select an appropriate integration method for each use case.
- Lead development of reusable integration components and design patterns supporting consistent, efficient system connections and interagency interoperability.
- Design and develop APIs and backend data services that enable authorized systems and applications to access data.
- Develop ETL and ELT processes and secure file-transfer integrations when data movement is necessary.
- Assist in designing and developing database architectures for analytical workloads, including data modeling, structural design, and process and performance optimization.
- Assist with implementation of enterprise Identity Access Management mechanisms for internal and external applications and systems.
- Mentor and train newer team members, including the Data Interoperability Analyst, Business Data Analyst, and Data Architect.
- Assist with technical feasibility assessments for proposed data integrations and interoperability requirements for agency modernization efforts.
- Document integration interfaces, data dependencies, transformation rules, and operational procedures.
- Build data visualizations using business intelligence software.
- Collaborate on requirements gathering and design reviews for scalable systems as needed.
- Perform other duties as needed.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
What This Job Offers
Job Type
Full-time
Career Level
Senior
