Prescient Edge is seeking a Data Governance & Metadata Scientist to support a Federal Government client. This role is contingent upon contract award. The Data Governance & Metadata Scientists will specialize in data lineage and metadata governance, ensuring metadata consistency and synchronization between Databricks, Kubernetes, and research dashboards, while tracking data lineage and provenance. They will support ontology-driven decision support systems, mapping structured and unstructured datasets to enhance data interoperability. Responsibilities include developing automated metadata validation and quality control mechanisms to ensure research datasets comply with DoD governance frameworks. Utilization of Azure-native indexing services, such as Cognitive Search, for federated metadata and research product discovery pipelines is expected. The role also involves submitting a Data Governance & Metadata Validation Report detailing data lineage improvements, governance effectiveness, and compliance findings. Additionally, the scientists will be responsible for API-based ingestion, data acquisition from storage containers, and ETL processing in a Data Catalog, ensuring metadata accuracy and lineage tracking. They will establish and maintain metadata governance frameworks, ensuring compliance with DoD data management policies and interoperability with Data Catalog. Development of automated metadata tagging processes to improve data discoverability, classification, and lineage tracking within the Common Intelligence Picture (CIP) platform is required. Implementation and management of data governance workflows, ensuring integration with Open Lineage, Unity Catalog, and GIS metadata standards, are also key aspects of this role. Proposed personnel must possess the knowledge and capability to develop, implement, and maintain data governance frameworks, ensuring metadata consistency, lineage tracking, and interoperability between Data Lake, ESRI Kubernetes environments, and external data sources. Proficiency in metadata management, data lineage tracking (Unity Catalog/Open Lineage), schema alignment, and governance best practices is essential. Expertise in geospatial data standards, data cataloging, and compliance with DoD metadata policies is required.
Stand Out From the Crowd
Upload your resume and get instant feedback on how well it matches this job.
Job Type
Full-time
Career Level
Senior