Data Submission process overview
The EMODnet Data Ingestion portal focuses on data providers and their data sets that are not yet handled and part of the mainstream arrangements and data handling processes of the EMODnet Data Centres. The latter are National Oceanographic Data Centres (NODC), National Geological Surveys, Biology Institutes, and National Hydrographic Agencies in European countries.
Note: Data submitters have to register in the Marine-ID register to get an account in the Data Submission service.
You can download the Manual for Data Submitters and the Manual for Data Centres.
EMODnet Data Ingestion is a component in the European marine data management landscape and supports the routing of data sets from newly identified data providers towards uptake in national, regional and European marine data management infrastructures and this way towards contributing to EMODnet thematic groups. .
These pathways follow for all EMODnet themes a common workflow:
- data are gathered from observing organizations;
- data are validated, processed and stored in dedicated national data centres;
- validated data are populated in the appropriate European infrastructure (such as SeaDataNet, EurOBIS and others depending of the theme);
- validated data are made part of EMODnet thematic groups for possible inclusion in EMODnet data products and services.
Potential data providers are marine data holders that are not yet routinely submitting data sets to national data centres and not (yet) used to practices and standards as used by the international marine data management community. Therefore, they must be supported to submit their data packages for open access and use in national data centres and EMODnet.
The online Data Submission service provides an easy means for potential data providers to submit marine dataset packages, that they have collected and are managing. Each package should consist of a collection of datasets and relevant documentation, accompanied by completing a submission form with a limited set of metadata to describe the datasets collection.
A distinction is made between 2 phases in the life cycle of a data submission
- Phase I: from data submission to publishing of the submitted datasets package ‘as is’;
- Phase II: further elaboration of the datasets package and integration (of subsets) in national, European and EMODnet thematic portals.
The workflow process from data submission to publishing of the submitted data package during both phases is illustrated below.
A data tracking service is integrated in the Data Submission service to allow data providers to stay informed about the progress from data submission to publishing.
In Phase II the published datasets package will be further processed and curated by the assigned data centre, most probably again in dialogue with the data submitter, in order to make these or subsets fit for long term storage and stewardship in their data management system and to share it with the appropriate European infrastructure and EMODnet thematic group(s).
The validation and processing of data submissions will be made made easier for data centres if data submitters already apply standard data formats for their datasets collections and also provide relevant documentation as part of their submissions.That will greatly optimise the efforts and time needed for Phases I and II.