D-Net

merging trunk changes with IIS-CDH-5.3.0 branch

merging trunk changes with IIS-CDH-5.3.0 branch

creating IIS-CDH-5.3.0 branch

#1176 defining remove_sideproducts property in workflows headers

#1147 introducing HTML import and HTML plaintext ingestion in main workflows: primary and preprocessing

#1070 introducing support for multiple context identifiers, replacing import_project_concepts_context_id IIS input parameter with import_project_concepts_context_ids_csv

#919 enabling concepts matching for FET projects in mainworkflows: import, export, primary and preprocessing

#1022 introducing extracted document metadata collapser at importing phase.
Propagating extracted document mentadata (including PMC ingested metadata) to processing part of workflow what can be exploited by citation matching module.
Introducing citations collapser in last stage of processing phase collapsing ingested citations with matched citations.

#963 propagating dataset -> mdstore from import to exporting phase: importer produces DocumentToMDStore datasetore utilized by exporter module. Updating transformer definition to handle DocumentToMDStore instead of Identifier schema

renaming metadataextraction_excluded_ids to more appropriate metadataextraction_excluded_checksums