D-Net

#1301 introducing common/export_to_json and utilizing this subworkflow in both primary and preprocessing workflows executing it when active_export=false which means hbase export is disabled

#1248 introducing fault subdirectory support in all workflows wrapping metadataextraction subworkflow up to the processing and primary root workflows. This should prevent fault directory from being removed when ${remove_sideproducts} flag is enabled, it will be propagated along with metadata and plaintext.

#1195 removing obsolete ports docreation and datasetid from hbase mapred import, removing references to those ports in workflow.xml files, updating transformer by removing filtering by datasetid due to decisions made in #1072

#1176 defining remove_sideproducts property in workflows headers

#1172 introducing support for active_export parameter in both preprocessing and primary workflows

#1153 utilizing ${user.name} placeholder in ${workingDir} generation process, copying version.properties from oozie_app to mark execution environment with application version

#1147 introducing HTML import and HTML plaintext ingestion in main workflows: primary and preprocessing

updating job.properties

#1083 enabling webcrawl ingester module extracting FX field from plaintext before executing project reference extraction

updating default job properties