D-Net

merging trunk changes with IIS-CDH-5.3.0 branch

merging trunk changes with IIS-CDH-5.3.0 branch

#1198 aligning IIS dependencies and java code to CDH5.3.0 cluster

#1197 introducing job.properties changes aligning paths to rumcajs cluster HDFS structure

creating IIS-CDH-5.3.0 branch

imports cleanup

#118 fixing web usage similarity exporter module

#118 bugfix: shortening node name exceeding 50 chars

#118 enabling document-websiteusage-similiarity exporter module in exporter workflow definition

#118 updating similarities exporter module: assuming relations provided as input are bidirectional so we do not create backward relations

#919 renaming DocumentToResearchInitiative to DocumentToConceptId and DocumentToResearchInitiatives to DocumentToConceptIds

#919 introducing support for exporting document project concepts, minor research-initatives exporter refactoring

introducing ProtoBuffMergingTest

• writing skipped document identifiers to DocumentId datastore
• filtering out relations by skipped identifiers from DocumentId datasetore

#963 propagating dataset -> mdstore from import to exporting phase: importer produces DocumentToMDStore datasetore utilized by exporter module. Updating transformer definition to handle DocumentToMDStore instead of Identifier schema

#637 updating documents affiliations exporter

#637 renaming DocumentMetadataActionBuilderModuleFactory to DocumentAffiliationsActionBuilderModuleFactory

#637 renaming document_extractedMetadata algorithm to more descriptive document_affiliations, propagating changes to action set identifier properties names

#433 fixing problem with unserializable comparator: moving logic to comparable objects

setting missing new AlphaNumericCitationComparator() comparator after recent sorting related refactoring

broken code fix: renaming OafDecoder#getCF() to OafDecoder#getCFQ()

#433 introducing natural citations ordering

fixing exporter code after recent Affiliation.avdl refactoring and adding countryCode field, renaming contry to countryName

#759 fixing maintaining action set identifiers in exporter module: when module does not get any input action set identifier does not have to be specified

removing empty package

fixing NPEx

setting confidence level to 1*factor when not specified

removing redundant code

throwing exception when mdstoreid or mdstore service location set to $UNDEFINED$ value

throwing exception when actionsetid set to $UNDEFINED$ value

introducing shared citation ExtraData XML model in icm-iis-common, implementing citation importer in mapred_import workflow, implementing exporter module

introducing citations xstream deserialization tests

introducing hashCode and equals method

introducing CitationsXmlConverter unit test

updating main method introduced for testing purposes

updating main method introduced for testing purposes

#433 introducing ComparableCitationEntry and TypedId model in citations, exported as sorted set XML representation

building inference with default trust level set when confidence level is not provided

omitting 30| person identifier prefix when exporting XML BLOB containing author statistics

omitting 50| publication prefix when exporting citations XML BLOB

#637 introducing methods building organization identifiers based on organization name, organization entities and result to organization relations. Currently those methods are not hooked up with exporter main method.

utilizing renamed invertBidirectionalRelationAndBuild() method

introducing buildOaf(OafEntity oafEntity, DataInfo dataInfo) method for building inferenced entities

removing json export test which became obsolete

renaming root element from list to citations

#691 introducing citations exporter module, updating exporter workflow.xml definition

introducing confidenceToTrustLevelNormalizationFactor getter method