testing
updated dhp-schema dependency (includeted refereed defined as Qualifier)
using Long for dates in broker events
added mapping for externalreferences
less memory pressure on the hbase table export job, context propagation utils. Proto exporter aligned with most recent dhp.model changes
Set to invisible if there is no URL
Option to print proto produced by tests
Added publisher field
trying to reduce memory footprint
fixed counter name formatting
read only the body qualifier instead of the entire column family
set bestaccessright.classname to 'not avalable' when the classid is UNKNOWN
set UNKNOWN bestaccessright in case of empty accessright
added counters for exported content (entities and relations)
protobuf to dhp model mapping aligned with dhp-schema:1.1.5
log the actual xslt engine
serializing processingchargeamount and currency
#4008: refereed field as property of the result instance and supported both from OAF and ODF.
#4008: mapping the refereed status (peer reviewed or not?) - test file and pom to use snapshot version of mapping-utils
fixed mapping for dateofcollection and dateoftransformation
avoid repeated colons in the dedup id creation
use jackson object mapper to serialize dhp oaf model ignoring blank properties
added test cases for ODF mapping: consider also lowercase attribute in date element 'datetype'
added mapping for Result.Instance
removed useless logs, they might clog the cluster resources
addition of the trust in the mapping of the datainfo
test for propagation of result to organization both via datasource and via semantic relation
refactoring
code refactoring
code formatting
fixed bug: mapper for organizations sent wrong information about the organization id. It was the id of the datasource that was emitted instead of the one of the organization
Test to check the good hostedby is considered by the mapping
Handling empty values for float fields like project totalcosts
rehash the entire openaire id when building the root identifier to avoid clashes
#4961: ensure we properly build XML records of projects and orgs with summary and budget information
avoid NPEs mapping DOIBoost records
update of the propagation constant for the propagation of organization relation for projects belonging to a ds related to the org
propagation of relationship between products of a datasource and the organization(s) the datasource is related to. The propagation is done if the ds in an institutional repository and if the result is not already linked to the organization. No addition to the provenance of the relation is added in case it would already be present
refactor needed because the InstOrgKey class has been moved to dedicated package
update of the propagation constant to fit also the propagation of author affiliation
propagation of affiliation relation (hasAuthorInstitution) from result to organization through results linked by strong semantic relations. Results already associated to the organization will not have the hasAuthorInstitution relation overwritten
logic of the compositekeys for propagation moved on dedicated package. Ordering datasource, organization, results on the key that groups for the reducer
try to fix issue with svn
moved the implementation of the composite keys in a dedicated package since it is used in mode than one propagation
better handling of side cases
fixed null abstract
[broker] factored out method to obtain the key to be emitted by the enrichment map phase
ORCID events are not yet ready for production
limit the dnet-pace-core dependency to use version 3.0.14, i.e. prior to the introduction of the translation map in the configuration
refactoring. changed name to constant
Test for propagation of result to community through organization
Test for ORCID propagation to result through semantic relation
update of propagation constant for orcid propagation and propagation of product to organization through semantic relation
mapreduce job for the propagation of ORCID through result. Follows only isSupplementedBy, isSupplementTo semantic relations
Added one counter to count the number of results per community
DOIBOOST mapping: include dates formatted as \d{4}-\d{1,2}-\d{1,2}, discard records not providing at least one date
fixed valid date Actions
aligned infospace exporter with dhp-schema:1.0.4
fixed infospace export procedure, avoid to emit the same result more than once
OpenOrgs DB: use of tsv for rels
deduped orgs to OpenOrgs DB (jobs + wfs) using temporary hdfs files
context propagation of projects rels through semantic rels: fixed field assignment when building the relation qualifier
fixed export procedure: include also relationships
added dhp mapping test
included infospace mapping towards the new OAF DHP model
Added new mapper
avoid to print the job configuration in the setup phase
use of dnet-pace-core 3.0.15
put operations WAS SYNC
Added new propagation constants for the ORCID propagation
(openorgs) added schemeid to pids in sql query
pick the first mergedIn identifier
using streams instead of guava collection transformations
added firstname and surname in case of authors without orcid id, extracted from fullname, needed for propagation
final logic of propagation of community through organization (products belonging to given organization will be associated to the community)
Testing sygma
fixed test
removed project reference from src/test/resources/eu/dnetlib/data/transform/odf.xml, the test didn't include any check against it
fixed problem on subject null in scholixToActions
Test for checking: #4911 (missing collectedfrom/hostedby identifiers)
Testing guidelines 4 with current odf2hbase mapping (repo: Aria)
tests for qeios
fix
fixed issue
moved resolution of mapping organization- communities to mapper
removed try catch for key validity
using Text as grouping key type between mapper and reducer
fixed error
not needed class
new tests and resources
implementation of propagation of result to community through organization
added new util
refactor and cleaning