avoiding to fail with NPE in case of missing relClass(es)
updated config for rel expansion to include result's collectedfrom
enrichment events includes also subjects
added topics for subjects
calculate the trust by comparing duplicates in a group, then scale the similarity value
tests for merged entities
refactor: easier way to build dedup rels
avoid NPE when trying to index missing content from HBase
test record aligned according to the latest transformation for OpenTrials
[maven-release-plugin] prepare for next development iteration
[maven-release-plugin] prepare release dnet-mapreduce-jobs-0.0.9.5
depending on released dnet-actionmanager-common
real opentrials example
depending on released parent
depending on dnet-openaireplus-mapping-utils >= 5.0.0
no need to depend directly from protobuf schemas, as they are inherited from dnet-openaireplus-mapping-utils
added original ids in mock data used by tests
using dnet-openaire-data-protos [3.0.0,3.7.1]
fixed invertion of rel source and target in case of one way relationships (symmetric = false)
align with latest dnet-actionmanager-common
partial refactoring of the job for the generation of broker events
Added test for jsonextrafield
[affiliation] invert rel source and target in case of one way relationships (symmetric = false)
[maven-release-plugin] prepare release dnet-mapreduce-jobs-0.0.9.3
bumped dependency version
updated tests
expand result url within relationships
test for #2319
[maven-release-plugin] prepare release dnet-mapreduce-jobs-0.0.9.2
using modules that depend on dnet-parent. Dropping support for dnet-hadoop-parent
funder original name field all in low-case letters
mock trust in enrichment events
fixed mock record used in tests
setting trust in OpenAireEventPayloadFactory
using lit. broker common module, added extra fields in EventMap
commented out code that sets a counter because we reach the max num of counters and the job fails
[broker] created factories for specific event type
#2192: fixed profile and more logs
#2192: entityregistry::* should end up with "other" datas ource type label for the portal. PrepareReduceFeeder now expects a 'ui.other.datasourcetypes' job param with the list of datasource types to be handled this way.
[broker] fixed inverted condition for ENRICH/ABSTRACT
[broker] fixed test
OpenAIRE broker DTOs moved in specific module: dnet-openaire-broker
[broker] avoid leading '/' character in the topic definition. Avoid '.' characters in map keys (elasticsearch doesn't like them)
[broker] implemented job for identification of enrichment events
Testing projects with funders with original name.
#2091: testing dataset claims
updated XML record file used for opentrials testing.
reverted to use json-java-format 1.2
reverted to previous revision
changed WRITE_TO_WAL = true for all jobs writing to HBase tables
added counters to keep track of the relationships provenance
[maven-release-plugin] prepare release dnet-mapreduce-jobs-0.0.8.8
new tst for claim updates
updated opentrial sample record
excluding dateoftransformation from metadata fields, it should be serialised only in the record header
Added dr:dateOfTransformation to some test XML files.For publications dr:dateOfCollection must be set.For datasets dri:dateOfCollections must be set.
Testing OpenTrials dataset record mapping. Depending on snapshot parent.
finally I made those scripts decent
[maven-release-plugin] prepare release dnet-mapreduce-jobs-0.0.8.7
fixed dependencies, depending on released parent
import cleanup
reverting, we need less getters
ignores
upload
tests for dedup experiments
added more getters
dedup experiments
added mapper class for hdfs actions
cleanup
depending on released mongo-logging
added Mapper class PromoteActionSetFromHDFS
Updated pom version to 0.0.8.7
added anchorStats map-only job
added counter for DOIs
removing useless counters
using most recent dnet-pace-core features
fixed DedupDeleteRelMapper
do not export deleted entities
adapted to the removal of contributors as relationships
updated scripts
bumped version