D-Net

Updated classes for DOIBoost based on the trunk version

actually incrementing the counters just added

added counters for matching subject, content providers and zenodo community for each community

changed to consider to mirror the change in zenodo community value: zenodo community instead of the openaire community associated to a result. The context of the zenodo community will be removed from those of the result if the zenodo community is not associated to any openaire community.

replaced CrossRef with Crossref

fixed creation of the coordinates (columnFamily) driving the Put operation

less log verbosity

fixRelations must work on main entities in a single scan pass

added support for simulation mode: allows to do not change the data and keep track of summary counters

introduced jobs to fix the relationships among deduped records. Got rid of deprecations on the HBase Put method usage

refactoring and fixed issue for empty project list

Added new check for result type checking inside list of results in country propagation

fixed issue for empty result in list of results to which propagate the country (last fix produced a bug)

changed message in context

fixed bug for list of result(50|) empty

Propagation general Iterator and Contants class

Iterator to handle results from mapper for project propagation

Reducers fro project propagation to File and to HBase

Iterator for managing values from mapper for result country propagation

fixed issue

new Exception class for not valid list of values in reducer

modified type for type variable. From int to Type

added new variables and methods

updated implementation to use iterator

specific iterator for country propagation

Added generic Iterator over the list of information gathered from the reducer

fix error on parsing abstract

updated to consider the new class Utils and the new values in Propagation Constants classes

updated to store properties of the value

class to contain the methods common to the propagation classes among the propagation types

update of the constants for the propagation

map-reduce to implement the propagation of the association between project and result through the existence of semantic relations

map to count the number of results having a semantic relation of type isSupplementedBy that also have a relation isProducedBy with at least one project

avoid to import non necessary affiliations from DOIBoost

fixed bug for uncompressed abstract in DOIBoostToAction

changed mapping for compressed abstract in DOIBoostToAction

less verbose logging

using proper import for LogFactory

added Mapper and Reducer class for infoSpace counts workflows

added reducer to produce counts on the infospace

added reducer to produce counts on the infospace

cannot use Guava's Splitter.splitToList, must stick to basic split method. Classpath is messed up

implemented ConfigurableExportMapper

Removed un-used import

fixed test

updated Mapper to return the whole invalid record

export invalid xml records

refactored Action

Map only job that produces [openaireId, doi] pairs of records containing invalid characters

added parameter to filter only organization in DOIBoostToAction

fixed problem of missing name in authors

merged beta branch to master

introduced use of BlockProcessor

fixed issue when country information is not present for datasource

change throwing of exception with counters

change parameter from ImmutableBytesWritable to Text

refactoring and change of counters

rollback wrong commit

fixing and testing propagation implementation

reducer for country propagation that writes on hdfs

cleanup pid types in order to make them valid attributes

added code for propagation of countries from institutional organization

master branch for deployments @ICM

why parse strings as Floats?

reverted to r52985 . Test runs shows we need to rely on the edgeIds produced by the connected components identfication phase instead of the vertexIds

alignment to trunk version

avoid to produce duplicated events by eliminating the roots from the comparison process

introduced mapping resulttype -> portal url

Fixed log class name

avoid collisions when hashing pids by value

cleaned up unused method, using setDurability in put operation

added mapper and hadoop job configuration file for importing Grid.AC organization data

integrating bulktag from trunk to beta branch

rule out invalid dates also on CrossRefToActions

rule out invalid dates on ScholixToActions

cleanup

produce 'supplement' subrel type in case of supplement relationships

simplified connected component application on the graph

adding check to understand the bug of wrong relation generated

do not skip processing datasets in DedupBuildRootsMapper, improved error reporting in DedupBuildRootsReducer

do not push vertex ids in memory, process them on the fly

added jobs for predatory journal analysis

added invisible setup

refactored Action

fixed null element

Created CrossrefImportMapper

add CrossRefToAction

fixed mapping from scholix to openaire model

small fixes

changed key type

changed key type

implemented mapper writing

added configuration

added Mapper for tranform scholexplorer links into actionsets

deprecation: use setDurability instead of setWriteToWAL

introduced subType in pace wf configuration

adjusted ids export procedure