updated pom
testing datasource mapping
manage the missing boolean fields
added expansion of BoolField type
testing with yarn
playing with elasticsearch
added constant value for max retries
expanding rel funder and its attributes
adapted to latest version
fetch only instancetype and hostedby from the instance attributes, adding url to external references
catch and log memory errors
fixed infinite loop (merged from branch 0.6.x)
fixed xml record escape
cleanup
trying to catch memory errors
derp fix
added configurable max number of rel/children to be expanded in each entity
integrated fix from beta_context branch
log the xslt
aligned with version in pom.xml
bumped version due to update in dnet-pace-core
using action set id in the index record building process
Added dc:creator
csv export of the duplicates original ids
updated to the new pace specs, cleanup
WT ids are uniform now
adding empty solr docs to the rotten record set
using different counter names
added dedup roots to csv export job, dedup index feed job, tests
using proper logger
added dedup configuration to the entities merging process
added more detailed counter about entity sub-type
several improvements
raised version
commenting test with big doaj dataset
different escaping
trying to catch any kind of exception
Testing DOAj for #1222#note-4
added DedupSimilarityToActionsMapper and relative dependency
increased version in scripts
updated the version of a dependency
fundingtree is an escaped xml, not a json anymore.
increased a minor virsion
sample records
reimplemented the fundingpath and context generation
updated packages
updated packages, codestyle
codestyle
OafMerger moved to mapping utils
added protobuf-java-format dependency
renamed test
added json size test
saving disk space, less logging
Updated configuration for testing
extended entities join configuration, added more tests
scripts using updated version 0.0.6.3
test record took from HDFS
discard persons in OAI feeding (#1107)
do not alter inferenceprovenance; codestyle
Using released hadoop parent.
added FCT fundings as contexts
merged branch ProtoMapping
imlemented retries
Added oaf:identifiers to record sample.
ignored iml file
updated tests
updated scripts
[maven-release-plugin] prepare for next development iteration
[maven-release-plugin] prepare release dnet-mapreduce-jobs-0.0.5
removed extra scm tag
added scm
bumped version, updated parent: let's start to depend on releases
cleanup & tests
added default bestlicense value. Used when the records doesn't provide any
added more fields in test record
Moved counters from entity body to header.
- provenance information parsed from element "about" - namespace aware datacite mapping for oaf:language and oaf:dateaccepted - dedupBuildRoot doesn't write to WAL- removed unused claim_2_hbase.xsl- overall cleanup
added relationship/children counters
revised tests
Avoiding set '___' generated when we have "strange" set names such as those in cyrillic/ukrain. In those cases records are assigned to a default set, currently named "OTHER".
expanding provenanceaction classid
merge from branch newIndexFeed
fixing #783 (note-18)
extraInfo removed from CDATA block, expanding provenance action in inferred elements
fixed dependencies
fixed blacklist type
more logging. fixed entity type check
more logging
defined limit to the maximum number of counters
added serialization, tests
instantiate one SAXReader for each call
fixed format-layout-interpretation concatenation,doesn't fail when the fieldExtractor returns a null result