Project

General

Profile

Statistics
| Revision:

# Date Author Comment
36972 06/05/2015 03:44 PM Claudio Atzori

Tesing with "max" attribute

36932 05/05/2015 10:45 AM Claudio Atzori

using inverse rel to refer to the correct link descriptor, avoid npe

36916 04/05/2015 06:48 PM Claudio Atzori

defined maximum number of relationships, configurable per relationship type [attribute 'max' in the EntityGrouperConfigurationDSResourceType]

36859 03/05/2015 11:34 PM Alessia Bardi

FCT has level_0 only in funding tree

36855 01/05/2015 09:45 AM Claudio Atzori

trying to debug

36832 30/04/2015 12:30 PM Alessia Bardi

branching for beta and new fundingpaths and context

35981 03/04/2015 11:32 AM Claudio Atzori

added more detailed counter about entity sub-type

35975 03/04/2015 10:31 AM Claudio Atzori

several improvements

35896 01/04/2015 04:55 PM Alessia Bardi

commenting test with big doaj dataset

35771 30/03/2015 11:57 AM Claudio Atzori

different escaping

35769 30/03/2015 11:46 AM Claudio Atzori

trying to catch any kind of exception

35746 27/03/2015 05:23 PM Alessia Bardi

Testing DOAj for #1222#note-4

35476 18/03/2015 06:47 PM Claudio Atzori

added DedupSimilarityToActionsMapper and relative dependency

35442 18/03/2015 12:15 PM Alessia Bardi

fundingtree is an escaped xml, not a json anymore.

35196 09/03/2015 05:09 PM Michele Artini

sample records

35179 09/03/2015 02:39 PM Michele Artini

reimplemented the fundingpath and context generation

35135 05/03/2015 07:46 PM Claudio Atzori

updated packages

35133 05/03/2015 07:44 PM Claudio Atzori

updated packages, codestyle

35129 05/03/2015 07:38 PM Claudio Atzori

codestyle

35128 05/03/2015 07:34 PM Claudio Atzori

updated packages

35127 05/03/2015 07:31 PM Claudio Atzori

OafMerger moved to mapping utils

34600 19/02/2015 04:14 PM Claudio Atzori

renamed test

34599 19/02/2015 04:07 PM Claudio Atzori

added json size test

34536 16/02/2015 07:56 PM Claudio Atzori

saving disk space, less logging

34454 11/02/2015 07:31 PM Alessia Bardi

Updated configuration for testing

34439 11/02/2015 04:06 PM Claudio Atzori

extended entities join configuration, added more tests

34438 11/02/2015 03:49 PM Claudio Atzori

extended entities join configuration, added more tests

34386 10/02/2015 11:16 AM Alessia Bardi

test record took from HDFS

34374 09/02/2015 06:44 PM Alessia Bardi
34358 09/02/2015 12:05 PM Alessia Bardi

discard persons in OAI feeding (#1107)

34225 03/02/2015 11:50 AM Claudio Atzori

do not alter inferenceprovenance; codestyle

33382 12/12/2014 06:07 PM Claudio Atzori

added FCT fundings as contexts

33137 02/12/2014 04:33 PM Claudio Atzori

merged branch ProtoMapping

32832 17/11/2014 04:41 PM Claudio Atzori

imlemented retries

32714 13/11/2014 03:20 PM Alessia Bardi

Added oaf:identifiers to record sample.

32094 03/11/2014 05:21 PM Claudio Atzori

updated tests

31997 31/10/2014 10:19 AM Claudio Atzori

cleanup & tests

31409 16/10/2014 05:42 PM Claudio Atzori

added default bestlicense value. Used when the records doesn't provide any

31208 08/10/2014 03:25 PM Claudio Atzori

added more fields in test record

31186 07/10/2014 02:54 PM Alessia Bardi

Moved counters from entity body to header.

30969 01/10/2014 02:22 PM Claudio Atzori

- provenance information parsed from element "about"
- namespace aware datacite mapping for oaf:language and oaf:dateaccepted
- dedupBuildRoot doesn't write to WAL
- removed unused claim_2_hbase.xsl
- overall cleanup

30968 01/10/2014 02:15 PM Claudio Atzori

added relationship/children counters

30967 01/10/2014 02:14 PM Claudio Atzori

revised tests

30882 25/09/2014 05:42 PM Alessia Bardi

Avoiding set '___' generated when we have "strange" set names such as those in cyrillic/ukrain. In those cases records are assigned to a default set, currently named "OTHER".

30863 25/09/2014 12:40 PM Claudio Atzori

expanding provenanceaction classid

30834 23/09/2014 06:14 PM Claudio Atzori

merge from branch newIndexFeed

30833 23/09/2014 06:14 PM Claudio Atzori

fixing #783 (note-18)

30827 23/09/2014 03:46 PM Claudio Atzori

extraInfo removed from CDATA block, expanding provenance action in inferred elements

29734 31/07/2014 02:28 PM Claudio Atzori

fixed blacklist type

29732 31/07/2014 12:48 PM Claudio Atzori

more logging. fixed entity type check

29707 30/07/2014 04:15 PM Claudio Atzori

more logging

29702 30/07/2014 03:38 PM Claudio Atzori

defined limit to the maximum number of counters

29657 29/07/2014 03:24 PM Claudio Atzori

defined limit to the maximum number of counters

29043 11/07/2014 06:54 PM Claudio Atzori

added serialization, tests

29042 11/07/2014 06:53 PM Claudio Atzori

instantiate one SAXReader for each call

29041 11/07/2014 06:52 PM Claudio Atzori

fixed format-layout-interpretation concatenation,
doesn't fail when the fieldExtractor returns a null result

29040 11/07/2014 06:51 PM Claudio Atzori

added json serialization, builds the matching key one time only

29036 11/07/2014 04:30 PM Alessia Bardi

do not upsert sets here in the mapper: we shall delegate to a separate workflow to be run after the OAI feeding is completed.

29032 11/07/2014 03:49 PM Alessia Bardi

Always new records to test how faster we go

29030 11/07/2014 03:36 PM Alessia Bardi

Always new records to test how faster we go

29014 10/07/2014 07:41 PM Alessia Bardi

Refactored class that extracts fields from records. When we can't find an expected index from the configuration to check its repeatability, the field is indexed as repeatable and a counter is updated.

29009 10/07/2014 06:33 PM Claudio Atzori

idScheme and idNamespace defined as part of the OAI configuration profile

29000 10/07/2014 05:54 PM Alessia Bardi

Removed dependency to dnet-oai-utils to avoid inheritance of unwanted jars such as cnr-rmi-api, cnr-service-common, spring, etc., which should not appear when running a job on the cluster. Needed classes have been copied and adapted so they do not use spring anymore.

28981 10/07/2014 09:49 AM Claudio Atzori

extended dedup configuration, including now blacklists and algorithm parameters

28904 04/07/2014 03:33 PM Alessia Bardi

Format, layout and interpretation are obtained from the collection name rather than being fixed.

28467 26/06/2014 04:38 PM Claudio Atzori

namespace cleanup

28457 25/06/2014 07:20 PM Claudio Atzori

removed unused field <dri:repositoryId/>

28411 24/06/2014 09:59 AM Claudio Atzori

removed protocolbuffers dependency from dnet-pace-core, Builders and Proto specific tests moved in dnet-openaireplus-mapping-utils, adapted dnet-mapreduce-jobs

28311 19/06/2014 03:15 PM Claudio Atzori

oaf schema location passed as parameter by the workflow

28309 19/06/2014 02:24 PM Alessia Bardi

Testing without depending on a running mdstore

28308 19/06/2014 01:49 PM Claudio Atzori

small refactor

28303 19/06/2014 12:54 PM Alessia Bardi

OAI feed map only job

28226 16/06/2014 09:30 AM Claudio Atzori

fixed oaf to xml serialization

28094 09/06/2014 04:19 PM Claudio Atzori

merged from branch 0.0.4

27199 06/05/2014 05:56 PM Claudio Atzori

added early implementation of OAI feeding job (M/R)

27148 05/05/2014 09:40 AM Claudio Atzori

fixed IIS output escaping

27147 05/05/2014 09:39 AM Claudio Atzori

added support for one way relationships