Project

General

Profile

Statistics
| Revision:

# Date Author Comment
35476 18/03/2015 06:47 PM Claudio Atzori

added DedupSimilarityToActionsMapper and relative dependency

35452 18/03/2015 01:55 PM Michele Artini

increased version in scripts

35451 18/03/2015 01:07 PM Michele Artini

updated the version of a dependency

35442 18/03/2015 12:15 PM Alessia Bardi

fundingtree is an escaped xml, not a json anymore.

35439 18/03/2015 12:01 PM Michele Artini

increased a minor virsion

35196 09/03/2015 05:09 PM Michele Artini

sample records

35179 09/03/2015 02:39 PM Michele Artini

reimplemented the fundingpath and context generation

35135 05/03/2015 07:46 PM Claudio Atzori

updated packages

35133 05/03/2015 07:44 PM Claudio Atzori

updated packages, codestyle

35129 05/03/2015 07:38 PM Claudio Atzori

codestyle

35128 05/03/2015 07:34 PM Claudio Atzori

updated packages

35127 05/03/2015 07:31 PM Claudio Atzori

OafMerger moved to mapping utils

34901 27/02/2015 05:39 PM Claudio Atzori

temporary commit

34898 27/02/2015 05:37 PM Claudio Atzori

offline dedup

34602 19/02/2015 04:17 PM Claudio Atzori

added protobuf-java-format dependency

34600 19/02/2015 04:14 PM Claudio Atzori

renamed test

34599 19/02/2015 04:07 PM Claudio Atzori

added json size test

34536 16/02/2015 07:56 PM Claudio Atzori

saving disk space, less logging

34454 11/02/2015 07:31 PM Alessia Bardi

Updated configuration for testing

34439 11/02/2015 04:06 PM Claudio Atzori

extended entities join configuration, added more tests

34438 11/02/2015 03:49 PM Claudio Atzori

extended entities join configuration, added more tests

34387 10/02/2015 11:18 AM Alessia Bardi

scripts using updated version 0.0.6.3

34386 10/02/2015 11:16 AM Alessia Bardi

test record took from HDFS

34374 09/02/2015 06:44 PM Alessia Bardi
34358 09/02/2015 12:05 PM Alessia Bardi

discard persons in OAI feeding (#1107)

34225 03/02/2015 11:50 AM Claudio Atzori

do not alter inferenceprovenance; codestyle

33811 09/01/2015 05:25 PM Alessia Bardi

Using released hadoop parent.

33382 12/12/2014 06:07 PM Claudio Atzori

added FCT fundings as contexts

33137 02/12/2014 04:33 PM Claudio Atzori

merged branch ProtoMapping

32832 17/11/2014 04:41 PM Claudio Atzori

imlemented retries

32714 13/11/2014 03:20 PM Alessia Bardi

Added oaf:identifiers to record sample.

32328 07/11/2014 03:53 PM Claudio Atzori

ignored iml file

32094 03/11/2014 05:21 PM Claudio Atzori

updated tests

32008 31/10/2014 10:45 AM Claudio Atzori

updated scripts

32007 31/10/2014 10:36 AM Claudio Atzori

[maven-release-plugin] prepare for next development iteration

32006 31/10/2014 10:36 AM Claudio Atzori

[maven-release-plugin] copy for tag dnet-mapreduce-jobs-0.0.5

32005 31/10/2014 10:36 AM Claudio Atzori

[maven-release-plugin] prepare release dnet-mapreduce-jobs-0.0.5

32004 31/10/2014 10:35 AM Claudio Atzori

removed extra scm tag

32003 31/10/2014 10:31 AM Claudio Atzori

added scm

32002 31/10/2014 10:23 AM Claudio Atzori

[maven-release-plugin] prepare release dnet-mapreduce-jobs-0.0.5

31998 31/10/2014 10:19 AM Claudio Atzori

bumped version, updated parent: let's start to depend on releases

31997 31/10/2014 10:19 AM Claudio Atzori

cleanup & tests

31409 16/10/2014 05:42 PM Claudio Atzori

added default bestlicense value. Used when the records doesn't provide any

31208 08/10/2014 03:25 PM Claudio Atzori

added more fields in test record

31186 07/10/2014 02:54 PM Alessia Bardi

Moved counters from entity body to header.

30969 01/10/2014 02:22 PM Claudio Atzori

- provenance information parsed from element "about"
- namespace aware datacite mapping for oaf:language and oaf:dateaccepted
- dedupBuildRoot doesn't write to WAL
- removed unused claim_2_hbase.xsl
- overall cleanup

30968 01/10/2014 02:15 PM Claudio Atzori

added relationship/children counters

30967 01/10/2014 02:14 PM Claudio Atzori

revised tests

30882 25/09/2014 05:42 PM Alessia Bardi

Avoiding set '___' generated when we have "strange" set names such as those in cyrillic/ukrain. In those cases records are assigned to a default set, currently named "OTHER".

30863 25/09/2014 12:40 PM Claudio Atzori

expanding provenanceaction classid

30835 23/09/2014 06:14 PM Claudio Atzori

merge from branch newIndexFeed

30834 23/09/2014 06:14 PM Claudio Atzori

merge from branch newIndexFeed

30833 23/09/2014 06:14 PM Claudio Atzori

fixing #783 (note-18)

30827 23/09/2014 03:46 PM Claudio Atzori

extraInfo removed from CDATA block, expanding provenance action in inferred elements

30751 18/09/2014 03:02 PM Alessia Bardi

fixed dependencies

30350 17/09/2014 11:05 AM Sandro La Bruzzo

created tag folder for release

30017 04/09/2014 04:08 PM Claudio Atzori

removed CDATA from extraInfo payloads

30005 04/09/2014 11:44 AM Claudio Atzori

using CloudSolrServer for parallel index feeding

29946 02/09/2014 05:23 PM Claudio Atzori

added branch name

29905 29/08/2014 10:57 AM Claudio Atzori

updated branch version and build scripts

29903 29/08/2014 10:50 AM Claudio Atzori

update branch with contributes from trunk and other branches

29860 26/08/2014 11:14 AM Claudio Atzori

changed properties passed to index feed m/r job

29858 26/08/2014 10:32 AM Claudio Atzori

fixed pom and scripts

29856 25/08/2014 06:15 PM Claudio Atzori

updated index feed job to make use of the new shared solr lib

29850 25/08/2014 05:31 PM Claudio Atzori

branch to test the new index feeding libs

29734 31/07/2014 02:28 PM Claudio Atzori

fixed blacklist type

29732 31/07/2014 12:48 PM Claudio Atzori

more logging. fixed entity type check

29707 30/07/2014 04:15 PM Claudio Atzori

more logging

29702 30/07/2014 03:38 PM Claudio Atzori

defined limit to the maximum number of counters

29657 29/07/2014 03:24 PM Claudio Atzori

defined limit to the maximum number of counters

29043 11/07/2014 06:54 PM Claudio Atzori

added serialization, tests

29042 11/07/2014 06:53 PM Claudio Atzori

instantiate one SAXReader for each call

29041 11/07/2014 06:52 PM Claudio Atzori

fixed format-layout-interpretation concatenation,
doesn't fail when the fieldExtractor returns a null result

29040 11/07/2014 06:51 PM Claudio Atzori

added json serialization, builds the matching key one time only

29036 11/07/2014 04:30 PM Alessia Bardi

do not upsert sets here in the mapper: we shall delegate to a separate workflow to be run after the OAI feeding is completed.

29034 11/07/2014 03:49 PM Claudio Atzori

early implementation of jar upload script

29032 11/07/2014 03:49 PM Alessia Bardi

Always new records to test how faster we go

29030 11/07/2014 03:36 PM Alessia Bardi

Always new records to test how faster we go

29014 10/07/2014 07:41 PM Alessia Bardi

Refactored class that extracts fields from records. When we can't find an expected index from the configuration to check its repeatability, the field is indexed as repeatable and a counter is updated.

29009 10/07/2014 06:33 PM Claudio Atzori

idScheme and idNamespace defined as part of the OAI configuration profile

29002 10/07/2014 05:56 PM Claudio Atzori

proto to pace mapping parses the whole entity

29000 10/07/2014 05:54 PM Alessia Bardi

Removed dependency to dnet-oai-utils to avoid inheritance of unwanted jars such as cnr-rmi-api, cnr-service-common, spring, etc., which should not appear when running a job on the cluster. Needed classes have been copied and adapted so they do not use spring anymore.

28998 10/07/2014 05:43 PM Claudio Atzori

branch to adapt the proto to pace mapping

28981 10/07/2014 09:49 AM Claudio Atzori

extended dedup configuration, including now blacklists and algorithm parameters

28904 04/07/2014 03:33 PM Alessia Bardi

Format, layout and interpretation are obtained from the collection name rather than being fixed.

28467 26/06/2014 04:38 PM Claudio Atzori

namespace cleanup

28457 25/06/2014 07:20 PM Claudio Atzori

removed unused field <dri:repositoryId/>

28411 24/06/2014 09:59 AM Claudio Atzori

removed protocolbuffers dependency from dnet-pace-core, Builders and Proto specific tests moved in dnet-openaireplus-mapping-utils, adapted dnet-mapreduce-jobs

28311 19/06/2014 03:15 PM Claudio Atzori

oaf schema location passed as parameter by the workflow

28309 19/06/2014 02:24 PM Alessia Bardi

Testing without depending on a running mdstore

28308 19/06/2014 01:49 PM Claudio Atzori

small refactor

28303 19/06/2014 12:54 PM Alessia Bardi

OAI feed map only job

28226 16/06/2014 09:30 AM Claudio Atzori

fixed oaf to xml serialization

28094 09/06/2014 04:19 PM Claudio Atzori

merged from branch 0.0.4

28083 09/06/2014 02:57 PM Claudio Atzori

tests

28082 09/06/2014 02:57 PM Claudio Atzori

inferred stuff will be expanded right after of the main entity element

28081 09/06/2014 02:56 PM Claudio Atzori

cleanup

28068 07/06/2014 11:09 AM Claudio Atzori

updated test configuration

28067 07/06/2014 11:08 AM Claudio Atzori

helper method to discover the type of the entity target of a relationship, used during the xml expansion