Project

General

Profile

Statistics
| Revision:
  • svn:ignore: .classpath .settings target .project

# Date Author Comment
36271 09/04/2015 04:30 PM Claudio Atzori

adding empty solr docs to the rotten record set

36247 09/04/2015 02:53 PM Claudio Atzori

using different counter names

36164 08/04/2015 10:48 AM Claudio Atzori

added dedup roots to csv export job, dedup index feed job, tests

36158 08/04/2015 09:51 AM Claudio Atzori

using proper logger

36157 08/04/2015 09:50 AM Claudio Atzori

added dedup configuration to the entities merging process

35981 03/04/2015 11:32 AM Claudio Atzori

added more detailed counter about entity sub-type

35975 03/04/2015 10:31 AM Claudio Atzori

several improvements

35897 01/04/2015 05:00 PM Alessia Bardi

raised version

35896 01/04/2015 04:55 PM Alessia Bardi

commenting test with big doaj dataset

35771 30/03/2015 11:57 AM Claudio Atzori

different escaping

35769 30/03/2015 11:46 AM Claudio Atzori

trying to catch any kind of exception

35746 27/03/2015 05:23 PM Alessia Bardi

Testing DOAj for #1222#note-4

35476 18/03/2015 06:47 PM Claudio Atzori

added DedupSimilarityToActionsMapper and relative dependency

35452 18/03/2015 01:55 PM Michele Artini

increased version in scripts

35451 18/03/2015 01:07 PM Michele Artini

updated the version of a dependency

35442 18/03/2015 12:15 PM Alessia Bardi

fundingtree is an escaped xml, not a json anymore.

35439 18/03/2015 12:01 PM Michele Artini

increased a minor virsion

35196 09/03/2015 05:09 PM Michele Artini

sample records

35179 09/03/2015 02:39 PM Michele Artini

reimplemented the fundingpath and context generation

35135 05/03/2015 07:46 PM Claudio Atzori

updated packages

35133 05/03/2015 07:44 PM Claudio Atzori

updated packages, codestyle

35129 05/03/2015 07:38 PM Claudio Atzori

codestyle

35128 05/03/2015 07:34 PM Claudio Atzori

updated packages

35127 05/03/2015 07:31 PM Claudio Atzori

OafMerger moved to mapping utils

34602 19/02/2015 04:17 PM Claudio Atzori

added protobuf-java-format dependency

34600 19/02/2015 04:14 PM Claudio Atzori

renamed test

34599 19/02/2015 04:07 PM Claudio Atzori

added json size test

34536 16/02/2015 07:56 PM Claudio Atzori

saving disk space, less logging

34454 11/02/2015 07:31 PM Alessia Bardi

Updated configuration for testing

34439 11/02/2015 04:06 PM Claudio Atzori

extended entities join configuration, added more tests

34438 11/02/2015 03:49 PM Claudio Atzori

extended entities join configuration, added more tests

34387 10/02/2015 11:18 AM Alessia Bardi

scripts using updated version 0.0.6.3

34386 10/02/2015 11:16 AM Alessia Bardi

test record took from HDFS

34374 09/02/2015 06:44 PM Alessia Bardi
34358 09/02/2015 12:05 PM Alessia Bardi

discard persons in OAI feeding (#1107)

34225 03/02/2015 11:50 AM Claudio Atzori

do not alter inferenceprovenance; codestyle

33811 09/01/2015 05:25 PM Alessia Bardi

Using released hadoop parent.

33382 12/12/2014 06:07 PM Claudio Atzori

added FCT fundings as contexts

33137 02/12/2014 04:33 PM Claudio Atzori

merged branch ProtoMapping

32832 17/11/2014 04:41 PM Claudio Atzori

imlemented retries

32714 13/11/2014 03:20 PM Alessia Bardi

Added oaf:identifiers to record sample.

32328 07/11/2014 03:53 PM Claudio Atzori

ignored iml file

32094 03/11/2014 05:21 PM Claudio Atzori

updated tests

32008 31/10/2014 10:45 AM Claudio Atzori

updated scripts

32007 31/10/2014 10:36 AM Claudio Atzori

[maven-release-plugin] prepare for next development iteration

32005 31/10/2014 10:36 AM Claudio Atzori

[maven-release-plugin] prepare release dnet-mapreduce-jobs-0.0.5

32004 31/10/2014 10:35 AM Claudio Atzori

removed extra scm tag

32003 31/10/2014 10:31 AM Claudio Atzori

added scm

32002 31/10/2014 10:23 AM Claudio Atzori

[maven-release-plugin] prepare release dnet-mapreduce-jobs-0.0.5

31998 31/10/2014 10:19 AM Claudio Atzori

bumped version, updated parent: let's start to depend on releases

31997 31/10/2014 10:19 AM Claudio Atzori

cleanup & tests

31409 16/10/2014 05:42 PM Claudio Atzori

added default bestlicense value. Used when the records doesn't provide any

31208 08/10/2014 03:25 PM Claudio Atzori

added more fields in test record

31186 07/10/2014 02:54 PM Alessia Bardi

Moved counters from entity body to header.

30969 01/10/2014 02:22 PM Claudio Atzori

- provenance information parsed from element "about"
- namespace aware datacite mapping for oaf:language and oaf:dateaccepted
- dedupBuildRoot doesn't write to WAL
- removed unused claim_2_hbase.xsl
- overall cleanup

30968 01/10/2014 02:15 PM Claudio Atzori

added relationship/children counters

30967 01/10/2014 02:14 PM Claudio Atzori

revised tests

30882 25/09/2014 05:42 PM Alessia Bardi

Avoiding set '___' generated when we have "strange" set names such as those in cyrillic/ukrain. In those cases records are assigned to a default set, currently named "OTHER".

30863 25/09/2014 12:40 PM Claudio Atzori

expanding provenanceaction classid

30835 23/09/2014 06:14 PM Claudio Atzori

merge from branch newIndexFeed

30834 23/09/2014 06:14 PM Claudio Atzori

merge from branch newIndexFeed

30833 23/09/2014 06:14 PM Claudio Atzori

fixing #783 (note-18)

30827 23/09/2014 03:46 PM Claudio Atzori

extraInfo removed from CDATA block, expanding provenance action in inferred elements

30751 18/09/2014 03:02 PM Alessia Bardi

fixed dependencies

29734 31/07/2014 02:28 PM Claudio Atzori

fixed blacklist type

29732 31/07/2014 12:48 PM Claudio Atzori

more logging. fixed entity type check

29707 30/07/2014 04:15 PM Claudio Atzori

more logging

29702 30/07/2014 03:38 PM Claudio Atzori

defined limit to the maximum number of counters

29657 29/07/2014 03:24 PM Claudio Atzori

defined limit to the maximum number of counters

29043 11/07/2014 06:54 PM Claudio Atzori

added serialization, tests

29042 11/07/2014 06:53 PM Claudio Atzori

instantiate one SAXReader for each call

29041 11/07/2014 06:52 PM Claudio Atzori

fixed format-layout-interpretation concatenation,
doesn't fail when the fieldExtractor returns a null result

29040 11/07/2014 06:51 PM Claudio Atzori

added json serialization, builds the matching key one time only

29036 11/07/2014 04:30 PM Alessia Bardi

do not upsert sets here in the mapper: we shall delegate to a separate workflow to be run after the OAI feeding is completed.

29034 11/07/2014 03:49 PM Claudio Atzori

early implementation of jar upload script

29032 11/07/2014 03:49 PM Alessia Bardi

Always new records to test how faster we go

29030 11/07/2014 03:36 PM Alessia Bardi

Always new records to test how faster we go

29014 10/07/2014 07:41 PM Alessia Bardi

Refactored class that extracts fields from records. When we can't find an expected index from the configuration to check its repeatability, the field is indexed as repeatable and a counter is updated.

29009 10/07/2014 06:33 PM Claudio Atzori

idScheme and idNamespace defined as part of the OAI configuration profile

29000 10/07/2014 05:54 PM Alessia Bardi

Removed dependency to dnet-oai-utils to avoid inheritance of unwanted jars such as cnr-rmi-api, cnr-service-common, spring, etc., which should not appear when running a job on the cluster. Needed classes have been copied and adapted so they do not use spring anymore.

28981 10/07/2014 09:49 AM Claudio Atzori

extended dedup configuration, including now blacklists and algorithm parameters

28904 04/07/2014 03:33 PM Alessia Bardi

Format, layout and interpretation are obtained from the collection name rather than being fixed.

28467 26/06/2014 04:38 PM Claudio Atzori

namespace cleanup

28457 25/06/2014 07:20 PM Claudio Atzori

removed unused field <dri:repositoryId/>

28411 24/06/2014 09:59 AM Claudio Atzori

removed protocolbuffers dependency from dnet-pace-core, Builders and Proto specific tests moved in dnet-openaireplus-mapping-utils, adapted dnet-mapreduce-jobs

28311 19/06/2014 03:15 PM Claudio Atzori

oaf schema location passed as parameter by the workflow

28309 19/06/2014 02:24 PM Alessia Bardi

Testing without depending on a running mdstore

28308 19/06/2014 01:49 PM Claudio Atzori

small refactor

28303 19/06/2014 12:54 PM Alessia Bardi

OAI feed map only job

28226 16/06/2014 09:30 AM Claudio Atzori

fixed oaf to xml serialization

28094 09/06/2014 04:19 PM Claudio Atzori

merged from branch 0.0.4

27199 06/05/2014 05:56 PM Claudio Atzori

added early implementation of OAI feeding job (M/R)

27148 05/05/2014 09:40 AM Claudio Atzori

fixed IIS output escaping

27147 05/05/2014 09:39 AM Claudio Atzori

added support for one way relationships

26857 17/04/2014 12:49 PM Sandro La Bruzzo

SCRIPT_COMMENT: fixed deploy.info file to the module dnet-mapreduce-jobs

26716 16/04/2014 03:51 PM Sandro La Bruzzo

SCRIPT_COMMENT: Added deploy.info file to the module dnet-mapreduce-jobs