Project

General

Profile

Statistics
| Revision:

dnet40/modules/dnet-mapreduce-jobs/branches/0.0.6.3.x/src/main/java/eu/dnetlib/data/mapreduce/hbase/oai @ 36641

Name Size Revision Age Author Comment
  config 29040 almost 10 years Claudio Atzori added json serialization, builds the matching k...
  utils 34374 over 9 years Alessia Bardi
OAIFeedJob.java 1.36 KB 28303 about 10 years Alessia Bardi OAI feed map only job
OaiFeedMapper.java 9.69 KB 36641 about 9 years Alessia Bardi Using MongoClient instead of deprecated Mongo. ...

Latest revisions

# Date Author Comment
36641 23/04/2015 11:33 AM Alessia Bardi

Using MongoClient instead of deprecated Mongo. Removed record status management, since records are always new anyway.
35898 01/04/2015 05:14 PM Alessia Bardi

branch for code before the re-implementation of context and fundingpaths
34374 09/02/2015 06:44 PM Alessia Bardi
34358 09/02/2015 12:05 PM Alessia Bardi

discard persons in OAI feeding (#1107)
30882 25/09/2014 05:42 PM Alessia Bardi

Avoiding set '___' generated when we have "strange" set names such as those in cyrillic/ukrain. In those cases records are assigned to a default set, currently named "OTHER".
29043 11/07/2014 06:54 PM Claudio Atzori

added serialization, tests
29042 11/07/2014 06:53 PM Claudio Atzori

instantiate one SAXReader for each call
29041 11/07/2014 06:52 PM Claudio Atzori

fixed format-layout-interpretation concatenation,
doesn't fail when the fieldExtractor returns a null result
29040 11/07/2014 06:51 PM Claudio Atzori

added json serialization, builds the matching key one time only
29036 11/07/2014 04:30 PM Alessia Bardi

do not upsert sets here in the mapper: we shall delegate to a separate workflow to be run after the OAI feeding is completed.

View revisions

Also available in: Atom