Project

General

Profile

Statistics
| Revision:

# Date Author Comment
59664 22/10/2020 17:49 Alessia Bardi

fix issue in recursive impletation. Addition of path from home directory to file in nested folder - from Miriam

59231 06/08/2020 19:45 Alessia Bardi

#5842: do not return blank strings but an empty <record/>

59094 13/07/2020 17:33 Alessia Bardi

supporting incremental harvesting with the fs collector plugin

57867 12/12/2019 17:13 Alessia Bardi

#5185: Log formatting

57866 12/12/2019 16:23 Alessia Bardi

#5185: Improved logging and handling of HTTP status codes

57554 08/11/2019 15:59 Michele Artini

plugin to collect from an external mongo mdstore

56626 18/07/2019 16:52 Sandro La Bruzzo

fixed empty attribute error

56610 18/07/2019 11:54 Claudio Atzori

do not log or propagate erroneous and potentially huge xml records. They might clog the information system

55930 30/05/2019 18:37 Alessia Bardi

Check is blank

54376 14/12/2018 10:15 Claudio Atzori

switched to org.apache.httpcomponents:httpclient:4.5.3

54375 14/12/2018 10:06 Claudio Atzori

switched to org.apache.httpcomponents:httpclient:4.5.3

54119 04/12/2018 16:22 Sandro La Bruzzo

Changed OAI Iterator to allow to find the next resumption token even if the page is not xml well formed

53932 22/11/2018 18:40 Alessia Bardi

Upgrade to commons.net:commons.net 3.6 (from 3.3) and commons-httpclient 4.5.6 (from 3.1).
using HttpConnector where needed.
httpConnector can now return an InputStream and not only a string.

53122 14/09/2018 14:05 Andreas Czerniak

remove some characters there are not in XML Character Range.
see https://www.w3.org/TR/REC-xml/#charsets

52727 11/07/2018 18:21 Claudio Atzori

added request url in error log

51958 08/05/2018 11:16 Miriam Baglioni

added default value to responseType variable

51955 08/05/2018 10:40 Miriam Baglioni

add private variable responseType and getter for it and code to assign it the responseType value

51556 28/03/2018 15:39 Claudio Atzori

javadoc and some java8 stuff

50772 16/02/2018 12:32 Alessia Bardi

HttpConnector connection leak? trying to solve by disconnecting the HttpConnection

50665 09/02/2018 17:44 Jochen Schirrwagen

updated imports for commons-lang3

50067 04/12/2017 19:07 Jochen Schirrwagen

remove rest plugin from this module

50050 03/12/2017 22:17 Jochen Schirrwagen

classes for rest-api

50042 01/12/2017 16:19 Jochen Schirrwagen

check condition retry-after in combination with HTTP-Status 503

49677 25/10/2017 14:42 Claudio Atzori

try to clean the csv values before converting to xml

49674 25/10/2017 14:04 Claudio Atzori

do not pollute the logs

49643 23/10/2017 18:24 Alessia Bardi

Moved HttpConnector in common package

49006 20/09/2017 10:14 Alessia Bardi

FTP metadata collector plugin now supports incremental harvesting

48804 05/08/2017 18:45 Jochen Schirrwagen

update user-agent to "Mozilla/5.0 (compatible; OAI; +http://www.openaire.eu)", the word "Harvester" caused 403 status code in one case

48023 28/06/2017 12:56 Claudio Atzori

integrated latest changes from dnet40

47654 22/06/2017 17:51 Alessia Bardi

No fatal logs are needed anymore

47589 19/06/2017 19:19 Alessia Bardi

Set header/objIdentifier from the name of the json/xml record collected from file system, when the access param "setObjIdentifierFromFileName" is true. Note that the field is not in the dri namespace.

47519 14/06/2017 17:23 Alessia Bardi

FS Plugin: for claims we need to be able to collect json files

47518 14/06/2017 17:10 Alessia Bardi

FS Plugin: extension parameter is optional. When void, it means we can take all files

45198 10/01/2017 16:07 Claudio Atzori

codebase used to migrate to java8 the production system