fix issue in recursive impletation. Addition of path from home directory to file in nested folder - from Miriam
#5842: do not return blank strings but an empty <record/>
supporting incremental harvesting with the fs collector plugin
#5185: Log formatting
#5185: Improved logging and handling of HTTP status codes
plugin to collect from an external mongo mdstore
fixed empty attribute error
do not log or propagate erroneous and potentially huge xml records. They might clog the information system
Check is blank
switched to org.apache.httpcomponents:httpclient:4.5.3
Changed OAI Iterator to allow to find the next resumption token even if the page is not xml well formed
Upgrade to commons.net:commons.net 3.6 (from 3.3) and commons-httpclient 4.5.6 (from 3.1).using HttpConnector where needed.httpConnector can now return an InputStream and not only a string.
remove some characters there are not in XML Character Range.see https://www.w3.org/TR/REC-xml/#charsets
added request url in error log
added default value to responseType variable
add private variable responseType and getter for it and code to assign it the responseType value
javadoc and some java8 stuff
HttpConnector connection leak? trying to solve by disconnecting the HttpConnection
updated imports for commons-lang3
remove rest plugin from this module
classes for rest-api
check condition retry-after in combination with HTTP-Status 503
try to clean the csv values before converting to xml
do not pollute the logs
Moved HttpConnector in common package
FTP metadata collector plugin now supports incremental harvesting
update user-agent to "Mozilla/5.0 (compatible; OAI; +http://www.openaire.eu)", the word "Harvester" caused 403 status code in one case
integrated latest changes from dnet40
No fatal logs are needed anymore
Set header/objIdentifier from the name of the json/xml record collected from file system, when the access param "setObjIdentifierFromFileName" is true. Note that the field is not in the dri namespace.
FS Plugin: for claims we need to be able to collect json files
FS Plugin: extension parameter is optional. When void, it means we can take all files
codebase used to migrate to java8 the production system