from + until arguments with UTCDatetime
adding from/until dates aligned with OAI v2, ISO8601 (refs #6839)
adding from/until dates aligned with OAI v2
removed check for same RT from one call to the other (no specification say that it must be different) Left the check that at least one element named record should be present in the returned list
added check for same rumption token and empty records list - both times throw runtime eception
fix issue in recursive impletation. Addition of path from home directory to file in nested folder - from Miriam
#5842: do not return blank strings but an empty <record/>
supporting incremental harvesting with the fs collector plugin
#5185: Log formatting
#5185: Improved logging and handling of HTTP status codes
added @Ignore to a test
plugin to collect from an external mongo mdstore
fixed empty attribute error
do not log or propagate erroneous and potentially huge xml records. They might clog the information system
Check is blank
switched to org.apache.httpcomponents:httpclient:4.5.3
Changed OAI Iterator to allow to find the next resumption token even if the page is not xml well formed
Upgrade to commons.net:commons.net 3.6 (from 3.3) and commons-httpclient 4.5.6 (from 3.1).using HttpConnector where needed.httpConnector can now return an InputStream and not only a string.
instance of httpconnector so the test works when unignored
removed DOCTYPE declaration so the test works
remove some characters there are not in XML Character Range.see https://www.w3.org/TR/REC-xml/#charsets
Ignore test used to check the issue with SSL misconfigured servers.
committed partial test for Michele, my hero :-)
added request url in error log
Ignore test I do not want to run on jenkins
Testing SNI
added default value to responseType variable
add private variable responseType and getter for it and code to assign it the responseType value
javadoc and some java8 stuff
HttpConnector connection leak? trying to solve by disconnecting the HttpConnection
updated imports for commons-lang3
remove rest plugin from this module
classes for rest-api
check condition retry-after in combination with HTTP-Status 503
try to clean the csv values before converting to xml
do not pollute the logs
Moved HttpConnector in common package
Ignore test for FTP collector as it connects to the eagle FTP
FTP metadata collector plugin now supports incremental harvesting
update user-agent to "Mozilla/5.0 (compatible; OAI; +http://www.openaire.eu)", the word "Harvester" caused 403 status code in one case
integrated latest changes from dnet40
No fatal logs are needed anymore
Set header/objIdentifier from the name of the json/xml record collected from file system, when the access param "setObjIdentifierFromFileName" is true. Note that the field is not in the dri namespace.
FS Plugin: for claims we need to be able to collect json files
FS Plugin: extension parameter is optional. When void, it means we can take all files
migrated to dnet45
codebase used to migrate to java8 the production system