D-Net

[maven-release-plugin] copy for tag dnet-modular-collector-service-3.3.4

[maven-release-plugin] prepare release dnet-modular-collector-service-3.3.4

Ingore test that uses remote SFTP

removed reference to the not anymore used DateTimeFormatter for jsch dates

Better using integer mtime. Parsing string dates is hell.

Ignore tests that use remote sftp locations

SFTP plugin now supports incremental collection based on the last modified date of files.

removed old version of dependency for jsch

changed basePath parameter optional in plugin filesfrommetadata

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.3.3

HttpConnector complemented with CookieHandler, CookieManager due to issue with URV data provider

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.3.2

user-agent string changed again due to issue with yet another data provider

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.3.1

add the same parameter to protocol files_from_mdstore

Ignore test using remote ftp

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.3.0

Increased version: we want to exclude this from the production container for now.

fixed a typo in two comments (FTP vs SFTP)

- removed old ftp (code and spring bean)
- renamed new ftp (aka ftp2) as ftp
- added a first version of sftp protocol for collection
- minor changes in the code (e.g. exception classes involved)

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.2.0

ups, wrongly removal of xmlns

basePath access param set as mandatory for files_from_metadata. Available path to choose from should be in service parameters of the Object store service (property key: 'basePath')

added User-Agent request property to circumvent http 403 status code, example kagoshima repository

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.14

clean a log

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.13

fix some NPE and IndexOutOfBoundException in CSV plugins

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.12

solving ticket #1160

Created a collectorServiceErrorMessageLogList to help jochen in debugging OAI harvests gone wrong.

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.11

returning error code & message when a timeout occurs

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.10

set log to debug

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.9

trying to fix ftp collector service - test fixed

trying to fix ftp collector service

improved logs

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.8

Avoid noisy info logs and throw UnsupportedOperation when needed.

reindent

Test for HttpConnector

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.7

implemented layer file system for Object Store Service

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.6

Implements 1236#note-16: stop reading pages if I have already seen ALL sets provided by the current page.

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.5

Testing

Preventing to cycle over ListSets pages when the publishers do not work and return always the same page.

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.4

added extensions filter to ftp2 plugin
-test corrected.

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.3

added extensions filter to ftp2 plugin

ftp2 failures in disconnection/logout do not invalidate the WF (an error is logged, though)

301/302 codes are not manually handled

test

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.2

fixed a bean name

[maven-release-plugin] prepare for next development iteration

[maven-release-plugin] prepare release dnet-modular-collector-service-3.1.1

fixed test

httpList plugin

added mongodump collector plugin

corrected a bug in next()

added contructors with File argument

added tests for zip and tar.gz iterators

tests re-packaged

package refactoring

first implementation of the zip collector plugin

removed RuntimeExceptions
better logging

logger removed

removed extension param

First implementation of .tar.gz plugin

Filesystem plugin' tests updated

removed useless toString()

laxy and recursive FS collector plugin.
tested on datacite.

-Extensions param is a CSV list e.g "xml,pg,pdf"
-The behavior is by design recursive.