updated nexus URL to https and new hostname
every time a requests times out, the next timeout is increased
Updated to the latest version on dnet45 codebase: the stream is closed, need to copy the content
Expect date, not datetime for incremental harvesting
Fixed typo in logs
removed sort on createCursor because of this error: Query failed with error code 96 and error message 'Executor error during find command: OperationFailed: Sort operation used more than the maximum 33554432 bytes of RAM. Add an index, or specify a smaller limit
solr 772 integration
fixed ranges to exclude SOLR772 snapshots
dependenxies and deploy for slr772
branch for solr772
Added failedCallback to mdstore plugin invocation
updated resolver and Trying to allow mdstore plugin to print progress information on UI
HttpSimpleCollectorPlugin now uses HttpConnector so that it can deal with redirect and retries
Using snapshot parent
Ingored wrong test
fixed wrong import
modified OAI Collector plugin to skip invalid page but continue to download retrieving the next resumption token
but we need an and
or is or
COnsider 201 code ok (for huma-num OAI-PMH endpoint)
ensureIndices on latest write (+ logs to double check)
SftpIterator can work incrementally with dates and datetimes
Added CrossRef plugin
Reverted filesystem plugin to the first implementation that does not use FileDirectoryStream: files were left open causing Too many open files errors
implemented new way of commit incremental store
using new mockito lib
namespace map must be initialized
updated mockito version
added protocol property
created garbage collection hard version
Cleaner is now able to handle namespaces in cleaning rules, if they are defined in the new NAMESPACES element of the CleanerDSResourceType
pass inner exception, otherwise we do not know why we could not initialize the mongo cursor
modified creation of endpoint template
fixed bug missing timestamp on incremental feeding mdstore
re-introduced the "noCursorTimeout" option that was overridden by the merge from trunk
MERGE: branch updated with trunk changes through r50560
added log
[maven-release-plugin] prepare for next development iteration
[maven-release-plugin] copy for tag dnet-data-services-2.0.0-SAXONHE
[maven-release-plugin] prepare release dnet-data-services-2.0.0-SAXONHE
set version for provided servlet
Fixed loop
new parameter for targz plugin to collect only file with given extensions
New simple http collector plugin that doesn't care about splitting the file it downloads.
Cleaned test configuration
Fixed incremental harvesting via sftp due to an issue with Java8 DateTime. Wish the time management would be easier with Java8?
Removed cursor timemout
Upgraded incremental harvesting and other stuff
bug fixed
removed First Line
updated mongo dump iterator to read compressed json
added new mdstore
created a branch for the new mdstore
typo in log
reverted, I restarted the webapp and did not get those error again
Trying synchronized in MongoResultSetListener to avoid com.mongodb.MongoQueryException: Query failed with error code 12051 and error message 'clientcursor already in use? driver problem?' on server
Launch the correct exception when parsing fails
Returning more detailed counters for mdstore feeding.Fixed bug when trying to store too large XML: now all the page of XMLs is skipped, so we can go on with the other records (MongoBulkWritesManager)
Typo in log
Throw detailed esception
fixed bug
Changed deliverObjects of mongo gridfs
Also handle -1 date
implemented use of from/until for incremental record delivery
Cannot have two web methods with the same name and different args
empty passphrase
New method to disable cursor timeout when reading from mdstore
added method to ObjectStore
forgot an import
limit number of files to be downloaded from ariadne (test is ignored anyway)
clean up test log configuration
Added no timeout option to gridfsResultSet
Use ThreadSafeIterator
Need synchronized next() method to avoid issues when collecting while getting the wf status/history
Not disconnect from sftp in the hasNext
less retries and corrected path in the queue for incremental mode
Fixed file path
fixed log4j
Ignore remote test
Need to create the session using the username parameter :-)
Added username parameter to the SFTP plugin with public key auth
deploy.info for SaxonHE branches
changed dependency so that it is clear those are modules using SAXON HE
fixed deploy.info
added deploy.info
fixed test property
Test for SFTP with public key. Marked with @Ignore because it relies on an external SFTP server
Logging parameters when connecting to SFTP with Public key authentication
sftpPubKeyAuthentication API protocol for SFTP with pubKey authentication
Setting Saxon Transformerfactory also in the property file
changed a way to create DLIObject to avoid java heap space
fixing memory leak, records should not loaded in memory
transformator function
Branch for migration to Saxon HE
branches folder