Project

General

Profile

Statistics
| Revision:

# Date Author Comment
61049 25/05/2021 04:55 PM Alessia Bardi

Updated to the latest version on dnet45 codebase: the stream is closed, need to copy the content

61048 25/05/2021 04:16 PM Alessia Bardi

Updated to the latest version on dnet45 codebase: the stream is closed, need to copy the content

60110 09/12/2020 06:47 PM Alessia Bardi

Expect date, not datetime for incremental harvesting

58852 04/06/2020 10:03 PM Alessia Bardi

Fixed typo in logs

58040 30/01/2020 11:46 AM Enrico Ottonello

removed sort on createCursor because of this error: Query failed with error code 96 and error message 'Executor error during find command: OperationFailed: Sort operation used more than the maximum 33554432 bytes of RAM. Add an index, or specify a smaller limit

57160 26/09/2019 04:14 PM Enrico Ottonello

solr 772 integration

57132 25/09/2019 11:32 AM Alessia Bardi

fixed ranges to exclude SOLR772 snapshots

57131 25/09/2019 11:29 AM Alessia Bardi

fixed ranges to exclude SOLR772 snapshots

57113 21/09/2019 12:22 PM Alessia Bardi

dependenxies and deploy for slr772

57112 21/09/2019 12:18 PM Alessia Bardi

branch for solr772

56977 06/09/2019 09:46 AM Michele Artini

Added failedCallback to mdstore plugin invocation

54390 14/12/2018 11:47 AM Sandro La Bruzzo

updated resolver and Trying to allow mdstore plugin to print progress information on UI

53895 20/11/2018 04:55 PM Alessia Bardi

HttpSimpleCollectorPlugin now uses HttpConnector so that it can deal with redirect and retries

53857 18/11/2018 08:38 PM Alessia Bardi

Using snapshot parent

53649 07/11/2018 03:20 PM Sandro La Bruzzo

Ingored wrong test

53648 07/11/2018 03:01 PM Sandro La Bruzzo

fixed wrong import

53647 07/11/2018 02:58 PM Sandro La Bruzzo

modified OAI Collector plugin to skip invalid page but continue to download retrieving the next resumption token

53507 17/10/2018 03:30 PM Alessia Bardi

but we need an and

53506 17/10/2018 03:20 PM Alessia Bardi

or is or

53497 17/10/2018 03:09 PM Alessia Bardi

COnsider 201 code ok (for huma-num OAI-PMH endpoint)

53440 12/10/2018 11:30 AM Alessia Bardi

ensureIndices on latest write (+ logs to double check)

52889 03/08/2018 10:30 AM Alessia Bardi

SftpIterator can work incrementally with dates and datetimes

52682 05/07/2018 02:37 PM Sandro La Bruzzo

Added CrossRef plugin

51722 08/04/2018 11:01 AM Alessia Bardi

Reverted filesystem plugin to the first implementation that does not use FileDirectoryStream: files were left open causing Too many open files errors

51189 13/03/2018 01:17 PM Sandro La Bruzzo

implemented new way of commit incremental store

51184 13/03/2018 12:19 PM Alessia Bardi

using new mockito lib

51183 13/03/2018 12:18 PM Alessia Bardi

namespace map must be initialized

51182 13/03/2018 12:18 PM Alessia Bardi

updated mockito version

51117 09/03/2018 12:44 PM Miriam Baglioni

added protocol property

51059 06/03/2018 05:09 PM Sandro La Bruzzo

created garbage collection hard version

51009 02/03/2018 11:52 AM Alessia Bardi

Cleaner is now able to handle namespaces in cleaning rules, if they are defined in the new NAMESPACES element of the CleanerDSResourceType

50930 24/02/2018 05:19 PM Alessia Bardi

pass inner exception, otherwise we do not know why we could not initialize the mongo cursor

50898 23/02/2018 09:57 AM Miriam Baglioni

modified creation of endpoint template

50819 19/02/2018 05:33 PM Sandro La Bruzzo

fixed bug missing timestamp on incremental feeding mdstore

50679 12/02/2018 11:41 AM Alessia Bardi

re-introduced the "noCursorTimeout" option that was overridden by the merge from trunk

50563 02/02/2018 11:02 AM Alessia Bardi

MERGE: branch updated with trunk changes through r50560

50402 25/01/2018 02:46 PM Sandro La Bruzzo

added log

49117 25/09/2017 06:13 PM Alessia Bardi

[maven-release-plugin] prepare for next development iteration

49116 25/09/2017 06:13 PM Alessia Bardi

[maven-release-plugin] copy for tag dnet-data-services-2.0.0-SAXONHE

49115 25/09/2017 06:13 PM Alessia Bardi

[maven-release-plugin] prepare release dnet-data-services-2.0.0-SAXONHE

49114 25/09/2017 06:12 PM Alessia Bardi

set version for provided servlet

49032 20/09/2017 07:14 PM Alessia Bardi

Fixed loop

49030 20/09/2017 06:48 PM Alessia Bardi

new parameter for targz plugin to collect only file with given extensions

48833 10/08/2017 04:53 PM Alessia Bardi

New simple http collector plugin that doesn't care about splitting the file it downloads.

48825 09/08/2017 04:02 PM Alessia Bardi

Cleaned test configuration

48824 09/08/2017 04:01 PM Alessia Bardi

Fixed incremental harvesting via sftp due to an issue with Java8 DateTime. Wish the time management would be easier with Java8?

48757 26/07/2017 02:01 PM Sandro La Bruzzo

Removed cursor timemout

48701 25/07/2017 10:21 AM Sandro La Bruzzo

Upgraded incremental harvesting and other stuff

48584 17/07/2017 04:11 PM Sandro La Bruzzo

bug fixed

48583 17/07/2017 03:47 PM Sandro La Bruzzo

added log

48582 17/07/2017 03:27 PM Sandro La Bruzzo

removed First Line

48581 17/07/2017 02:38 PM Sandro La Bruzzo

updated mongo dump iterator to read compressed json

48528 11/07/2017 10:44 AM Sandro La Bruzzo

added new mdstore

48526 11/07/2017 10:41 AM Sandro La Bruzzo

created a branch for the new mdstore

48234 03/07/2017 11:08 AM Alessia Bardi

typo in log

47243 13/05/2017 04:28 PM Alessia Bardi

reverted, I restarted the webapp and did not get those error again

47241 13/05/2017 04:16 PM Alessia Bardi

Trying synchronized in MongoResultSetListener to avoid com.mongodb.MongoQueryException: Query failed with error code 12051 and error message 'clientcursor already in use? driver problem?' on server

47235 12/05/2017 07:02 PM Alessia Bardi

Launch the correct exception when parsing fails

47234 12/05/2017 07:02 PM Alessia Bardi

Returning more detailed counters for mdstore feeding.
Fixed bug when trying to store too large XML: now all the page of XMLs is skipped, so we can go on with the other records (MongoBulkWritesManager)

47208 12/05/2017 12:37 AM Alessia Bardi

Typo in log

47207 12/05/2017 12:01 AM Alessia Bardi

Throw detailed esception

46935 21/04/2017 03:14 PM Sandro La Bruzzo

fixed bug

46934 21/04/2017 03:06 PM Sandro La Bruzzo

Changed deliverObjects of mongo gridfs

46866 18/04/2017 05:19 PM Alessia Bardi

Also handle -1 date

46852 18/04/2017 10:50 AM Claudio Atzori

implemented use of from/until for incremental record delivery

46851 18/04/2017 10:43 AM Claudio Atzori

implemented use of from/until for incremental record delivery

46850 18/04/2017 10:38 AM Claudio Atzori

implemented use of from/until for incremental record delivery

46825 13/04/2017 12:42 PM Alessia Bardi

Cannot have two web methods with the same name and different args

46824 13/04/2017 12:30 PM Alessia Bardi

empty passphrase

46821 13/04/2017 12:28 PM Alessia Bardi

New method to disable cursor timeout when reading from mdstore

46803 12/04/2017 04:20 PM Sandro La Bruzzo

added method to ObjectStore

46799 12/04/2017 03:27 PM Alessia Bardi

forgot an import

46796 12/04/2017 03:15 PM Alessia Bardi

limit number of files to be downloaded from ariadne (test is ignored anyway)

46795 12/04/2017 03:14 PM Alessia Bardi

clean up test log configuration

46780 11/04/2017 05:19 PM Sandro La Bruzzo

Added no timeout option to gridfsResultSet

46766 10/04/2017 04:46 PM Alessia Bardi

Use ThreadSafeIterator

46765 10/04/2017 04:40 PM Alessia Bardi

Need synchronized next() method to avoid issues when collecting while getting the wf status/history

46764 10/04/2017 03:56 PM Alessia Bardi

Not disconnect from sftp in the hasNext

46761 10/04/2017 02:46 PM Alessia Bardi

less retries and corrected path in the queue for incremental mode

46752 10/04/2017 10:56 AM Alessia Bardi

Fixed file path

46750 10/04/2017 10:52 AM Alessia Bardi

fixed log4j

46749 10/04/2017 10:16 AM Alessia Bardi

Ignore remote test

46747 10/04/2017 10:15 AM Alessia Bardi

Need to create the session using the username parameter :-)

46743 10/04/2017 10:05 AM Alessia Bardi

Added username parameter to the SFTP plugin with public key auth

46693 05/04/2017 10:08 AM Alessia Bardi

deploy.info for SaxonHE branches

46691 04/04/2017 05:42 PM Alessia Bardi

changed dependency so that it is clear those are modules using SAXON HE

46655 04/04/2017 03:22 PM Sandro La Bruzzo

fixed deploy.info

46646 04/04/2017 03:06 PM Sandro La Bruzzo

added deploy.info

46321 16/03/2017 02:52 PM Alessia Bardi

fixed test property

46320 16/03/2017 02:52 PM Alessia Bardi

Test for SFTP with public key. Marked with @Ignore because it relies on an external SFTP server

46319 16/03/2017 02:50 PM Alessia Bardi

Logging parameters when connecting to SFTP with Public key authentication

46300 15/03/2017 05:52 PM Alessia Bardi

sftpPubKeyAuthentication API protocol for SFTP with pubKey authentication

46299 15/03/2017 05:46 PM Alessia Bardi

Setting Saxon Transformerfactory also in the property file

46233 13/03/2017 11:51 AM Sandro La Bruzzo

changed a way to create DLIObject to avoid java heap space

46206 09/03/2017 10:40 AM Claudio Atzori

fixing memory leak, records should not loaded in memory

46152 06/03/2017 03:42 PM Alessia Bardi

transformator function

46151 06/03/2017 03:41 PM Alessia Bardi

Branch for migration to Saxon HE

46150 06/03/2017 03:41 PM Alessia Bardi

branches folder

46118 03/03/2017 12:15 PM Alessia Bardi

using escapeXml10 instead of deprecated escapeXml