Project

General

Profile

Statistics
| Revision:

dnet50/modules/dnet-data-services/branches/saxonHE/src/main/java/eu/dnetlib/data/collector/plugins @ 52889

Name Size Revision Age Author Comment
  archive 49032 about 6 years Alessia Bardi Fixed loop
  filesfrommetadata 41850 over 7 years Sandro La Bruzzo Added modular collector service
  filesystem 51722 over 5 years Alessia Bardi Reverted filesystem plugin to the first impleme...
  ftp 41850 over 7 years Sandro La Bruzzo Added modular collector service
  httplist 46766 over 6 years Alessia Bardi Use ThreadSafeIterator
  mongo 50679 over 5 years Alessia Bardi re-introduced the "noCursorTimeout" option that...
  oai 50563 over 5 years Alessia Bardi MERGE: branch updated with trunk changes throug...
  oaisets 46766 over 6 years Alessia Bardi Use ThreadSafeIterator
  sftp 52889 about 5 years Alessia Bardi SftpIterator can work incrementally with dates ...
AbstractSplittedRecordPlugin.java 1.19 KB 41850 over 7 years Sandro La Bruzzo Added modular collector service
ClasspathCollectorPlugin.java 572 Bytes 41850 over 7 years Sandro La Bruzzo Added modular collector service
FileCSVCollectorPlugin.java 3.5 KB 41850 over 7 years Sandro La Bruzzo Added modular collector service
FileCollectorPlugin.java 588 Bytes 41850 over 7 years Sandro La Bruzzo Added modular collector service
FileGZipCollectorPlugin.java 655 Bytes 41850 over 7 years Sandro La Bruzzo Added modular collector service
HttpCSVCollectorPlugin.java 3.3 KB 41850 over 7 years Sandro La Bruzzo Added modular collector service
HttpCollectorPlugin.java 1.16 KB 42936 over 7 years Claudio Atzori adapted to org.apache.httpcomponents:httpclient...
HttpSimpleCollectorPlugin.java 1.13 KB 48833 about 6 years Alessia Bardi New simple http collector plugin that doesn't c...

Latest revisions

# Date Author Comment
52889 03/08/2018 10:30 AM Alessia Bardi

SftpIterator can work incrementally with dates and datetimes
51722 08/04/2018 11:01 AM Alessia Bardi

Reverted filesystem plugin to the first implementation that does not use FileDirectoryStream: files were left open causing Too many open files errors
50679 12/02/2018 11:41 AM Alessia Bardi

re-introduced the "noCursorTimeout" option that was overridden by the merge from trunk
50563 02/02/2018 11:02 AM Alessia Bardi

MERGE: branch updated with trunk changes through r50560

49032 20/09/2017 07:14 PM Alessia Bardi

Fixed loop
49030 20/09/2017 06:48 PM Alessia Bardi

new parameter for targz plugin to collect only file with given extensions
48833 10/08/2017 04:53 PM Alessia Bardi

New simple http collector plugin that doesn't care about splitting the file it downloads.
48824 09/08/2017 04:01 PM Alessia Bardi

Fixed incremental harvesting via sftp due to an issue with Java8 DateTime. Wish the time management would be easier with Java8?
48234 03/07/2017 11:08 AM Alessia Bardi

typo in log
47208 12/05/2017 12:37 AM Alessia Bardi

Typo in log

View revisions

Also available in: Atom