Project

General

Profile

Statistics
| Revision:

# Date Author Comment
60109 09/12/2020 06:46 PM Alessia Bardi

For incremental harvesting: return the date with date granularity level.

59043 02/07/2020 07:15 PM Alessia Bardi

Test the logics of mdbuilder -- just in case

58106 17/02/2020 04:42 PM Sandro La Bruzzo

migration to spark

57896 16/12/2019 06:16 PM Alessia Bardi

Added snapshot repository from FORTH, just in case

57629 15/11/2019 10:55 AM Alessia Bardi

more testing for Ariadne and 3M mappings

57585 11/11/2019 06:37 PM Enrico Ottonello

removed unused test file

57486 31/10/2019 12:11 PM Enrico Ottonello

removed mapping from profiles section, mapping is taken only from url; x3m transformation node moved to dnet-ariadneplus module

57484 31/10/2019 12:06 PM Enrico Ottonello

aligned to aggregator instance

57483 31/10/2019 12:05 PM Enrico Ottonello

x3ml-engine version reset to 1.9.3

57471 29/10/2019 06:15 PM Alessia Bardi

testing usage of 1.9.2-SNAPSHOT for troubleshooting issue with ariadne mapping

57470 29/10/2019 06:11 PM Alessia Bardi

reverted to 57117

57469 29/10/2019 06:07 PM Alessia Bardi

using version 1.9.2-SNAPSHOT of x3ml to troublesheet issue in ariadne

57446 22/10/2019 03:53 PM Enrico Ottonello

align svn folder info

57440 22/10/2019 01:46 PM Enrico Ottonello

mapping url downloaded from remote url set in workflow parameters

57117 21/09/2019 12:52 PM Alessia Bardi

reverted for solr5

57116 21/09/2019 12:47 PM Alessia Bardi

fixed dependencies and deploy for solr772

57115 21/09/2019 12:37 PM Alessia Bardi

fixed dependencies and deply info for solr772

57114 21/09/2019 12:34 PM Alessia Bardi

branch for solr772

57066 13/09/2019 10:35 AM Alessia Bardi

x3ml-engine 1.9.1 does not help, so let's go back to 1.9.3

57063 13/09/2019 10:06 AM Alessia Bardi

trying with x3ml-engine v1.9.1

57062 13/09/2019 10:03 AM Alessia Bardi

trying with x3ml-engine v1.9.1

57041 12/09/2019 10:38 AM Alessia Bardi

using x3ml-engine version 1.9.3

57039 12/09/2019 10:21 AM Alessia Bardi

[maven-release-plugin] prepare for next development iteration

57038 12/09/2019 10:21 AM Alessia Bardi

[maven-release-plugin] copy for tag dnet-msro-service-6.0.1-SAXONHE

57037 12/09/2019 10:21 AM Alessia Bardi

[maven-release-plugin] prepare release dnet-msro-service-6.0.1-SAXONHE

55560 10/05/2019 05:31 PM Alessia Bardi

Updated URL for FORTH repository to avoid the "peer not authenticated" error when compiling

55516 07/05/2019 05:54 PM Alessia Bardi

Default source should be the api, otherwise the delete of an api of one ds will trigger the deletion of all records for the data source in the OAI-PMH

54023 28/11/2018 05:57 PM Alessia Bardi

Sticking to release version 3.9.0: using synchronised is not helpful, maybe the 1.9.0 release helps

54013 28/11/2018 04:07 PM Alessia Bardi

trying to use x3ml-engine inside a synchronised method as suggested in https://support.d4science.org/issues/12919#change-77131

53904 21/11/2018 10:42 AM Alessia Bardi

Log input file that cannot be transformed

53441 12/10/2018 11:52 AM Alessia Bardi

Parthenos mappings now require new x3ml-engine version and field <thesaurus_info/> is now mandatory.

52732 12/07/2018 10:52 AM Alessia Bardi

Updated default mail template with start and end dates in human readable version

52730 11/07/2018 07:09 PM Alessia Bardi

Human readable start and end date

52694 05/07/2018 06:19 PM Alessia Bardi

BBActorCallback now can pass parameters back to the workflow for logging purposes.

52682 05/07/2018 02:37 PM Sandro La Bruzzo

Added CrossRef plugin

52665 04/07/2018 09:48 AM Michele Artini

fixes a xquery

52663 03/07/2018 01:52 PM Alessia Bardi

fixed compilation error

52661 03/07/2018 12:20 PM Alessia Bardi

merged r52660: email dispatching for wf template based on parent workflow notification configuration

52660 03/07/2018 12:14 PM Michele Artini

Sending mails also to addresses in parentProfile

52459 12/06/2018 05:15 PM Alessia Bardi

fixed dependency to x3ml-engine

52069 17/05/2018 02:51 PM Alessia Bardi

Testing URI shortener

51371 21/03/2018 10:40 AM Alessia Bardi

x3ml-engine upgraded to spring4: removed exclusion and enlarged the dependency version range

51368 20/03/2018 05:22 PM Alessia Bardi

ensure we do not get 1.8.5-SNAPSHOT

51349 20/03/2018 02:53 PM Alessia Bardi

Opened range for x3ml-engine dependency: up to 1.9.0 excluded

50844 21/02/2018 04:03 PM Alessia Bardi

Have the x3ml engine generate real UUIDs instead of test values.

50832 20/02/2018 03:27 PM Sandro La Bruzzo

added log

50818 19/02/2018 03:10 PM Sandro La Bruzzo

implemented incremental transfrom and resolving

50678 12/02/2018 11:36 AM Alessia Bardi

cleanup

50566 02/02/2018 12:23 PM Alessia Bardi

MERGE: branch updated with trunk changes through r50565

50369 23/01/2018 07:03 PM Alessia Bardi

Trying to exclude slf4j deps from x3ml to see if it helps in properly logging.

50263 09/01/2018 05:31 PM Alessia Bardi

We can use x3ml version 1.8.2 but not later version (compilation problems due to some spring conflicts, apparently)

49797 03/11/2017 09:13 AM Alessia Bardi

Job nodes related to Parthenos now extends AsyncJobNode

49123 25/09/2017 06:20 PM Alessia Bardi

[maven-release-plugin] prepare for next development iteration

49122 25/09/2017 06:20 PM Alessia Bardi

[maven-release-plugin] copy for tag dnet-msro-service-6.0.0-SAXONHE

49121 25/09/2017 06:20 PM Alessia Bardi

[maven-release-plugin] prepare release dnet-msro-service-6.0.0-SAXONHE

49021 20/09/2017 12:38 PM Alessia Bardi

removed ennoying log

49018 20/09/2017 12:36 PM Alessia Bardi

logs

49012 20/09/2017 10:59 AM Alessia Bardi

Do not log the content of mapping files

48842 11/08/2017 04:04 PM Alessia Bardi

Tests moved from msro to dnet-parthenos, where they should have belonged in the first place

48830 10/08/2017 03:35 PM Alessia Bardi

New parameter to decide to pass the full record or only the metadata content to x3m

48782 28/07/2017 10:08 AM Sandro La Bruzzo

fix find Date range bug

48770 27/07/2017 11:05 AM Sandro La Bruzzo

removed until

48765 26/07/2017 06:18 PM Alessia Bardi

Using RDF_XML_PLAIN serialization.

48763 26/07/2017 04:47 PM Alessia Bardi

Updated mapping for culturaItalia and ignored its test until they fix the mapping.

48761 26/07/2017 04:24 PM Alessia Bardi

Add dri:datasourceapi in the header

48760 26/07/2017 02:20 PM Alessia Bardi

Updated Clarin 365 mapping for tests

48701 25/07/2017 10:21 AM Sandro La Bruzzo

Upgraded incremental harvesting and other stuff

48585 17/07/2017 06:10 PM Alessia Bardi

Updated tests and mappings

48562 13/07/2017 12:55 PM Alessia Bardi

Fixed logs

48306 04/07/2017 12:34 PM Alessia Bardi

More tests fro x3m

47583 19/06/2017 02:58 PM Alessia Bardi

Ignore CLARIn test that fails for duplicate namespace prefix

47487 13/06/2017 06:48 PM Alessia Bardi

Testing #8664#note-5 for EHRI and namespace

47486 13/06/2017 06:46 PM Alessia Bardi

More tests for EHRI and CulturaItalia

47251 15/05/2017 09:38 AM Alessia Bardi

Testing Parthenos 3M mappings

47240 13/05/2017 04:15 PM Alessia Bardi

Logging

47234 12/05/2017 07:02 PM Alessia Bardi

Returning more detailed counters for mdstore feeding.
Fixed bug when trying to store too large XML: now all the page of XMLs is skipped, so we can go on with the other records (MongoBulkWritesManager)

47233 12/05/2017 06:59 PM Alessia Bardi

Logging the extracted metadata for debugging

47232 12/05/2017 06:59 PM Alessia Bardi

Added tests with real mappings

47197 11/05/2017 08:33 PM Alessia Bardi

X3M Transformation node must be able to handle multiple 3M mappings

47196 11/05/2017 08:32 PM Alessia Bardi

Handling workflow parameters of type 'list'

47195 11/05/2017 06:12 PM Alessia Bardi

New type of workflow parameter that enables multiple selection of values from a list obtained via a function: "list"

46921 20/04/2017 05:47 PM Alessia Bardi

Now we can tune the X3ML engine logs: https://support.d4science.org/issues/8117

46877 19/04/2017 03:10 PM Sandro La Bruzzo

fixed bug

46871 19/04/2017 12:22 PM Sandro La Bruzzo
46865 18/04/2017 05:18 PM Alessia Bardi

Moved class in more proper package

46864 18/04/2017 04:47 PM Alessia Bardi

Interpretation is not a solr-only property

46858 18/04/2017 04:25 PM Alessia Bardi

Handle date range requests

46857 18/04/2017 04:24 PM Alessia Bardi

New jobnode to get the last start date of a workflow of the same type of the current. The old job node is still needed to get the date as formatted string

46856 18/04/2017 04:22 PM Alessia Bardi

Just one job node for refresh/incremental harvesting

46855 18/04/2017 04:21 PM Alessia Bardi

UpdateIndex must consider also the interpretation, not only format and layout

46842 14/04/2017 12:06 PM Alessia Bardi

Execution time monitored in debug mode on the jobNode, as the preparation for the mapping application does not impact on the total transformation time (from 0 to 3 ms, while transformation takes 100-200 ms)

46841 14/04/2017 11:14 AM Alessia Bardi

logs for monitoring transofrmation execution time

46839 14/04/2017 10:35 AM Alessia Bardi

Cleanup

46826 13/04/2017 12:45 PM Alessia Bardi

calling the right deliver methods based on the noCursorTimeout param

46822 13/04/2017 12:28 PM Alessia Bardi

Using new method to disable cursor timeout when reading from mdstore

46817 13/04/2017 11:19 AM Alessia Bardi

Test

46816 13/04/2017 11:19 AM Alessia Bardi

checking how long it takes to transform

46814 13/04/2017 10:05 AM Alessia Bardi

I do not want to see dri:repositoryIdentifier anymore

46804 12/04/2017 04:25 PM Alessia Bardi

removed some DEBUG log

46800 12/04/2017 04:15 PM Alessia Bardi

DEBUGGING THE TIMEOUT OF THE MONGO CURSOR: is there a metadata record that it is really slow to transform?