D-Net

mapping url downloaded from remote url set in workflow parameters

branch for solr772

x3ml-engine 1.9.1 does not help, so let's go back to 1.9.3

trying with x3ml-engine v1.9.1

using x3ml-engine version 1.9.3

Default source should be the api, otherwise the delete of an api of one ds will trigger the deletion of all records for the data source in the OAI-PMH

Sticking to release version 3.9.0: using synchronised is not helpful, maybe the 1.9.0 release helps

trying to use x3ml-engine inside a synchronised method as suggested in https://support.d4science.org/issues/12919#change-77131

Log input file that cannot be transformed

Updated default mail template with start and end dates in human readable version

Human readable start and end date

BBActorCallback now can pass parameters back to the workflow for logging purposes.

fixed compilation error

merged r52660: email dispatching for wf template based on parent workflow notification configuration

Have the x3ml engine generate real UUIDs instead of test values.

cleanup

MERGE: branch updated with trunk changes through r50565

Job nodes related to Parthenos now extends AsyncJobNode

removed ennoying log

logs

Do not log the content of mapping files

New parameter to decide to pass the full record or only the metadata content to x3m

Using RDF_XML_PLAIN serialization.

Add dri:datasourceapi in the header

Fixed logs

Logging

Returning more detailed counters for mdstore feeding.
Fixed bug when trying to store too large XML: now all the page of XMLs is skipped, so we can go on with the other records (MongoBulkWritesManager)

Logging the extracted metadata for debugging

X3M Transformation node must be able to handle multiple 3M mappings

Handling workflow parameters of type 'list'

New type of workflow parameter that enables multiple selection of values from a list obtained via a function: "list"

Moved class in more proper package

Interpretation is not a solr-only property

Handle date range requests

New jobnode to get the last start date of a workflow of the same type of the current. The old job node is still needed to get the date as formatted string

Just one job node for refresh/incremental harvesting

UpdateIndex must consider also the interpretation, not only format and layout

Execution time monitored in debug mode on the jobNode, as the preparation for the mapping application does not impact on the total transformation time (from 0 to 3 ms, while transformation takes 100-200 ms)

logs for monitoring transofrmation execution time

Cleanup

calling the right deliver methods based on the noCursorTimeout param

Using new method to disable cursor timeout when reading from mdstore

checking how long it takes to transform

I do not want to see dri:repositoryIdentifier anymore

removed some DEBUG log

DEBUGGING THE TIMEOUT OF THE MONGO CURSOR: is there a metadata record that it is really slow to transform?

fixed xpath for the selection of the metadata body to validate

Need to validate only the content of oai:metadata

an instance of default job node for no-op

dateOfTransformation under the dri namespace

fixed call to current-datetime()

LayoutToRecordStylesheet xslt must be passed as property

MDBuilder passes to record template also the datasource name to fill dri:datasourcename

fixed typo on log

Node that validates XML record against their schema or a specific schema given its URL

Added dsName parameter

Created UnaryFunction for X3ML

Building correct D-Net XMLs after transformation with X3M

use the boolean to activate/disable the check

JobNode for X3m transformation and XSD verifier

Simplified param passing to this node

x3m node and test

cleanup

Now the OAI nodes are ProcessAware, so we can get the datasource name.

Removed logging

Deprecated unused field for FetchMDRecordsJobNode

Fixed parameters for OAI workflow

Removed node for deleted job node ReadMDstore

OAI job nodes adapted to the latest version on Dnet 40: less mess with parameters

added required parameter for OAI: oai_recordSource

fixed an ordering problem on logs

execution of Wf templates in not configured wfs

last execution date/status for wfTemplates

scheduled workflows

added common wf nodes

verifyIndexJobNode

RunMDStorePLuginJobNode

fixed bug

fixed bug a related to the first execution of a scheduled wf

added verifyMDStoreJobNode

Log which sys parameters are empty

removed useless mdformat param from FetchMdStore, and changed implementation of abastract OAI Node

Added workflows for entity registy

updated OAI job nodes

refactored out SimpleJobNode and AsyncJobNode common parts

the wf must fail in case of parameter type mismatch

the wf must fail in case of parameter type mismatch

cleanup

Added DatasourceManager Core with backend Postgres

added scope prototype to wfNodeRetrieveMdStoreId

fixed parameter passing when invoking wfTemplate

grahNodeParameters

java 8 refactoring

resolving env parameters on wf runtime

added management of env attribute

added method to remove a specific attribute from wf Env

simplified node

avoid to index 'system:error' as it might hold long text

fixed bug