added waitAll node
handled deleted records case
fixed condition to obtain accessInfoPackage,see ticket #677
Added condition to obtain accessInfoPackage only from oai apis
better logging
fixed param check
building correctly the outputQuorum parameter
added copytable workflow
fixed ids in project_funding table
fixed protocol import of re3data
include zenodo-like datasets to IIS export
fixed namespaceprefix assignment for re3data datasources
fixed id assignment
mode forced to REFRESH in dedicated node
fixed typo
fixed wf template
added refresh/incremental modes to dataset collection wf
added workflow to export datasets directly on HBASE (zenodo)
fixed project id assignment, again
fixed project id assignment
fixed funding id assignment: invalid values will be mapped as UNKNOWN
added workflow shortcut to avoid exporting all the md record on hdfs, allows to reuse the intermediate data stored during the previous run
dataInfo moved in about section
adding dataInfo to "about" section
delete aggregation extra_fields in REPO_BYE
added api param to SET_INFO nodes
links to external editors in wf details pages
using OpenaireMdBuilder also for incremental branch
saved also mdId as extraField
removed unused xslt
implemented a node to decapsule the claimed records
fixed generation of header fields
Removed dedup meta workflow that re-use workflows used in the dm metaworkflow. If different metaworkflows re-use the same wfs, those wfs are executed multiple times.
fixed tags
updated layout for the mdstore holding claimed records
added mdbuilder for openaire
fixed mapping for protocolclass
fix a string template attribute
add node UPDATE_INFO to collection/transformation wf templates
derp indentation
renamed wf
updated wf for dataset records
Removed metaworkflow to avoid undesired multiple execution of workflows triggered by the current implementation of msro based on issn notification.
added descriptions
updated wf definition
fail if wf definition doesn't set the required params
fixed wf params
dedicated action sets to avoid overlapping
fixed format name
webcrawl store is OAF
IMEF to ODF and webcrawl store is OAF .
fix invalid profile
reverted changes to working version
merged branch newIndexFeed to trunk
updated provision workflow
lookup for "solr" as backendId
added created index node
release connection
indexing wf uses the new index service specs
stats update moved to dedicated wf
added flags to enable/disable metadata extraction module
added action sets dedicated to each inference module
aligned parameters with job specs
updated IIS specific property
updated param name and values
fixed schema value
Fixed bug with datatasource to hbase wf
updated provision wf
reused wf definitions instead of dubling them in a dedicated load wf
use of the extrafield that overrides the api compliance for the creation of the hbase datasource records
added compound index on funder and oaftype for OAI
Fixed json parameters for OAI M/R job node
Added node to set the new current OAI db
Fixed parameters
labels
SetFormatInfoJobNode takes three optional parameters that specify the name of the env properties where format, layout, and intepretation will be put.This is useful to the dm.provision wf, where the OAI nodes need the triple "oaf-index-openaire" instead of "DMF|TMF-index-openaire".
Fixed target node
Updated workflows for OAI feed/post feed.
more logging
Jochen updates
early definition of overall provision workflow
removed indentation
Context profiles will be fetched by the oozie process, so we pass the isLookupEndpoint as wf param
updated datacite workflows
Updated OAI wf: before the feed we have to drop the store because we can't perform upserts in the M/R job: too expensive.
updated stats workflow
allow to use transformation rules in claimed records transformations
fixed a condition in original param of apicollections
Add an alter table condition
re-added a deleted statement
aligned stats wf definition with param specification
updated stats update workflow
factored out job nodes to set the context profile list, and the entity link table. defined stats update workflow
added param names to wf definition
allow to override the xquery to discovery the search service at runtime.
Update query to submit datasources with a calculated compliance
reverted openaire_basic term to driver
Added post feed workflow to perform operations such as creating indices, counting sets, after the OAI store has been fed.