Added a first implementation of data flow monitoring
wf update to support the exclusion of persons and duplicate records during the OAI feed. Ported from 2.2.1 branch
Merged changes from 2.x branch regarding the stats report visualization in UI.
Updated profile creation dates.
MERGE dnet-openaireplus-workflows statsManager branch [33559]:[33654] into trunk
Added 2 new meta-wf to request the backup and restore actions to the StatsManagerService. Waiting for #914 to understand where exactly in the existing workflows the backup node can be put.
Updated workflow name
stats conf moved in the resp. HadoopJobConfiguration profile.
we need a start node.
Workflows for stats validation and cache refresh added to the stats metaworkflow
updated wf definition
added created index node
indexing wf uses the new index service specs
stats update moved to dedicated wf
Added node to set the new current OAI db
Fixed parameters
labels
SetFormatInfoJobNode takes three optional parameters that specify the name of the env properties where format, layout, and intepretation will be put.This is useful to the dm.provision wf, where the OAI nodes need the triple "oaf-index-openaire" instead of "DMF|TMF-index-openaire".
Updated workflows for OAI feed/post feed.
early definition of overall provision workflow
Context profiles will be fetched by the oozie process, so we pass the isLookupEndpoint as wf param
Updated OAI wf: before the feed we have to drop the store because we can't perform upserts in the M/R job: too expensive.
updated stats workflow
aligned stats wf definition with param specification
updated stats update workflow
factored out job nodes to set the context profile list, and the entity link table. defined stats update workflow
added param names to wf definition
allow to override the xquery to discovery the search service at runtime.
Added post feed workflow to perform operations such as creating indices, counting sets, after the OAI store has been fed.
New blackboard action to create an oai store. This is needed by the wf for OAI feeding.
nicer workflow family and name
idScheme and idNamespace defined as part of the OAI configuration profile
Need to pass idscheme and namespace parameter to the job.
submittable M/R OAI feeding job
simplified index switch wf
manual start
added wf to perform only index switch (BB msg to the search service)
renamed meta wf definition file
user parameter for the hdfs filepath to use as input of the OAI feed
generalized wf node
renamed wf file name
fixed wf definition
refactor
fixed wf syntax