Project

General

Profile

Statistics
| Revision:

# Date Author Comment
61386 14/07/2021 15:40 Claudio Atzori

default Hadoop cluster set to IIS, fixed typo

61348 08/07/2021 11:34 Claudio Atzori

default Hadoop cluster set to IIS

61029 20/05/2021 12:24 Alessia Bardi

Do not prepend PIC to the PIC number, as requested by the EC DG staff member

61018 18/05/2021 16:00 Alessia Bardi

No start nodes: they are executed one after the other

60996 12/05/2021 18:47 Alessia Bardi

Updated info workflow to also set the last update date of the sources of DOIBoost

60995 12/05/2021 18:30 Alessia Bardi

Workflows that import data by-passing the aggregation system

60988 12/05/2021 09:56 Claudio Atzori

using openaire datasource id instead of the repository profile identifier in the hadoop-based aggregation workflows

60979 07/05/2021 14:52 Miriam Baglioni

changed the collectedfrom as the id of the datasource for the funder. Added the insertion of the datasources in the database

60978 07/05/2021 14:51 Miriam Baglioni

changed the collectedfrom to the one of the datasource of the funder instead of openaire (to have the collectedfrom as the id of the openaire datasource made the projects to be associated to openaire)

60972 26/04/2021 15:57 Claudio Atzori

allow to set untilDateOverride in hadoop-specific collection workflows

60452 19/02/2021 12:43 Claudio Atzori

updated hadoop aggregation workflow reporting

60434 16/02/2021 11:19 Miriam Baglioni

we lost the information for one eventual level 2 in the funding stream with the data we get from the api

60433 16/02/2021 11:18 Miriam Baglioni

context for new funder chistera and changed name for old funders RCUK (now UKRI) and GSRT (now GSRI)

60432 16/02/2021 11:16 Miriam Baglioni

changed to consider funding stream to level two

60385 08/02/2021 17:17 Claudio Atzori

updated hadoop-specific aggregation workflows

60384 08/02/2021 17:06 Claudio Atzori

updated hadoop-specific aggregation workflows

60383 08/02/2021 14:35 Claudio Atzori

updated hadoop-specific aggregation workflows

60381 08/02/2021 13:54 Claudio Atzori

updated hadoop-specific aggregation workflows

60380 08/02/2021 13:40 Claudio Atzori

updated hadoop-specific collection workflow parameters: allow to configure the http client behaviour

60366 05/02/2021 09:00 Claudio Atzori

updated hadoop-specific aggregation workflows

60365 05/02/2021 08:57 Claudio Atzori

updated hadoop-specific aggregation workflows

60363 04/02/2021 17:19 Claudio Atzori

Hadoop-based collection workflow: capture oozie output params

60362 04/02/2021 17:11 Claudio Atzori

Hadoop-based aggregation workflow labels

60357 04/02/2021 14:18 Michele Artini

Removed MessageType from Message

60351 03/02/2021 15:54 Michele Artini

implematation of dhp messages with a MVC controller

60342 02/02/2021 14:25 Claudio Atzori

hadoop based transformation workflow

60330 01/02/2021 14:47 Claudio Atzori

updated hadoop-specific aggregation workflows

60327 01/02/2021 11:30 Claudio Atzori

updated hadoop-specific aggregation workflows

60321 29/01/2021 16:16 Claudio Atzori

updated hadoop-specific aggregation workflows

60318 29/01/2021 13:59 Claudio Atzori

updated hadoop-specific aggregation workflows

60316 29/01/2021 12:30 Claudio Atzori

updated hadoop-specific aggregation workflows

59801 09/11/2020 14:16 Miriam Baglioni

new context creation for UKRI

59676 23/10/2020 17:44 Alessia Bardi

Procedure for #6000

59460 23/09/2020 18:03 Alessia Bardi

#5976: remove from beta the funders already in production

59186 29/07/2020 11:52 Alessia Bardi

Instructions to address the path of multiple funding paths: see also #5695

59026 30/06/2020 12:34 Alessia Bardi

wfs assignable to entityregistry::products like Datacite

59020 29/06/2020 18:07 Alessia Bardi

#5695 : addressing the cleanup of projects with multiple funding paths

59019 29/06/2020 18:05 Alessia Bardi

Query updated to ignore funders that are not ready for production, but have been aggregated into production

59018 29/06/2020 17:52 Alessia Bardi

exclude projects from BETA funders in the view used by the IIS in production

59015 29/06/2020 16:55 Alessia Bardi

Missing ';' to properly end statements

59013 29/06/2020 16:37 Alessia Bardi

fixed table name

59012 29/06/2020 16:29 Alessia Bardi

SQL commands to copy projects from beta to prod

59005 29/06/2020 14:53 Miriam Baglioni

context for ANR projects

59000 26/06/2020 15:00 Alessia Bardi

No UNKNOWN funding streams for FP7

58973 22/06/2020 11:46 Alessia Bardi

Added node to change the last update date of the stats

58842 04/06/2020 17:03 Alessia Bardi

#5603: Yugoslavian orgs

58647 07/05/2020 19:00 Alessia Bardi

Workflow to set the proper date for UI/GUI consumption.

58490 14/04/2020 16:11 Alessia Bardi

Added OpenAIRE 4.0 compatibility

58350 27/03/2020 15:39 Claudio Atzori

updated standalone dedup wf, according to the new oozie wf specs

58349 27/03/2020 15:36 Claudio Atzori

updated standalone dedup wf, according to the new oozie wf specs

58329 25/03/2020 18:58 Claudio Atzori

WIP: defining data provision workflow to be run on the OCEAN cluster

58291 18/03/2020 09:16 Claudio Atzori

WIP: data provision workflow exploiting the oozie jobs on the OCEAN Hadoop cluster

58107 17/02/2020 18:12 Claudio Atzori

generic OAF compatible aggregation workflow, dedicated to the [Intersection] use case (set DataInfo.invisible = true)

58051 03/02/2020 12:20 Alessia Bardi

#5297: mappings for the European Environment Agency

57810 04/12/2019 15:24 Alessia Bardi

Fixing countries for organizations coming from NSF annd not only

57728 27/11/2019 18:17 Miriam Baglioni

workflow for propagation of results to communities through organization

57727 27/11/2019 18:16 Miriam Baglioni

workflow for orcid propagation

57678 25/11/2019 17:25 Alessia Bardi

Query to patch the missing countries for funders.

57652 20/11/2019 17:10 Alessia Bardi

#4962: patching db for summary and funded amount

57651 20/11/2019 17:09 Alessia Bardi

Including currency

57608 14/11/2019 14:44 Michele Artini

query to import OpenOrgs without acronyms

57584 11/11/2019 18:30 Alessia Bardi

#4650: need specific interpretation for claims

57579 11/11/2019 18:04 Alessia Bardi

Fixes #4650: claims to enter HBASE before repository record

57577 11/11/2019 15:59 Alessia Bardi

fixed trailing char

57576 11/11/2019 15:58 Alessia Bardi

removed old job nodes

57510 05/11/2019 12:19 Michele Artini

deduped orgs to OpenOrgs DB (jobs + wfs) using temporary hdfs files

57475 30/10/2019 12:14 Alessia Bardi

#4993: sql to manually add entry in hostedby map

57442 22/10/2019 14:54 Michele Artini

openorgs simrels in provision wf

57437 22/10/2019 12:05 Michele Artini

sql queries for open orgs similarities

57431 21/10/2019 16:40 Miriam Baglioni

update xquery for the community configuration used in the exporter. Added information in the community profile to include the organizations that support the community

57430 21/10/2019 16:37 Miriam Baglioni

workflow for the propagation of result to community through relevant organization. THe organization relevant for the community are given as an input parameter (community.map input) managed by the user in the workflow

57429 21/10/2019 16:36 Miriam Baglioni

Workflow for the propagation of result to communities through semantic relation

57413 18/10/2019 16:40 Claudio Atzori

introduced distcp workflow to synchronise data from DM to IIS cluster

57397 17/10/2019 11:14 Michele Artini

(openorgs) added schemeid to pids in sql query

57392 16/10/2019 14:20 Michele Artini

temporary test

57383 16/10/2019 11:42 Michele Artini

Import of OpenOrgs Organizations

57353 11/10/2019 17:38 Claudio Atzori

added summary, totalcost and fundedamount to the projects_mv materialized view

57333 10/10/2019 11:34 Sandro La Bruzzo

mereged transformation Job spark

57300 08/10/2019 10:21 Alessia Bardi

#4967: change for datasources

57299 08/10/2019 10:12 Sandro La Bruzzo

merged with branch dnet-hadoop

57272 04/10/2019 17:29 Alessia Bardi

#4852: sysimport:crosswalk is enough

57268 04/10/2019 14:32 Claudio Atzori

removed optional2 and optional2 from project_details table

57247 02/10/2019 18:08 Miriam Baglioni

changed the original name with the English name

57246 02/10/2019 17:59 Miriam Baglioni

fixed wrong number of chars in namespaceprefix

57245 02/10/2019 17:38 Miriam Baglioni

changed the context for considering the founding stream and the change in the name of the funder

57244 02/10/2019 17:36 Miriam Baglioni

Russian Science Foundation context

56999 09/09/2019 11:24 Alessia Bardi

fixes #4865: do not export OAI PMH URLs that are not used

56860 06/08/2019 15:06 Alessia Bardi

Cleaned up namespaces and handle objIdentifier linke in dnet50 mdbuilder.xslt.st

56859 06/08/2019 14:46 Alessia Bardi

Normalize space of metadata identifier path as it is done in "normal" mdBuilder

56773 25/07/2019 18:17 Alessia Bardi

Claims2hbase must always run before oaf and odf to hbase to avoid issues like #4650

56772 25/07/2019 18:16 Alessia Bardi

Updated to current version in production

56553 15/07/2019 16:14 Alessia Bardi

#4689: changed type for missionstatementurl on dsm_datasources

56479 10/07/2019 18:15 Miriam Baglioni

fixed name of node in bean

56416 08/07/2019 23:30 Miriam Baglioni

added bean for propagation of community result through semantic relation

56370 05/07/2019 10:50 Miriam Baglioni

commented in the applicationContext all the hadoop implementation specific classes

56366 04/07/2019 18:15 Miriam Baglioni

MERGE dnet-openaireplus-workflows dnet-hadoop 56022:56364 into trunk

56130 19/06/2019 19:20 Alessia Bardi

Validation step also for aggregator of data repository, as requested in #4297

56129 19/06/2019 19:16 Alessia Bardi

Added cris and guidelines 4 available for continous validation

56021 07/06/2019 10:25 Miriam Baglioni

Updates for Selection Criteria implementation

56002 05/06/2019 17:08 Enrico Ottonello

added workflow configuration and hadoop job for orcid publications without doi import