Documentation

h1. DOIBoost

h4. DOIBoost: Crossref, Unpaywall, Microsoft Academic Graph, ORCID

The idea behind DOIBoost and its origin can be found in the paper (and related resources) at: 

* La Bruzzo S., Manghi P., Mannocci A. (2019) OpenAIRE's DOIBoost - Boosting CrossRef for Research. In: Manghi P., Candela L., Silvello G. (eds) Digital Libraries: Supporting Open Science. IRCDL 2019. Communications in Computer and Information Science, vol 988. Springer, doi:10.1007/978-3-030-11226-4_11 . Open Access version available at: https://doi.org/10.5281/zenodo.1441071

In short, the goal is to enrich the records available on Crossref with what's available on Unpaywall, Microsoft Academic Graph, ORCID intersecting all those datasets by DOI.

The generation of DOIBoost consists in the following phases:

1 Filter Crossref records that:

* have blank title

* have one of the following publishers: "Test accounts", "CrossRef Test Account"

* have no authors with valid names, where valid means: not blank and different from all strings in this list: @List(",", "none none", "none, none", "none &na;", "(:null)", "test test test", "test test", "test", "&na; &na;")@

* have "Addie Jackson" as author and "Elsevier BV" as publisher (empirically we say they are test records)

1.1 Map Crossref links to projects/funders

Links to funding available in Crossref are mapped as funding relationships (@result@ --> @project@) applying the following mapping:

| funder | funding project | notes |

| funder | funding project | notes |

| funder | funding project | notes |

| funder | funding project | notes |

| funder | funding project | notes |

* If the funder DOI is one of 10.13039/100010663, 10.13039/100010661, 10.13039/501100007601, 10.13039/501100000780, 10.13039/100010665, for each @award@ (identified as a series from 4 to 9 digits) a link to the corresponding *H2020 project* is created

* If the funder DOI is one of 10.13039/100011199, 10.13039/100004431, 10.13039/501100004963, 10.13039/501100000780 for each @award@ (identified as a series from 4 to 9 digits) a link to the corresponding *FP7 project* is created

* If the funder DOI is 10.13039/501100000781 for each @award@ (identified as a series from 4 to 9 digits) a link to the corresponding *FP7 or H2020 project* is created

* 10.13039/100000001

2 Intersect Crossref with Unpaywall by DOI (DOIBoost1). The records are enriched with 

* TODO: AUTHORS?

* one @instance@ with 

** the @best_oa_location@ of Unpaywall

** @color@ set as follows: @green@ if the host is a repository; @gold@ if the host is publisher and the journal is open access; @hybrid@ if the host is publisher, the journal is not open access but there is a license; @bronze@ if no license is available.

3 Intersect DOIBoost1 with ORCID (DOIBoost2). The records are enriched with the ORCID identifiers of their authors

4 Intersect DOIBoost2 with Microsoft Academic Graph (DOIBoost3). The records are enriched with:

* abstracts

* MAG identifiers of authors

* affiliation relationships

* subjects (MAG FieldsOfStudy)

* conference or journal information (in the @journal@ field) TODO: or @container@, in case of the dump?

* [TO BE REMOVED] instances with URL from MAG

5 Enrich DOIBoost3 with hosting data sources (@hostedby@) and access right information. In this phase we intersect DOIBoost3 with a dataset composed of journals from OpenAIRE, Crossref, and the ISSN gold list. Each journal comes with its International Standard Serial Numbers (issn, eissn, lissn) and, when available, a flag that tells if the journal is open access. The intersection is done on the basis of the International Standard Serial Numbers. The records with a @journal.[l|e]issn@ that match are enriched as follows:

* Each instance gain the `hostedby` information. 

* If the journal is open access, the access rights of the instances are also set to "Open Access" with "gold" route.

The hostedby of records that do not match are set to the "Unknown Repository".