DOIBoost » History » Version 1
Alessia Bardi, 05/11/2021 03:55 PM
1 | 1 | Alessia Bardi | h1. DOIBoost |
---|---|---|---|
2 | |||
3 | h4. DOIBoost: Crossref, Unpaywall, Microsoft Academic Graph, ORCID |
||
4 | |||
5 | The idea behind DOIBoost and its origin can be found in the paper (and related resources) at: |
||
6 | |||
7 | * La Bruzzo S., Manghi P., Mannocci A. (2019) OpenAIRE's DOIBoost - Boosting CrossRef for Research. In: Manghi P., Candela L., Silvello G. (eds) Digital Libraries: Supporting Open Science. IRCDL 2019. Communications in Computer and Information Science, vol 988. Springer, doi:10.1007/978-3-030-11226-4_11 . Open Access version available at: https://doi.org/10.5281/zenodo.1441071 |
||
8 | |||
9 | In short, the goal is to enrich the records available on Crossref with what's available on Unpaywall, Microsoft Academic Graph, ORCID intersecting all those datasets by DOI. |
||
10 | The generation of DOIBoost consists in the following phases: |
||
11 | |||
12 | 1 Filter Crossref records that: |
||
13 | * have blank title |
||
14 | * have one of the following publishers: "Test accounts", "CrossRef Test Account" |
||
15 | * have no authors with valid names, where valid means: not blank and different from all strings in this list: @List(",", "none none", "none, none", "none &na;", "(:null)", "test test test", "test test", "test", "&na; &na;")@ |
||
16 | * have "Addie Jackson" as author and "Elsevier BV" as publisher (empirically we say they are test records) |
||
17 | |||
18 | 2 Intersect Crossref with Unpaywall by DOI (DOIBoost1). The records are enriched with |
||
19 | * TODO: AUTHORS? |
||
20 | * one @instance@ with |
||
21 | ** the @best_oa_location@ of Unpaywall |
||
22 | ** @color@ set as follows: @green@ if the host is a repository; @gold@ if the host is publisher and the journal is open access; @hybrid@ if the host is publisher, the journal is not open access but there is a license; @bronze@ if no license is available. |
||
23 | |||
24 | 3 Intersect DOIBoost1 with ORCID (DOIBoost2). The records are enriched with the ORCID identifiers of their authors |
||
25 | |||
26 | 4 Intersect DOIBoost2 with Microsoft Academic Graph (DOIBoost3). The records are enriched with: |
||
27 | * abstracts |
||
28 | * MAG identifiers of authors |
||
29 | * affiliation relationships |
||
30 | * subjects (MAG FieldsOfStudy) |
||
31 | * conference or journal information (in the @journal@ field) TODO: or @container@, in case of the dump? |
||
32 | * [TO BE REMOVED] instances with URL from MAG |
||
33 | |||
34 | 5 Enrich DOIBoost3 with hosting data sources (@hostedby@) and access right information. In this phase we intersect DOIBoost3 with a dataset composed of journals from OpenAIRE, Crossref, and the ISSN gold list. Each journal comes with its International Standard Serial Numbers (issn, eissn, lissn) and, when available, a flag that tells if the journal is open access. The intersection is done on the basis of the International Standard Serial Numbers. The records with a @journal.[l|e]issn@ that match are enriched as follows: |
||
35 | * Each instance gain the `hostedby` information. |
||
36 | * If the journal is open access, the access rights of the instances are also set to "Open Access" with "gold" route. |
||
37 | |||
38 | The hostedby of records that do not match are set to the "Unknown Repository". |