Project

General

Profile

« Previous | Next » 

Revision 60262

Updated documentation on OpenAIRE Research Graph dumps

View differences:

modules/dnet-api-http-doc/src/graph-dumps-old.html
1
<!DOCTYPE html>
2
<html lang="en-gb" dir="ltr" vocab="http://schema.org/">
3
   <head>
4
      <!--link href="http://demo.openaire.eu" rel="canonical" /-->
5
      <meta charset="utf-8">
6
      <meta http-equiv="X-UA-Compatible" content="IE=edge">
7
      <meta name="viewport" content="width=device-width, initial-scale=1">
8
      <meta http-equiv="content-type" content="text/html; charset=utf-8" />
9
      <meta name="description" content="OpenAIRE API documentation, OAI-PMH, open access, research, scientific publication, European Commission, EC, FP7, ERC, Horizon 2020, H2020, search, projects "/>
10
      <link href="./assets/favicon.ico" rel="shortcut icon" />
11
      <title>OpenAIRE API documentation - Dumps of the OpenAIRE Research Graph</title>
12
      <script  src="./assets/jquery.js"></script>
13
      <script  src="./assets/uikit.js"></script>
14
      <script src="./assets/uikit-icon-max.js"></script>
15
      <link rel="stylesheet" href="./assets/theme.css">
16
      <link rel="stylesheet" href="./assets/custom.css">
17
      <link rel="stylesheet" href="./assets/develop-custom.css">
18
   </head>
19
   <body class="" style="">
20
      <div class="uk-offcanvas-content uk-height-viewport">
21
        <div class="tm-header-mobile uk-hidden@m">
22
          <div animation="uk-animation-slide-top" class="uk-navbar-container uk-sticky  uk-navbar-transparent  " cls-active="uk-active uk-navbar-sticky" cls-inactive="uk-navbar-transparent  " uk-sticky="">
23
           <nav class="uk-navbar-container uk-navbar" uk-navbar="">
24
              <div class="uk-navbar-left">
25
                 <a class="uk-navbar-toggle" href="#tm-mobile" uk-toggle="">
26
                    <div uk-navbar-toggle-icon="" class="uk-navbar-toggle-icon uk-icon">
27

  
28
                    </div>
29
                 </a>
30
              </div>
31
              <div class="uk-navbar-center">
32
                 <a class="uk-navbar-item uk-logo" href="overview.html">
33
                 <img src="assets/OA DEVELOP_A.png" class="uk-responsive-height" alt="OpenAIRE">        </a>
34
              </div>
35
           </nav>
36
           <div id="tm-mobile" uk-offcanvas="" mode="slide" overlay="" class="uk-offcanvas">
37
              <div class="uk-offcanvas-bar">
38
                 <button class="uk-offcanvas-close uk-close uk-icon" type="button" uk-close="">
39
                 </button>
40
                 <div class="uk-child-width-1-1 uk-grid" uk-grid="">
41
                    <div>
42
                       <div class="uk-panel" id="module-0">
43
                          <ul class="uk-nav uk-nav-default">
44
                            <li class="uk-nav-header uk-parent" >
45
                              Dashboards
46
                              <ul class="uk-nav-sub">
47
                            		<li><a href="https://explore.openaire.eu" target="_blank" class="uk-heading-bullet explore-heading-bullet">EXPLORE</a></li>
48
                            		<li><a href="https://provide.openaire.eu" target="_blank" class="uk-heading-bullet provide-heading-bullet">PROVIDE</a></li>
49
                            		<li><a href="https://connect.openaire.eu" target="_blank" class="uk-heading-bullet connect-heading-bullet">CONNECT</a></li>
50
                            		<li><a href="https://monitor.openaire.eu" target="_blank" class="uk-heading-bullet monitor-heading-bullet">MONITOR</a></li>
51
                               </ul>
52
                            </li>
53
                             <li class="uk-nav-header uk-parent">
54
                                <a href="./overview.html"> Overview </a>
55

  
56
                             </li>
57
                             <li class="uk-nav-header uk-parent  uk-active">
58
                               Bulk access
59
                               <ul class="uk-nav-sub">
60
                                  <li><a routerLinkActive="uk-link" href="./graph-dumps.html" >OpenAIRE Research Graph Dumps</a></li>
61
                                  <li><a routerLinkActive="uk-link" href="./oai-pmh.html" >OAI-PMH (discontinued)</a></li>
62
                                  <li><a routerLinkActive="uk-link" href="./bulk-projects.html" >Bulk access to projects</a></li>
63
                               </ul>
64
                             </li>
65
                             <li class="uk-nav-header uk-parent">
66
                               <a href="./api.html">Selective access</a>
67
                               <ul class="uk-nav-sub">
68
                                 <li><a href="./api.html#pubs" >Publications</a></li>
69
                                 <li><a href="./api.html#datasets" >Research Data</a></li>
70
                                 <li><a href="./api.html#software" >Software</a></li>
71
                                 <li><a href="./api.html#other" >Other Research Products</a></li>
72
                                 <li><a href="./api.html#projects" >Projects</a></li>
73
                              </ul>
74
                             </li>
75
                          </ul>
76
                       </div>
77
                    </div>
78
                 </div>
79
              </div>
80
           </div>
81
        </div>
82
       </div>
83
        <!--Mobile ENDS here -->
84
        <div class="tm-toolbar custom-develop-toolbar uk-visible@m">
85
           <div class="uk-container uk-flex uk-flex-middle uk-container-expand ">
86
              <div class="uk-margin-auto-left">
87
                 <div class="uk-grid-medium uk-child-width-auto uk-flex-middle uk-grid uk-grid-stack" uk-grid="margin: uk-margin-small-top">
88
                    <div class="uk-first-column">
89
                       <div class="uk-panel inner" id="module-119">
90
                          <ul class="uk-subnav">
91
                            <li class="line"><a href="https://www.openaire.eu"><img class="uk-responsive-height" src="assets/Home_24white.svg" alt="home"/></a></li>
92
                            <li class="line"><a href="https://explore.openaire.eu" title="Search in OA. Link your research">Explore</a></li>
93
                            <li class="line"><a href="https://provide.openaire.eu" title="Content Provider Dashboard">Provide</a></li>
94
                            <li class="line"><a href="https://connect.openaire.eu" title="Research Community Dashboard">Connect</a></li>
95
                            <li class="line"><a href="https://monitor.openaire.eu" title="Monitoring Dashboard">Monitor</a></li>
96
                            <li class="line custom-develop-li "><a href="overview.html" title="APIs">Develop</a></li>
97
                          </ul>
98
                       </div>
99
                    </div>
100
                 </div>
101
              </div>
102
           </div>
103
        </div>
104
        <div class="tm-header uk-visible@m tm-header-transparent" uk-header="">
105
          <div animation="uk-animation-slide-top" class="uk-navbar-container uk-sticky uk-navbar-transparent" cls-active="uk-active uk-navbar-sticky" cls-inactive="uk-navbar-transparent"   top=".tm-header + [class*=&quot;uk-section&quot;]" uk-sticky="">
106
              <div class="uk-navbar-container uk-navbar-transparent">
107
                 <div class="uk-container uk-container-expand">
108
                    <nav class="uk-navbar" uk-navbar="{&quot;align&quot;:&quot;left&quot;}">
109
                       <div class="uk-navbar-left">
110
                          <a href="overview.html" class="uk-navbar-item uk-logo">
111
                          <img src="assets/OA DEVELOP_B.png" class="uk-responsive-height" alt="OpenAIRE"></a>
112
                       </div>
113
                       <div class="uk-navbar-right">
114
                          <ul class="uk-navbar-nav">
115
                             <li class="uk-parent">
116
                                <a href="overview.html" class="" aria-expanded="false">Overview</a>
117
                             </li>
118
                             <li class="uk-parent  uk-active">
119
                                <a href="#" class="" aria-expanded="false">Bulk access</a>
120
                                <div class="uk-navbar-dropdown uk-navbar-dropdown-bottom-left" style="left: 116px; top: 80px;">
121
                                   <div class="uk-navbar-dropdown-grid uk-child-width-1-1 uk-grid uk-grid-stack" uk-grid="">
122
                                      <div class="uk-first-column">
123
                                         <ul class="uk-nav uk-navbar-dropdown-nav">
124
                                            <li><a routerLinkActive="uk-link" href="./graph-dumps.html" >OpenAIRE Research Graph Dumps</a></li>
125
                                            <li><a routerLinkActive="uk-link" href="./oai-pmh.html" >OAI-PMH (discontinued)</a></li>
126
                                            <li><a routerLinkActive="uk-link" href="./bulk-projects.html" >Bulk access to projects</a></li>
127
                                         </ul>
128
                                      </div>
129
                                   </div>
130
                                </div>
131
                             </li>
132
                             <li class="uk-parent">
133
                                <a href="#" class="" aria-expanded="false">Selective access</a>
134
                                <div class="uk-navbar-dropdown uk-navbar-dropdown-bottom-left" style="left: 228px; top: 80px;">
135
                                   <div class="uk-navbar-dropdown-grid uk-child-width-1-1 uk-grid uk-grid-stack" uk-grid="">
136
                                      <div class="uk-first-column">
137
                                         <ul class="uk-nav uk-navbar-dropdown-nav">
138
                                           <li><a href="./api.html#pubs" >Publications</a></li>
139
                                           <li><a href="./api.html#datasets" >Research Data</a></li>
140
                                           <li><a href="./api.html#software" >Software</a></li>
141
                                           <li><a href="./api.html#other" >Other Research Products</a></li>
142
                                           <li><a href="./api.html#projects" >Projects</a></li>
143
                                         </ul>
144
                                      </div>
145
                                   </div>
146
                                </div>
147
                             </li>
148

  
149
                          </ul>
150
                       </div>
151

  
152
                    </nav>
153
                 </div>
154
              </div>
155
           </div>
156
         </div>
157

  
158
         <!-- MENU ENDS HERE-->
159
         <div class="first_page_section uk-section-default uk-section uk-padding-remove-vertical">
160
            <div class="first_page_banner_headline uk-grid-collapse uk-flex-middle uk-margin-remove-vertical uk-grid" uk-grid="">
161
            </div>
162
         </div>
163
         <div class=" uk-section  uk-margin-large-top tm-middle custom-main-content" id="tm-main">
164
            <div   class="uk-container">
165
               <div   uk-grid="" class="uk-grid uk-grid-stack">
166
                  <div   class="tm-main uk-width-1-1@s uk-width-1-1@m  uk-width-1-1@l uk-row-first uk-first-column">
167
                     <!-- Content GOES HERE-->
168
                     <div class="uk-alert-danger" uk-alert>
169
                        <h3>Contribute to improve the OpenAIRE Research Graph</h3>
170
                        <p>You can explore and test the beta release of the OpenAIRE Research Graph via the <a href="https://beta.explore.openaire.eu">OpenAIRE BETA Explore Portal</a> or via data dumps made available in <a href="https://zenodo.org/communities/openaire-research-graph">Zenodo</a>. </p>
171
                        <p>Help us making the graph ready for its 1st production release by providing your feedback.<br/>
172
                        Go to the <a href="https://trello.com/b/o1tEJ3rN/openaire-research-graph">OpenAIRE Research Graph Trello Board</a> to report content quality issues, including missing metadata records, wrong values, mistakes in the detection of duplicates and anything else that looks "weird" or wrong.
173
                        <p>Find the complete information about the OpenAIRE Research Graph, how to test it and contribute to improve it on <a href="https://www.openaire.eu/blogs/the-openaire-research-graph">our blog</a>.</p>
174
                     </div>
175
                     
176
                     <h2>OpenAIRE Research Graph Dumps</h2>
177
                     <p>The OpenAIRE Research Graph is one of the largest open scholarly record collections worldwide, key in fostering Open Science and establishing its practices in the daily research activities. 
178
                        Conceived as a public and transparent good, populated out of data sources trusted by scientists, the Graph aims at bringing discovery, monitoring, and assessment of science back in the hands of the scientific community. 
179
                     </p>
180
                     <p>Imagine a vast collection of research products all linked together, contextualised and openly available. 
181
                        For the past ten years OpenAIRE has been working to gather this valuable record. OpenAIRE is pleased to announce the beta release of its Research Graph, a massive collection of metadata and links between 
182
                        scientific products such as articles, datasets, software, and other research products, entities like organisations, funders, funding streams, projects, communities, and data sources.
183
                    </p>
184
                     <p>As of today, the OpenAIRE Research Graph aggregates around 450Mi metadata records with links collecting from 10,000 data sources trusted by scientists, including repositories registered in <a href="https://v2.sherpa.ac.uk/opendoar/">OpenDOAR</a>, Open Access journals registered in <a href="https://doaj.org/">DOAJ</a>, <a href="https://www.crossref.org/">Crossref</a>, <a href="https://unpaywall.org">Unpaywall</a>, <a href="https://orcid.org/">ORCID</a> and <a href="https://aka.ms/msracad">Microsoft Academic Graph</a>.
185
                        After cleaning, deduplication, and fine-grained classification processes, they narrow down to ~100Mi publications, ~8Mi datasets, ~200K software research products, 8Mi other products linked together with semantic relations. 
186
                        More than 10Mi full-texts of Open Access publications are mined by algorithms to enrich metadata records with additional properties and links among research products, funders, projects, communities, and organizations. 
187
                        Thanks to the mining algorithm, the graph is completed with 480Mi semantic relations.
188
                     </p>
189
                     <p>The OpenAIRE Research graph is available via our <a href="https://beta.explore.openaire.eu">BETA Explore Portal</a> and you can download it from <a href="https://zenodo.org/communities/openaire-research-graph">Zenodo</a>.
190
                     </p>
191
                     
192
                     <h3>Get the dumps</h3>
193
                    <div>
194
                       <p>The OpenAIRE Research Graph is exported as several dump files available on Zenodo (go to <a href="https://doi.org/10.5281/zenodo.3516917"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.3516917.svg" alt="DOI"></a>), so you can download the parts you are interested into. </p>
195
                      <ul>
196
                         <li> <strong>publications</strong>: metadata records about research literature (includes types of publications listed <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/publication">here</a>)</li>
197
                         <li> <strong>datasets:</strong>: metadata records about research data (includes the subtypes listed <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/dataset">here</a>)</li>
198
                         <li> <strong>software:</strong>: metadata records about research software (includes the subtypes listed <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/software">here</a>)</li>
199
                         <li> <strong>orps</strong>: metadata records about research products that cannot be classified as research literature, data or software (includes types of products listed <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/other">here</a>)</li>
200
                         <li> <strong>organizations</strong>: metadata records about organizations involved in the research life-cycle, such as universities, research organizations, funders.</li>
201
                         <li> <strong>content_providers</strong>: metadata records about providers whose content is available in the OpenAIRE Research Graph. They includes institutional and thematic repositories, journals, aggregators, funders' databases.</li>
202
                         <li> <strong>results_by_funder</strong>: metadata records about research results funded by a given funder. Each result includes information about its type (publications, datasets, software or other) and its specific sub-type (check the list of sub-types for <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/publication">publications</a>, <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/dataset">datasets</a>, <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/software">software</a>, and <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/other">other research products</a>).  </li>
203
                      </ul>
204
                       <p>The up-to-date list of funders available on OpenAIRE BETA can be find <a href="https://beta.explore.openaire.eu/search/entity-registries?datasourcetypename=%22Funder%20database%22">here on the BETA Explore portal</a>.</p>
205
                       <p> In the same <a href="https://zenodo.org/communities/openaire-research-graph">Zenodo community</a> you can also find the dumps of ScholeXplorer and DOIBoost.</p>
206
                    </div>
207
                     
208
                     <div>
209
                        <p>The dumps contain XML records compliant to the <b>OpenAIRE data model</b> and to the <b>oaf metadata format</b> (the same format of the records exported via <a href="./oai-pmh.html">OAI-PMH</a>):</p>
210
                       <ul>
211
                          <li><a href="" target="_blank">See the description of the OpenAIRE data model</a></li>
212
                          <li><a href="https://www.openaire.eu/schema/latest/oaf.xsd" target="_blank">See the oaf XML schema</a></li>
213
                          <li><a href="https://www.openaire.eu/schema/latest/doc/oaf.html" target="_blank">See the oaf XML schema documentation (generated via Oxygen XML Editor)</a></li>
214
                       </ul>
215
                     <p>Keep reading for instructions on how to consume the dumps.</p>
216
                     </div>
217

  
218
                     <h3>Consume the dumps</h3>
219
                     <div>
220
                        Each dump is a gzipped json file with many lines. Each line is in the form of:
221
                        <code>{"_id":{"$oid":"59b82504895be144859a9804"},"body":{"$binary":"base64(zip(XML_record))","$type":"00"}}</code><br/>
222
                        where the <code>body</code> field contains the base64 econding of the compressed XML record. <br/>
223
                        In order to get the XMLs you have to:
224
                        <ol>
225
                           <li>Unzip the file</li>
226
                           <li>Get only the value of the <code>$binary</code> field</li>
227
                           <li>Read each line and base64 decode it</li>
228
                           <li>Unzip the decoded string</li>
229
                        </ol>
230
                        
231
                        For example, to print the XMLs on the standard output you can run this command on MacOS/Unix/Linux based systems:
232
                        <code>gunzip -c file.json.gz | jq '.body."$binary"' -r | while IFS= read -r line; do echo "$line" | base64 --decode | bsdtar -x -O ; done </code><br/>
233
                        where 
234
                        <ul>
235
                           <li><code>file.json.gz</code> is the name you gave to the downloaded file dump;</li>
236
                           <li><code>jq</code> is a command to parse json files. It is not installed by default, but you can easy find it on official repositories. <a href="https://stedolan.github.io/jq/download/">Click here for installation instructions</a>.
237
                           <li><code>base64</code> and <code>bsdtar</code> are two libraries that are typically pre-installed.</li>
238
                        </ul>
239
                       Note that you should decide what to do with it (keep parsing XML inline or store them somewhere).
240
                       We suggest to start with few records to test and decide what to do, by adding a <code>head</code> command after the <code>gunzip</code>, like:
241
                     <code>gunzip -c file.json.gz | head -n 10 | jq '.body."$binary"' -r | while IFS= read -r line; do echo "$line" | base64 --decode | bsdtar -x -O ; done</code>
242
                     </div>
243
                     
244
                     <h3>Cite us</h3>
245
                     <p>If you use the OpenAIRE Research Graph for research purposes, please cite it as:<br/>
246
                        <i>Manghi, Paolo, Atzori, Claudio, Bardi, Alessia, Shirrwagen, Jochen, Dimitropoulos, Harry, La Bruzzo, Sandro, … Summan, Friedrich. (2019). OpenAIRE Research Graph Dump [Data set]. Zenodo. http://doi.org/10.5281/zenodo.3516917</i><br/>
247
                        If you want to cite a specific version, please follow the suggestion on Zenodo. For the current version (1.0.0-beta), please use: </br>
248
                        <i>Manghi, Paolo, Atzori, Claudio, Bardi, Alessia, Shirrwagen, Jochen, Dimitropoulos, Harry, La Bruzzo, Sandro, … Summan, Friedrich. (2019). OpenAIRE Research Graph Dump (Version 1.0.0-beta) [Data set]. Zenodo. http://doi.org/10.5281/zenodo.3516918</i><br/>
249
                        The OpenAIRE Research graph includes data from <a href="https://aka.ms/msracad">Microsoft Academic Graph</a> (MAG): please acknowledge also MAG following <a href="https://docs.microsoft.com/en-us/academic-services/graph/resources-faq#license">this guideline</a>.
250
                     </p>
251
                     <h3>License</h3>
252
                     <p>The OpenAIRE Research Graph is released under CC-BY license.</p>
253
                     <p>OpenAIRE is working to produce dumps that only contains metadata records that can be re-distributed with the CC0 license: stay tuned!</p>
254
                  </div>
255
               </div>
256
            </div>
257
         </div>
258

  
259
         <!-- FOOTER STARTS HERE-->
260

  
261

  
262
        <div class="uk-section-primary uk-section uk-section-small uk-padding-remove-bottom">
263
     <div class="uk-container uk-container-expand">
264
        <div class="uk-container uk-container-expand uk-margin-small">
265
           <div class="uk-grid-collapse uk-grid" uk-grid="">
266
              <div id="footer#3" class="uk-width-expand@s uk-first-column">
267
                 <div class="uk-margin-small uk-margin-remove-top uk-text-left@s uk-text-center">
268
                    <img src="assets/Logo_Horizontal_white_small.png"   data-width="126" data-height="30" class="el-image" alt="OpenAIRE">
269
                 </div>
270
                 <!--div id="footer#5" class="uk-margin uk-text-left@s uk-text-center">
271
                    <img src="assets/commission.jpg"   sizes="(min-width: 50px) 50px" data-width="427" data-height="285" class="el-image" alt="European Commission">
272
                 </div-->
273
                 <div class="uk-margin"><img style="margin-right: 8px; float: left;" src="assets/commission.jpg" alt="flag black white low" width="50" height="33"><span style="font-size: 8pt; line-height: 0.7!important;">OpenAIRE-Advance receives funding from the European Union's Horizon 2020 Research and Innovation programme under Grant Agreement No. 777541.</span></div>
274
                 <div id="footer#6" class="newsletter uk-margin uk-margin-remove-bottom uk-text-left@s uk-text-center uk-panel">
275
                    <h5 class="el-title uk-margin uk-h5">
276
                       Newsletter
277
                    </h5>
278
                    <a target="_blank" href="https://www.openaire.eu/newsletter/view" class="el-link">
279
                       <span   class="el-image uk-icon">
280
                          <svg width="20" height="20" viewBox="0 0 20 20" xmlns="http://www.w3.org/2000/svg">
281
                             <circle cx="3.12" cy="16.8" r="1.85"></circle>
282
                             <path fill="none" stroke="#000" stroke-width="1.1" d="M1.5,8.2 C1.78,8.18 2.06,8.16 2.35,8.16 C7.57,8.16 11.81,12.37 11.81,17.57 C11.81,17.89 11.79,18.19 11.76,18.5"></path>
283
                             <path fill="none" stroke="#000" stroke-width="1.1" d="M1.5,2.52 C1.78,2.51 2.06,2.5 2.35,2.5 C10.72,2.5 17.5,9.24 17.5,17.57 C17.5,17.89 17.49,18.19 17.47,18.5"></path>
284
                          </svg>
285
                       </span>
286
                    </a>
287
                 </div>
288
                 <div id="footer#7" class="newsletter uk-margin-small uk-margin-remove-top uk-text-left@s uk-text-center uk-panel">
289

  
290
                    <div class="acymailing_module" id="acymailing_module_formAcymailing60611">
291
                       <div class="acymailing_mootoolsbutton" id="acymailing_toggle_formAcymailing60611">
292
                          <p><a class="acymailing_togglemodule" id="acymailing_togglemodule_formAcymailing60611" target="_blank" href="https://www.openaire.eu/past-newsletters/listing">Subscribe</a></p>
293

  
294
                       </div>
295
                    </div>
296
                 </div>
297
                 <div class="uk-margin-small uk-margin-remove-top uk-text-left@s uk-text-center">
298
                    <div class="uk-child-width-auto uk-grid-small uk-flex-left@s uk-flex-center uk-grid" uk-grid="">
299
                       <div class="uk-first-column">
300
                          <a  href="http://www.facebook.com/groups/openaire/" target="_blank" class="el-link uk-icon-button uk-icon">
301
                             <svg width="20" height="20" viewBox="0 0 20 20" xmlns="http://www.w3.org/2000/svg">
302
                                <path d="M11,10h2.6l0.4-3H11V5.3c0-0.9,0.2-1.5,1.5-1.5H14V1.1c-0.3,0-1-0.1-2.1-0.1C9.6,1,8,2.4,8,5v2H5.5v3H8v8h3V10z"></path>
303
                             </svg>
304
                          </a>
305
                       </div>
306
                       <div>
307
                          <a  href="http://www.twitter.com/OpenAIRE_eu" target="_blank" class="el-link uk-icon-button uk-icon">
308
                             <svg width="20" height="20" viewBox="0 0 20 20" xmlns="http://www.w3.org/2000/svg">
309
                                <path d="M19,4.74 C18.339,5.029 17.626,5.229 16.881,5.32 C17.644,4.86 18.227,4.139 18.503,3.28 C17.79,3.7 17.001,4.009 16.159,4.17 C15.485,3.45 14.526,3 13.464,3 C11.423,3 9.771,4.66 9.771,6.7 C9.771,6.99 9.804,7.269 9.868,7.539 C6.795,7.38 4.076,5.919 2.254,3.679 C1.936,4.219 1.754,4.86 1.754,5.539 C1.754,6.82 2.405,7.95 3.397,8.61 C2.79,8.589 2.22,8.429 1.723,8.149 L1.723,8.189 C1.723,9.978 2.997,11.478 4.686,11.82 C4.376,11.899 4.049,11.939 3.713,11.939 C3.475,11.939 3.245,11.919 3.018,11.88 C3.49,13.349 4.852,14.419 6.469,14.449 C5.205,15.429 3.612,16.019 1.882,16.019 C1.583,16.019 1.29,16.009 1,15.969 C2.635,17.019 4.576,17.629 6.662,17.629 C13.454,17.629 17.17,12 17.17,7.129 C17.17,6.969 17.166,6.809 17.157,6.649 C17.879,6.129 18.504,5.478 19,4.74"></path>
310
                             </svg>
311
                          </a>
312
                       </div>
313
                       <div>
314
                          <a  href="http://www.linkedin.com/groups/OpenAIRE-3893548" target="_blank" class="el-link uk-icon-button uk-icon">
315
                             <svg width="20" height="20" viewBox="0 0 20 20" xmlns="http://www.w3.org/2000/svg">
316
                                <path d="M5.77,17.89 L5.77,7.17 L2.21,7.17 L2.21,17.89 L5.77,17.89 L5.77,17.89 Z M3.99,5.71 C5.23,5.71 6.01,4.89 6.01,3.86 C5.99,2.8 5.24,2 4.02,2 C2.8,2 2,2.8 2,3.85 C2,4.88 2.77,5.7 3.97,5.7 L3.99,5.7 L3.99,5.71 L3.99,5.71 Z"></path>
317
                                <path d="M7.75,17.89 L11.31,17.89 L11.31,11.9 C11.31,11.58 11.33,11.26 11.43,11.03 C11.69,10.39 12.27,9.73 13.26,9.73 C14.55,9.73 15.06,10.71 15.06,12.15 L15.06,17.89 L18.62,17.89 L18.62,11.74 C18.62,8.45 16.86,6.92 14.52,6.92 C12.6,6.92 11.75,7.99 11.28,8.73 L11.3,8.73 L11.3,7.17 L7.75,7.17 C7.79,8.17 7.75,17.89 7.75,17.89 L7.75,17.89 L7.75,17.89 Z"></path>
318
                             </svg>
319
                          </a>
320
                       </div>
321
                       <div>
322
                          <a  href="http://www.slideshare.net/OpenAIRE_eu" target="_blank" class="el-link uk-icon-button uk-icon">
323
                             <svg width="20" height="20" viewBox="0 0 20 20" xmlns="http://www.w3.org/2000/svg">
324
                                <line fill="none" stroke="#000" stroke-width="1.1" x1="13.4" y1="14" x2="6.3" y2="10.7"></line>
325
                                <line fill="none" stroke="#000" stroke-width="1.1" x1="13.5" y1="5.5" x2="6.5" y2="8.8"></line>
326
                                <circle fill="none" stroke="#000" stroke-width="1.1" cx="15.5" cy="4.6" r="2.3"></circle>
327
                                <circle fill="none" stroke="#000" stroke-width="1.1" cx="15.5" cy="14.8" r="2.3"></circle>
328
                                <circle fill="none" stroke="#000" stroke-width="1.1" cx="4.5" cy="9.8" r="2.3"></circle>
329
                             </svg>
330
                          </a>
331
                       </div>
332
                       <div>
333
                          <a href="https://www.youtube.com/channel/UChFYqizc-S6asNjQSoWuwjw" target="_blank" class="el-link uk-icon-button uk-icon">
334
                             <svg width="20" height="20" viewBox="0 0 20 20" xmlns="http://www.w3.org/2000/svg">
335
                                <path d="M15,4.1c1,0.1,2.3,0,3,0.8c0.8,0.8,0.9,2.1,0.9,3.1C19,9.2,19,10.9,19,12c-0.1,1.1,0,2.4-0.5,3.4c-0.5,1.1-1.4,1.5-2.5,1.6 c-1.2,0.1-8.6,0.1-11,0c-1.1-0.1-2.4-0.1-3.2-1c-0.7-0.8-0.7-2-0.8-3C1,11.8,1,10.1,1,8.9c0-1.1,0-2.4,0.5-3.4C2,4.5,3,4.3,4.1,4.2 C5.3,4.1,12.6,4,15,4.1z M8,7.5v6l5.5-3L8,7.5z"></path>
336
                             </svg>
337
                          </a>
338
                       </div>
339
                    </div>
340
                 </div>
341
              </div>
342
              <div id="footer#9" class="uk-width-expand@s">
343
                 <div id="footer#10" class="uk-width-medium uk-text-left@s uk-text-center uk-panel">
344
                    <h3 class="el-title uk-h6">Dashboards</h3>
345
                    <ul class="uk-nav uk-nav-default uk-nav-parent-icon uk-nav-accordion" uk-nav="">
346
                       <li><a href="https://explore.openaire.eu" target="_blank">Explore</a></li>
347
                       <li><a href="https://provide.openaire.eu" target="_blank">Provide</a></li>
348
                       <li><a href="https://connect.openaire.eu/" target="_blank">Connect</a></li>
349
                       <li><a href="https://monitor.openaire.eu" target="_blank">Monitor</a></li>
350
                       <li><a href="https://develop.openaire.eu" target="_blank">Develop</a></li>
351
                    </ul>
352
                 </div>
353
              </div>
354
              <div id="footer#11" class="uk-width-expand@s">
355
                 <div id="footer#12" class="uk-width-medium uk-text-left@s uk-text-center uk-panel">
356
                    <h3 class="el-title uk-h6">Support</h3>
357
                    <ul class="uk-nav uk-nav-default uk-nav-parent-icon uk-nav-accordion" uk-nav="">
358
                      <li><a href="https://www.openaire.eu/contact-noads">NOADs</a></li>
359
                       <li><a target="_blank" href="https://www.openaire.eu/guides">Guides</a></li>
360
                       <li><a target="_blank" href="https://www.openaire.eu/faqs">FAQs</a></li>
361
                       <li><a target="_blank" href="https://www.openaire.eu/frontpage/webinars">Webinars</a></li>
362
                       <li><a target="_blank" href="https://www.openaire.eu/support/helpdesk">Ask a question</a></li>
363
                    </ul>
364
                 </div>
365
              </div>
366
              <div id="footer#13" class="uk-width-expand@s">
367
                 <div id="footer#14" class="uk-width-medium uk-text-left@s uk-text-center uk-panel">
368
                    <h3 class="el-title uk-h6">Updates</h3>
369
                    <ul class="uk-nav uk-nav-default uk-nav-parent-icon uk-nav-accordion" uk-nav="">
370
                       <li><a target="_blank" href="https://www.openaire.eu/news/">News</a></li>
371
                       <li><a target="_blank" href="https://www.openaire.eu/events">Events</a></li>
372
                       <li><a target="_blank" href="https://www.openaire.eu/blogs/magazine">Blogs</a></li>
373
                       <li><a href="https://www.openaire.eu/newsletter/listing">Newsletters</a></li>
374
                       <li><a target="_blank" href="https://www.openaire.eu/documents">Documents</a></li>
375
                    </ul>
376
                 </div>
377
              </div>
378
           </div>
379
        </div>
380
     </div>
381
  </div>
382
  <div class="uk-section-primary uk-section uk-section-xsmall">
383
   <div class="uk-container">
384
      <div class="uk-grid-margin uk-grid uk-grid-stack" uk-grid="">
385
         <div class="uk-width-expand@m">
386
         </div>
387
      </div>
388
   </div>
389
</div>
390
<div class="uk-section-primary uk-section uk-section-xsmall">
391
   <div class="uk-container uk-container-expand">
392
      <div class="uk-grid-margin uk-grid" uk-grid="">
393
         <div class="uk-width-small@m uk-first-column">
394
         </div>
395
         <div class="uk-width-expand@m">
396
            <div id="footer#22" class=" uk-text-small uk-margin uk-margin-remove-bottom uk-text-center@m uk-text-center uk-text-lead">
397
               <a href="http://creativecommons.org/licenses/by/4.0/" rel="license">
398
                  <img src="/images/Icons/cc.svg" uk-svg="" hidden="true">
399
                  <svg viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg" width="24" height="24" class=" uk-svg">
400
                     <title></title>
401
                     <g data-name="Creative Commons" id="Creative_Commons">
402
                        <circle cx="12" cy="12" r="11.5" style="fill:none;stroke:#ffffff;stroke-linecap:round;stroke-linejoin:round"></circle>
403
                        <path d="M10.87,10a3.5,3.5,0,1,0,0,4" style="fill:none;stroke:#ffffff;stroke-linecap:round;stroke-linejoin:round"></path>
404
                        <path d="M18.87,10a3.5,3.5,0,1,0,0,4" style="fill:none;stroke:#ffffff;stroke-linecap:round;stroke-linejoin:round"></path>
405
                     </g>
406
                  </svg>
407
                  &nbsp;<img src="/images/Icons/cc-by.svg" uk-svg="" hidden="true">
408
                  <svg viewBox="0 0 24 24" xmlns="http://www.w3.org/2000/svg" width="24" height="24" class=" uk-svg">
409
                     <title></title>
410
                     <g id="Attribution">
411
                        <g data-name="<Group>" id="_Group_">
412
                           <circle cx="12" cy="5" data-name="<Path>" id="_Path_" r="1.5" style="fill:none;stroke:#ffffff;stroke-linecap:round;stroke-linejoin:round"></circle>
413
                           <path d="M12,8a5,5,0,0,0-3.07.71,1,1,0,0,0-.43.83V15H10v5.5h4V15h1.5V9.54a1,1,0,0,0-.43-.83A5,5,0,0,0,12,8Z" data-name="<Path>" id="_Path_2" style="fill:none;stroke:#ffffff;stroke-linecap:round;stroke-linejoin:round"></path>
414
                        </g>
415
                        <circle cx="12" cy="12" r="11.5" style="fill:none;stroke:#ffffff;stroke-linecap:round;stroke-linejoin:round"></circle>
416
                     </g>
417
                  </svg>
418
               </a>
419
               &nbsp;Unless otherwise indicated, all materials created by OpenAIRE are licenced under&nbsp;<a href="http://creativecommons.org/licenses/by/4.0/" rel="license">CC ATTRIBUTION 4.0 INTERNATIONAL LICENSE</a>.
420
            </div>
421
         </div>
422
         <div class="uk-width-small@m">
423
            <div class="uk-margin uk-margin-remove-top uk-margin-remove-bottom uk-text-right@m uk-text-center">
424
               <a href="#" uk-totop="" uk-scroll="" class="uk-totop uk-icon">
425

  
426
               </a>
427
            </div>
428
         </div>
429
      </div>
430
   </div>
431
</div>
432
 <!-- FOOTER ENDS HERE-->
433

  
434

  
435
      </div>
436
   </body>
437
</html>
0 438

  
modules/dnet-api-http-doc/src/bulk-projects.html
166 166
            <div   class="uk-container">
167 167
               <div   uk-grid="" class="uk-grid uk-grid-stack">
168 168
                  <div   class="tm-main uk-width-1-1@s uk-width-1-1@m  uk-width-1-1@l uk-row-first uk-first-column">
169
                    <!-- <div class="uk-alert-danger uk-text-center" uk-alert>
170
                        <p>
171
                          OpenAIRE is about to release its new face with lots of news and  services. <br>
172
                          During September, you may notice downtime in services, while some functionalities (e.g. user registration, validation, claiming) will be temporarily disabled.
173
                          We apologize for the inconvenience, please stay tuned! <br>
174
                          For further information please contact <a href="mailto:helpdesk@openaire.eu">helpdesk@openaire.eu</a>.
175
                        </p>
176
                    </div> -->
177
                     <div class="uk-alert-danger" uk-alert>
178
                        <h3>Contribute to improve the OpenAIRE Research Graph</h3>
179
                        <p>You can explore and test the beta release of the OpenAIRE Research Graph via the <a href="https://beta.explore.openaire.eu">OpenAIRE BETA Explore Portal</a> or via data dumps made available in <a href="https://zenodo.org/communities/openaire-research-graph">Zenodo</a>. </p>
180
                        <p>Help us making the graph ready for its 1st production release by providing your feedback.<br/>
181
                           Go to the <a href="https://trello.com/b/o1tEJ3rN/openaire-research-graph">OpenAIRE Research Graph Trello Board</a> to report content quality issues, including missing metadata records, wrong values, mistakes in the detection of duplicates and anything else that looks "weird" or wrong.
182
                        <p>Find the complete information about the OpenAIRE Research Graph, how to test it and contribute to improve it on <a href="https://www.openaire.eu/blogs/the-openaire-research-graph">our blog</a>.</p>
183
                     </div>
184
              	     <div class="uk-alert-danger" uk-alert>
185
              	        <p>Openaire XML Schema changed on 2 October 2018. <a href="https://www.openaire.eu/openaire-xml-schema-change-announcement" target="_blank">Click here</a> for details</p>
186
                    </div>
187

  
188 169
		    <h2>Bulk access to projects</h2>
189 170
                    <p>
190 171
                      The APIs offer custom access to metadata about projects funded by a selection of international funders for the <strong>DSpace</strong> and <strong>EPrints</strong> platforms.
modules/dnet-api-http-doc/src/graph-dumps.html
165 165
               <div   uk-grid="" class="uk-grid uk-grid-stack">
166 166
                  <div   class="tm-main uk-width-1-1@s uk-width-1-1@m  uk-width-1-1@l uk-row-first uk-first-column">
167 167
                     <!-- Content GOES HERE-->
168
                     <div class="uk-alert-danger" uk-alert>
169
                        <h3>Contribute to improve the OpenAIRE Research Graph</h3>
170
                        <p>You can explore and test the beta release of the OpenAIRE Research Graph via the <a href="https://beta.explore.openaire.eu">OpenAIRE BETA Explore Portal</a> or via data dumps made available in <a href="https://zenodo.org/communities/openaire-research-graph">Zenodo</a>. </p>
171
                        <p>Help us making the graph ready for its 1st production release by providing your feedback.<br/>
172
                        Go to the <a href="https://trello.com/b/o1tEJ3rN/openaire-research-graph">OpenAIRE Research Graph Trello Board</a> to report content quality issues, including missing metadata records, wrong values, mistakes in the detection of duplicates and anything else that looks "weird" or wrong.
173
                        <p>Find the complete information about the OpenAIRE Research Graph, how to test it and contribute to improve it on <a href="https://www.openaire.eu/blogs/the-openaire-research-graph">our blog</a>.</p>
174
                     </div>
175
                     
176
                     <h2>OpenAIRE Research Graph Dumps</h2>
168
                     <h2>The OpenAIRE Research Graph</h2>
177 169
                     <p>The OpenAIRE Research Graph is one of the largest open scholarly record collections worldwide, key in fostering Open Science and establishing its practices in the daily research activities. 
178 170
                        Conceived as a public and transparent good, populated out of data sources trusted by scientists, the Graph aims at bringing discovery, monitoring, and assessment of science back in the hands of the scientific community. 
179 171
                     </p>
180 172
                     <p>Imagine a vast collection of research products all linked together, contextualised and openly available. 
181
                        For the past ten years OpenAIRE has been working to gather this valuable record. OpenAIRE is pleased to announce the beta release of its Research Graph, a massive collection of metadata and links between 
173
                        For the past ten years OpenAIRE has been working to gather this valuable record. It is a massive collection of metadata and links between 
182 174
                        scientific products such as articles, datasets, software, and other research products, entities like organisations, funders, funding streams, projects, communities, and data sources.
183 175
                    </p>
184 176
                     <p>As of today, the OpenAIRE Research Graph aggregates around 450Mi metadata records with links collecting from 10,000 data sources trusted by scientists, including repositories registered in <a href="https://v2.sherpa.ac.uk/opendoar/">OpenDOAR</a>, Open Access journals registered in <a href="https://doaj.org/">DOAJ</a>, <a href="https://www.crossref.org/">Crossref</a>, <a href="https://unpaywall.org">Unpaywall</a>, <a href="https://orcid.org/">ORCID</a> and <a href="https://aka.ms/msracad">Microsoft Academic Graph</a>.
......
186 178
                        More than 10Mi full-texts of Open Access publications are mined by algorithms to enrich metadata records with additional properties and links among research products, funders, projects, communities, and organizations. 
187 179
                        Thanks to the mining algorithm, the graph is completed with 480Mi semantic relations.
188 180
                     </p>
189
                     <p>The OpenAIRE Research graph is available via our <a href="https://beta.explore.openaire.eu">BETA Explore Portal</a> and you can download it from <a href="https://zenodo.org/communities/openaire-research-graph">Zenodo</a>.
190
                     </p>
181
                     <p>Detailed information can be found on <a href="https://graph.openaire.eu">https://graph.openaire.eu</a></p>
182
             
191 183
                     
192 184
                     <h3>Get the dumps</h3>
193 185
                    <div>
194
                       <p>The OpenAIRE Research Graph is exported as several dump files available on Zenodo (go to <a href="https://doi.org/10.5281/zenodo.3516917"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.3516917.svg" alt="DOI"></a>), so you can download the parts you are interested into. </p>
195
                      <ul>
196
                         <li> <strong>publications</strong>: metadata records about research literature (includes types of publications listed <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/publication">here</a>)</li>
197
                         <li> <strong>datasets:</strong>: metadata records about research data (includes the subtypes listed <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/dataset">here</a>)</li>
198
                         <li> <strong>software:</strong>: metadata records about research software (includes the subtypes listed <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/software">here</a>)</li>
199
                         <li> <strong>orps</strong>: metadata records about research products that cannot be classified as research literature, data or software (includes types of products listed <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/other">here</a>)</li>
200
                         <li> <strong>organizations</strong>: metadata records about organizations involved in the research life-cycle, such as universities, research organizations, funders.</li>
201
                         <li> <strong>content_providers</strong>: metadata records about providers whose content is available in the OpenAIRE Research Graph. They includes institutional and thematic repositories, journals, aggregators, funders' databases.</li>
202
                         <li> <strong>results_by_funder</strong>: metadata records about research results funded by a given funder. Each result includes information about its type (publications, datasets, software or other) and its specific sub-type (check the list of sub-types for <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/publication">publications</a>, <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/dataset">datasets</a>, <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/software">software</a>, and <a href="http://api.openaire.eu/vocabularies/dnet:result_typologies/other">other research products</a>).  </li>
203
                      </ul>
204
                       <p>The up-to-date list of funders available on OpenAIRE BETA can be find <a href="https://beta.explore.openaire.eu/search/entity-registries?datasourcetypename=%22Funder%20database%22">here on the BETA Explore portal</a>.</p>
205
                       <p> In the same <a href="https://zenodo.org/communities/openaire-research-graph">Zenodo community</a> you can also find the dumps of ScholeXplorer and DOIBoost.</p>
186
                       <p>In order to facilitate users, different dumps are available. 
187
                          All are available under the <a href="https://zenodo.org/communities/openaire-research-graph">Zenodo community called OpenAIRE Research Graph</a>.
188
                          <ul>
189
                             <li>The <strong>whole OpenAIRE Research Graph Dump</strong><br/>
190
                                Dataset: <a href="https://doi.org/10.5281/zenodo.3516917"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.3516917.svg" alt="DOI"></a><br/>
191
                                Schema: <a href="https://doi.org/10.5281/zenodo.4238938"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.4238938.svg" alt="DOI"></a><br/>
192
                                This dataset is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</a>.<br/>
193
                                It is composed of several files so that you can download the parts you are interested into. 
194
                                Each file is a tar archive containing gz files, each with one json per line. 
195
                             </li>
196
                             <li>The <strong>OpenAIRE COVID-19 dump</strong> <br/>
197
                                Dataset: <a href="https://doi.org/10.5281/zenodo.3980490"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.3980490.svg" alt="DOI"></a><br/>
198
                                Schema: <a href="https://doi.org/10.5281/zenodo.3974225"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.3974225.svg" alt="DOI"></a><br/>
199
                                This dataset is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</a>.<br/>
200
                                It contains metadata records of publications, research data, software and projects on the topic of Corona Virus and COVID-19.
201
                                This dump is part of the <a href="https://www.openaire.eu/openaire-activities-for-covid-19">activities of OpenAIRE to support the fight against COVID-19</a> together with the <a href="https://covid-19.openaire.eu">OpenAIRE COVID-19 Gateway</a>. 
202
                                The dump consists of a tar archive containing gzip files with one json per line. 
203
                             </li>
204
                             <li>
205
                                The <strong>dumps about research communities, initiatives and infrastructures</strong> <br/>
206
                                Dataset: <a href="https://doi.org/10.5281/zenodo.3974604"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.3974604.svg" alt="DOI"></a><br/>
207
                                Schema: <a href="https://doi.org/10.5281/zenodo.3974225"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.3974225.svg" alt="DOI"></a><br/>
208
                                This dataset is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</a>.<br/>
209
                                The dataset contains one file per community/initiative/infrastructure collaborating with OpenAIRE. Check out also their community gateways on <a href="https://connect.openaire.eu">CONNECT</a>.
210
                                Each file is a tar archive containing gzip files with one json per line. 
211
                             </li>
212
                             <li>The dump of <strong>ScholeXplorer</strong> <br/>
213
                                Dataset: <a href="https://doi.org/10.5281/zenodo.1200252"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.1200252.svg" alt="DOI"></a><br/>
214
                                Schema (Scholix version 3): <a href="https://doi.org/10.5281/zenodo.1120275"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.1120275.svg" alt="DOI"></a><br/>
215
                                This dataset is licensed under a <a rel="license" href="https://creativecommons.org/publicdomain/zero/1.0/">CC0 1.0 Universal (CC0 1.0) Public Domain Dedication</a>.<br/>
216
                                The dataset contains the GZ-compressed dump of the Scholix links exposed by the <a href="https://scholexplorer.openaire.eu">OpenAIRE ScholeXplorer service</a>. 
217
                             </li>
218
                             <li>The dump of <strong>DOIBoost</strong> <br/>
219
                                Dataset: <a href="https://doi.org/10.5281/zenodo.1438355"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.1438355.svg" alt="DOI"></a><br/>
220
                                Publication: <a href="https://doi.org/10.5281/zenodo.1441071"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.1441071.svg" alt="DOI"></a><br/>
221
                                Software: <a href="https://doi.org/10.5281/zenodo.1441057"><img src="https://zenodo.org/badge/DOI/10.5281/zenodo.1441057.svg" alt="DOI"></a><br/>
222
                                This dataset is licensed under a <a rel="license" href="http://creativecommons.org/licenses/by/4.0/">Creative Commons Attribution 4.0 International License</a>.<br/>
223
                                DOIBoost is a metadata collection that enriches CrossRef with inputs from Microsoft Academic Graph, ORCID, and Unpaywall. 
224
                             </li>
225
                          </ul>
206 226
                    </div>
227
                     <h3>Cite us</h3>
228
                     <p>If you use any of the dumps above for research purposes, please cite it following the reccomendation that you find on the Zenodo page.<br/>
229
                        The OpenAIRE Research Graph and DOIBoost include data from <a href="https://aka.ms/msracad">Microsoft Academic Graph</a> (MAG): please acknowledge also MAG following <a href="https://docs.microsoft.com/en-us/academic-services/graph/resources-faq#license">this guideline</a>.<br/>
230
                     </p>
207 231
                     
232
                   <h3>Still using the old XML dumps?</h3>
208 233
                     <div>
209
                        <p>The dumps contain XML records compliant to the <b>OpenAIRE data model</b> and to the <b>oaf metadata format</b> (the same format of the records exported via <a href="./oai-pmh.html">OAI-PMH</a>):</p>
210
                       <ul>
211
                          <li><a href="" target="_blank">See the description of the OpenAIRE data model</a></li>
212
                          <li><a href="https://www.openaire.eu/schema/latest/oaf.xsd" target="_blank">See the oaf XML schema</a></li>
213
                          <li><a href="https://www.openaire.eu/schema/latest/doc/oaf.html" target="_blank">See the oaf XML schema documentation (generated via Oxygen XML Editor)</a></li>
214
                       </ul>
215
                     <p>Keep reading for instructions on how to consume the dumps.</p>
234
                        Please migrate to the new json dumps. Meanwhile, you can still access the <a href="./graph-dumps-old.html">old documentation here</a>.
216 235
                     </div>
217 236

  
218
                     <h3>Consume the dumps</h3>
219
                     <div>
220
                        Each dump is a gzipped json file with many lines. Each line is in the form of:
221
                        <code>{"_id":{"$oid":"59b82504895be144859a9804"},"body":{"$binary":"base64(zip(XML_record))","$type":"00"}}</code><br/>
222
                        where the <code>body</code> field contains the base64 econding of the compressed XML record. <br/>
223
                        In order to get the XMLs you have to:
224
                        <ol>
225
                           <li>Unzip the file</li>
226
                           <li>Get only the value of the <code>$binary</code> field</li>
227
                           <li>Read each line and base64 decode it</li>
228
                           <li>Unzip the decoded string</li>
229
                        </ol>
230
                        
231
                        For example, to print the XMLs on the standard output you can run this command on MacOS/Unix/Linux based systems:
232
                        <code>gunzip -c file.json.gz | jq '.body."$binary"' -r | while IFS= read -r line; do echo "$line" | base64 --decode | bsdtar -x -O ; done </code><br/>
233
                        where 
234
                        <ul>
235
                           <li><code>file.json.gz</code> is the name you gave to the downloaded file dump;</li>
236
                           <li><code>jq</code> is a command to parse json files. It is not installed by default, but you can easy find it on official repositories. <a href="https://stedolan.github.io/jq/download/">Click here for installation instructions</a>.
237
                           <li><code>base64</code> and <code>bsdtar</code> are two libraries that are typically pre-installed.</li>
238
                        </ul>
239
                       Note that you should decide what to do with it (keep parsing XML inline or store them somewhere).
240
                       We suggest to start with few records to test and decide what to do, by adding a <code>head</code> command after the <code>gunzip</code>, like:
241
                     <code>gunzip -c file.json.gz | head -n 10 | jq '.body."$binary"' -r | while IFS= read -r line; do echo "$line" | base64 --decode | bsdtar -x -O ; done</code>
242
                     </div>
243
                     
244
                     <h3>Cite us</h3>
245
                     <p>If you use the OpenAIRE Research Graph for research purposes, please cite it as:<br/>
246
                        <i>Manghi, Paolo, Atzori, Claudio, Bardi, Alessia, Shirrwagen, Jochen, Dimitropoulos, Harry, La Bruzzo, Sandro, … Summan, Friedrich. (2019). OpenAIRE Research Graph Dump [Data set]. Zenodo. http://doi.org/10.5281/zenodo.3516917</i><br/>
247
                        If you want to cite a specific version, please follow the suggestion on Zenodo. For the current version (1.0.0-beta), please use: </br>
248
                        <i>Manghi, Paolo, Atzori, Claudio, Bardi, Alessia, Shirrwagen, Jochen, Dimitropoulos, Harry, La Bruzzo, Sandro, … Summan, Friedrich. (2019). OpenAIRE Research Graph Dump (Version 1.0.0-beta) [Data set]. Zenodo. http://doi.org/10.5281/zenodo.3516918</i><br/>
249
                        The OpenAIRE Research graph includes data from <a href="https://aka.ms/msracad">Microsoft Academic Graph</a> (MAG): please acknowledge also MAG following <a href="https://docs.microsoft.com/en-us/academic-services/graph/resources-faq#license">this guideline</a>.
250
                     </p>
251
                     <h3>License</h3>
252
                     <p>The OpenAIRE Research Graph is released under CC-BY license.</p>
253
                     <p>OpenAIRE is working to produce dumps that only contains metadata records that can be re-distributed with the CC0 license: stay tuned!</p>
254 237
                  </div>
255 238
               </div>
256 239
            </div>
modules/dnet-api-http-doc/src/api.html
192 192
                  <!--div class="uk-card uk-margin-remove uk-padding-remove uk-card-default uk-card-body" style="z-index: 980;" uk-sticky="offset:100; bottom: #bottom">
193 193
                    <a class="uk-totop" href="#" uk-scroll="" uk-totop="">
194 194
                    </a></div-->
195
                    <!-- <div class="uk-alert-danger uk-text-center" uk-alert>
196
                        <p>
197
                          OpenAIRE is about to release its new face with lots of news and  services. <br>
198
                          During September, you may notice downtime in services, while some functionalities (e.g. user registration, validation, claiming) will be temporarily disabled.
199
                          We apologize for the inconvenience, please stay tuned! <br>
200
                          For further information please contact <a href="mailto:helpdesk@openaire.eu">helpdesk@openaire.eu</a>.
201
                        </p>
202
                    </div> -->
203
                    <div class="uk-alert-danger" uk-alert>
204
                        <h3>Contribute to improve the OpenAIRE Research Graph</h3>
205
                        <p>You can explore and test the beta release of the OpenAIRE Research Graph via the <a href="https://beta.explore.openaire.eu">OpenAIRE BETA Explore Portal</a> or via data dumps made available in <a href="https://zenodo.org/communities/openaire-research-graph">Zenodo</a>. </p>
206
                        <p>Help us making the graph ready for its 1st production release by providing your feedback.<br/>
207
                            Go to the <a href="https://trello.com/b/o1tEJ3rN/openaire-research-graph">OpenAIRE Research Graph Trello Board</a> to report content quality issues, including missing metadata records, wrong values, mistakes in the detection of duplicates and anything else that looks "weird" or wrong.
208
                        <p>Find the complete information about the OpenAIRE Research Graph, how to test it and contribute to improve it on <a href="https://www.openaire.eu/blogs/the-openaire-research-graph">our blog</a>.</p>
209
                    </div>
210
		   <div class="uk-alert-danger" uk-alert>
211
		       <p>Openaire XML Schema changed on 2 October 2018. <a href="https://www.openaire.eu/openaire-xml-schema-change-announcement" target="_blank">Click here</a> for details</p>
212
                    </div>
213

  
214 195
                  <p>
215
                    The OpenAIRE HTTP API allows developers to access the metadata information space of OpenAIRE by performing queries over publications, datasets, and projects.
196
                    The OpenAIRE HTTP API allows developers to access metadata records of the OpenAIRE Research Graph by performing queries over publications, datasets, and projects.
216 197
                    The API is intended for metadata discovery and exploration only, that is it does not give direct access to publication files and it does not provide access to
217
                    the whole information space: the number of total results returned by one query is limited to 10,000. For accessing the whole information space, developers are
218
                    encouraged to use the <a href="http://api.openaire.eu/#cha_oai_pmh" target="_blank">OAI-PMH</a>.<br>
198
                    the whole information space: the number of total results returned by one query is limited to 10,000. For accessing the whole graph, developers are
199
                    encouraged to use the <a href="./graph-dumps.html">OpenAIRE Research Graph dumps</a>.<br>
219 200
                  </p>
220 201

  
221 202
                    <div>

Also available in: Unified diff