Project

General

Profile

D64 OpenAIRE Maintenance Report » History » Revision 3

Revision 2 (Marek Horst, 09/12/2016 05:29 PM) → Revision 3/83 (Marek Horst, 09/12/2016 05:47 PM)

h1. D6.4 OpenAIRE Maintenance Report (v1, 9th of December 2016) 

 {{toc}} 

 h2. Overview 

 This document contains information about the deployment, status of OpenAIRE2020 services and content, and the history of major modifications of the system hosted at ICM, Poland.  

 The official maintenance of the OpenAIRE2020 services began on January 1st, 2015 when the project started. 

 h2. Deployment 

 Because OpenAIRE2020 services are a continuation and incremental extension of the services already present that resulted from OpenAIRE+ project, so they are still hosted on that same machines. More details are available at "OpenAIRE+ WP5 Maintenance Report":http://wiki.openaire.eu/xwiki/bin/view/OpenAIREplus%20Specific/WP5%20Maintenance%20Report. 

 _@Paweł: are there any new services in maintenance since OpenAIRE+ project worth mentioning here?_ 

 h2. Documentation 

 DNet deployment is performed following the documentation described at: http://ivy.driver.research-infrastructures.eu/ci/dnet-openaire-doc/ 

 _@Claudio: is it up to date?_ 

 Zenodo The Orphan repository is deployed according to the process described at http://invenio-software.org/wiki/Project/OpenAIREplus/ReleaseProcess. 

 _@Lars: link does not work anymore, can you provide the proper one?_ 

 "Information Inference Service":https://github.com/openaire/iis versioning and deployment is described on "IIS versioning and deployment":https://issue.openaire.research-infrastructures.eu/projects/openaire/wiki/IIS_versioning_and_deployment wiki page. More detailed description of IIS deployment is available on "IIS deployment step by step":https://issue.openaire.research-infrastructures.eu/projects/openaire/wiki/IIS_deployment_step_by_step wiki page. 

 h2. D-NET workflows 

 _@Claudio: could you fill that in?_ 

 h2. Services status 

 h3. D-NET backend services 

 _@Claudio: could you fill that in? Probably you can rely on http://wiki.openaire.eu/xwiki/bin/view/OpenAIREplus%20Specific/WP5%20Maintenance%20Report_ 

 h3. Portal 

 _@Paweł: could you fill that in? You can do it in a similar way it was done in http://wiki.openaire.eu/xwiki/bin/view/Technical%20Specifications/Maintenance%20Report_ 

 

 h3. Zenodo Orphan 

 Zenodo The Orphan repository employs an instance of the Invenio software, developed by CERN. 

 _@Lars: could you fill that in? You can do it in a similar way it was done in http://wiki.openaire.eu/xwiki/bin/view/Technical%20Specifications/Maintenance%20Report_ 

 

 h3. DM hadoop cluster 

 CDH version: @cdh4.3.1@ 

 h3. IIS hadoop cluster 

 CDH version: @cdh4.3.1@, replaced with @cdh5.5.2@ on November 20, 2016, to be replaced with @cdh5.9.0@ 

 h3. Content status 

 |*data type*|*count*| 
 |publications|17460368| 
 |datasets|3226586| 
 |projects|653268| 
 |organizations|64591| 
 |authors|16188328| 
 |EuropePMC XML contents|1574358| 
 |PDF contents|2227458| 

 Based on IIS report generated on November 20, 2016. 

 h3. Change Log for servers administration operations 

 _@Paweł: could you fill that in? This could be similar to: http://wiki.openaire.eu/xwiki/bin/view/OpenAIREplus%20Specific/Change%20Log%20for%20servers%20administration%20operations_ 

 h2. Major modifications 

 h3. Introducing CDH5 IIS cluster hosted in OCEAN infrastructure 

 Slave node specification: 
 * Huawei RH1288 V3 
 * CPU: 2x Intel(R) Xeon(R) CPU E5-2680 v3 @ 2.50GHz (24 cores, 48 threads) 
 * RAM: 128GB 
 * HDD: 4x SATA 6TB 7.2K RPM (HDFS) 

 Cluster summary (16 slaves): 
 * CPU: 384 cores, 768 threads 
 * RAM: 2048GB 
 * HDD: 384TB (HDFS) 

 YARN available resources: 
 * vcores: 640 
 * memory: 1.44TB 
 * HDFS: 344TB 

 h3. Incorporating resources from old CDH4 IIS cluster into existing DM CDH4 cluster 

 _@Paweł: are you aware of any other major modifications regarding other services such as new portal version etc?_ 

 h2. System downtimes 

 _@Paweł: could you fill that in? We could create dedicated with entry similar to: 
 http://wiki.openaire.eu/xwiki/bin/view/OpenAIREplus%20Specific/History%20of%20system%20outages 
 and link it here._