Project

General

Profile

D64 Servers Administration Operations Changelog » History » Version 3

Marek Horst, 14/06/2018 03:58 PM
improving l&f by introducing bullet points

1 1 Marek Horst
h1. Change Log for servers administration operations
2
3 2 Marek Horst
h2. 2nd Period (14/12/2016 - 30/06/2018)
4
5
June 2018:
6
7
May 2018:
8
9 3 Marek Horst
* "mantis#9574":https://mantis.icm.edu.pl/view.php?id=9574 Uploading (repeatedly) two updated configuration files required by integration tests suite on ci.ceon.pl
10 2 Marek Horst
11
April 2018:
12
13 3 Marek Horst
* "mantis#9736":https://mantis.icm.edu.pl/view.php?id=9736 Making ResourceManager being responsive again on IIS CI Test cluster
14 2 Marek Horst
15
March 2018:
16
17
February 2018:
18
19
January 2018:
20
21
December 2017:
22
23
November 2017:
24
25
October 2017:
26
27
September 2017:
28
29
August 2017:
30
31
July  2017:
32
33 3 Marek Horst
* "mantis#9693":https://mantis.icm.edu.pl/view.php?id=9693 Making spark history server available again on CDH5 cluster
34
* "mantis#9675":https://mantis.icm.edu.pl/view.php?id=9675 Fixing spark history server webapp returning 503 error
35
* "mantis#9654":https://mantis.icm.edu.pl/view.php?id=9654 Configuring apache httpd on hadoop clusters
36
* "mantis#9525":https://mantis.icm.edu.pl/view.php?id=9525 Adjusting puppeta and monit configuration on hadoop-ci-test
37
* "mantis#9738":https://mantis.icm.edu.pl/view.php?id=9738 Dropping openaire libs out of local maven repo on jenkins machine
38
* "mantis#9737":https://mantis.icm.edu.pl/view.php?id=9737 Providing jenkins worker SSH access to iis-ci-test.ocean.icm.edu.pl
39 2 Marek Horst
40
June 2017:
41
42 3 Marek Horst
* "mantis#9735":https://mantis.icm.edu.pl/view.php?id=9735 Fixing IIS build failures
43 2 Marek Horst
44
May 2017:
45
46
April 2017:
47
48 3 Marek Horst
* "mantis#9725":https://mantis.icm.edu.pl/view.php?id=9725 Hooking up OpenAIRE IIS with sonar.ceon.pl
49
* "mantis#9678":https://mantis.icm.edu.pl/view.php?id=9678 Optimizing memory configuration IIS CDH5 cluster
50 2 Marek Horst
51
March 2017: 
52
53 3 Marek Horst
* "mantis#9723":https://mantis.icm.edu.pl/view.php?id=9723 Fixing lost node on hadoop-ci-test.vls.icm.edu.pl
54
* "mantis#9724":https://mantis.icm.edu.pl/view.php?id=9724 Providing access to yarn web interfaces on hadoop-ci-test
55
* "mantis#9719":https://mantis.icm.edu.pl/view.php?id=9719 Fixing Resource Manager failures ON IIS CI Test cluster
56
* "mantis#9709":https://mantis.icm.edu.pl/view.php?id=9709 Renaming OCEAN cluster hosts
57 2 Marek Horst
58
February 2017:
59
60 3 Marek Horst
* "mantis#9691":https://mantis.icm.edu.pl/view.php?id=9691 Updating iis-ci-test.ocean.icm.edu.pl requirements
61
* "mantis#9699":https://mantis.icm.edu.pl/view.php?id=9699 Fixing random documents classification failures 
62
* "mantis#9710":https://mantis.icm.edu.pl/view.php?id=9710 Considering upgrade to 5.10.0, assessing potential risks
63
* "mantis#9711":https://mantis.icm.edu.pl/view.php?id=9711 Fixing virtual name node name resolution on CDH5 IIS cluster
64
* "mantis#9716":https://mantis.icm.edu.pl/view.php?id=9716 Dealing with Internal Server Error on IIS OCEAN CDH5 cluster master nodes
65 2 Marek Horst
66
January 2017:
67
68 3 Marek Horst
* "mantis#9695":https://mantis.icm.edu.pl/view.php?id=9695 Fixing DataNode unavailable to NameNode on iis-ci-test.ocean.icm.edu.pl
69 2 Marek Horst
70
December 2016:
71
72 3 Marek Horst
* "mantis#9688":https://mantis.icm.edu.pl/view.php?id=9688 Updating CDH5 cluster versions to 5.9.0 
73
* "mantis#9687":https://mantis.icm.edu.pl/view.php?id=9687 Purging and reallocating old CDH4 cluster resources
74
* "mantis#9636":https://mantis.icm.edu.pl/view.php?id=9636 Fixing CDH5 integration test cluster jobs deadlock
75
* "mantis#9631":https://mantis.icm.edu.pl/view.php?id=9631 Upgrading CDH5 integration test cluster
76 2 Marek Horst
77 1 Marek Horst
h2. 1st Period (01/01/2015 - 13/12/2016)
78
79
December 13, 2016:
80
  - Updated Oozie sharelibs on ci-test.hadoop5.iis.openaire.eu, see Mantis #"9691":https://mantis.icm.edu.pl/view.php?id=9691
81
  - Generated SSL cert signed by Let's Encrypt for mining.openaire.eu and enabled HTTPS for that site, see Redmine #"2521":https://issue.openaire.research-infrastructures.eu/issues/2521
82
  - Removed old and unused LVM volumes on Xen openaire-dm-hadoop[45]-dom0 machines (they replaced openaire-iis-hadoop[12]-dom0)
83
  - Created LVM volumes for openaire-dm-hadoop-s[11-16] on openaire-dm-hadoop[45]-dom0, see Redmine #"2511":https://issue.openaire.research-infrastructures.eu/issues/2511
84
December 12, 2016:
85
  - Deployed iis-ci-test.ocean.icm.edu.pl, a new pseudo Hadoop cluster for running IIS integration tests on CDH5, see Mantis #"9688":https://mantis.icm.edu.pl/view.php?id=9688
86
  - Created a new pseudo Hadoop cluster (IIS CI Test) for running IIS integration tests on CDH5 maintained by Cloudera Manager on eos-cr-mgmt1.ocean.icm.edu.pl, see above
87
December 09, 2016:
88
  - Upgraded CDH (from 5.7.5 to 5.9.0) also on ci-test.hadoop5.iis.openaire.eu, see Mantis #"9681":https://mantis.icm.edu.pl/view.php?id=9681
89
  - Removed HBase from ci-test.hadoop5.iis.openaire.eu, see above
90
  - Shutdowned all machines of the old IIS CDH4 Hadoop cluster, see Redmine #"2512":https://issue.openaire.research-infrastructures.eu/issues/2512
91
  - Shutdowned openaire-iis-hadoop4-dom0 machine
92
  - Renamed openaire-iis-hadoop1-dom0 machine to openaire-dm-hadoop4-dom0 and openaire-iis-hadoop2-dom0 machine to openaire-dm-hadoop5-dom0
93
December 08, 2016:
94
  - Upgraded CDH (from 5.7.5 to 5.9.0) on OCEAN IIS CDH5 Test cluster, see Mantis #"9681":https://mantis.icm.edu.pl/view.php?id=9681
95
December 07, 2016:
96
  - Created a ticket for announcing shutdown of IIS CDH4 Hadoop cluster (see Redmine #"2511":https://issue.openaire.research-infrastructures.eu/issues/2512)
97
  - Upgraded Cloudera Manager agents for OCEAN IIS CDH5 Test cluser from 5.7.0 to 5.9.0 because of Cloudera Manager server upgrade
98
December 06, 2016:
99
  - Closed the Redmine tickets #2344, #2431, #2463
100
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.16.5 to 2.17.1.
101
December 02, 2016:
102
  - Added missing index.html files in components/, modules/ and plugins/ subdirectories of the portal Joomla, see Redmine #"2484":https://issue.openaire.research-infrastructures.eu/issues/2484
103
  - Removed Disallow: lines from robots.txt of the portal Joomla for those subdirectories, see above
104
December 01, 2016:
105
  - Removed HBase from OCEAN IIS CDH5 Test cluster, see Mantis #"9678":https://mantis.icm.edu.pl/view.php?id=9678
106
  - Tuned some OCEAN IIS CDH5 Test settings for YARN (yarn.nodemanager.resource.cpu-vcores=40, yarn.nodemanager.resource.memory-mb=92GB), see above
107
  - Started ntpd on openaire-www-(proxy|front|back)2, because it seems it was inactive (dead), hint: "Could not send report: SSL_connect returned=1 errno=0 state=error: certificate verify failed.  This is often because the time is out of sync on the server or client"
108
November 30, 2016:
109
  - Fixed a broken backup of MongoDB on openaire-services.vls, because it failed a few days ago (November 26)
110
  - Enabled a backup of MongoDB on openaire-services-mongodb.vls
111
  - Removed an old & stale backup of MongoDB on openaire-services-beta.vls
112
  - Enabled a backup of MongoDB & PostgreSQL on openaire-services-beta.vls
113
  - Recreated a broken SSL cert for Puppet on openaire-www-(proxy|front|back)2.vls (Could not request certificate: stack level too deep)
114
  - Upgraded CDH (from 5.5.2 to 5.7.5) on OCEAN IIS CDH5 Test cluster because of CVE-2016-5393 Apache Hadoop Privilege escalation vulnerability, see Mantis #"9681":https://mantis.icm.edu.pl/view.php?id=9681
115
  - Fixed timezone on OCEAN IIS CDH5 Test cluster machines (now we use GMT everywhere), see above
116
  - Fixed /proc/sys/vm/swappiness on iis-cdh5-test-gw & iis-cdh5-test-m[1-3] machines, see above
117
  - Fixed /sys/kernel/mm/transparent_hugepage/defrag on eos-m2-sn40 machine, see above
118
  - Upgraded CDH (from 5.5.2 to 5.7.5) also on ci-test.hadoop5.iis.openaire.eu, see above
119
November 29, 2016:
120
  - Fixed Apache configuration of "http://guidelines.openaire.eu/":http://guidelines.openaire.eu/ for DocumenRoot
121
November 28, 2016:
122
  - Purged the old logs of HDFS NameNode, balancer and Zookeeper on namenode1.hadoop.dm.openaire.eu because of a near full-filled / partition
123
  - Fixed Exim4 aliases on namenode1.hadoop.dm.openaire.eu & master1.hadoop.iis.openaire.eu in order to send to me the messages from HDFS balancer script launched by Cron (Mail delivery failed: returning message to sender: hdfs@namenode1.hadoop.dm.openaire.eu retry timeout exceeded)
124
  - Tuned yarn.scheduler.maximum-allocation-mb (16GB) YARN setting of OCEAN IIS CDH5 Test cluster, see Mantis #"9678":https://mantis.icm.edu.pl/view.php?id=9678
125
  - Stopped HBase of OCEAN IIS CDH5 Test cluster, see above
126
  - Updated and restarted openaire-www-(proxy|front|back)1.vls & openaire-www-front3 machines
127
  - Started, updated and restarted again openaire-www-(proxy|front|back)2.vls machines
128
November 25, 2016:
129
  - Tuned yarn.scheduler.maximum-allocation-vcores (6) YARN setting of OCEAN IIS CDH5 Test cluster, see Mantis #"9678":https://mantis.icm.edu.pl/view.php?id=9678
130
November 24, 2016:
131
  - Recreated a broken SSL cert for Puppet on openaire-iis-hadoop3-dom0.vls (Could not send report: SSL_CTX_use_PrivateKey:: key values mismatch)
132
November 23, 2016:
133
  - Fixed Apache configuration for a reverse proxy for CM on eos-cr-mgmt1.ocean.icm.edu.pl, because the clusters settings were changable only in a classic layout of CM, see Cloudera Case #"117145":https://cloudera-portal.force.com/5003400000spXmZ
134
  - Fixed robots.txt of OpenAIRE portal, because Googlebot couldn't grab images/CSS/JavaScript/etc, see Redmine #"2484":https://issue.openaire.research-infrastructures.eu/issues/2484
135
November 22, 2016:
136
  - Recreated a broken SSL cert for Puppet on openaire-www-test.vls (Could not send report: SSL_CTX_use_PrivateKey:: key values mismatch)
137
  - Tuned some OCEAN IIS CDH5 Test settings for YARN (mapreduce.map.memory.mb=0, mapreduce.map.java.opts.max.heap=1638MB, mapreduce.reduce.memory.mb=0, mapreduce.reduce.java.opts.max.heap=3276MB), see Mantis #"9678":https://mantis.icm.edu.pl/view.php?id=9678
138
November 21, 2016:
139
  - Started container 8480 on openaire-services.vls, because it crashed by night, see Redmine #"2477":https://issue.openaire.research-infrastructures.eu/issues/2477
140
  - Fixed owner of /var/log/nginx/ directory (from www-data: to root:) on furkot2, because of CVE-2016-1247 vulnerability against Nginx, for more details see "https://legalhackers.com/advisories/Nginx-Exploit-Deb-Root-PrivEsc-CVE-2016-1247.html":https://legalhackers.com/advisories/Nginx-Exploit-Deb-Root-PrivEsc-CVE-2016-1247.html
141
  - Fixed Apache configuration of "http://guidelines.openaire.eu/":http://guidelines.openaire.eu/ for /robots.txt & /favicon.ico requests
142
  - Allowed connections to OpenAIRE Piwik from Dimitris Pierrakos machine without authentication against CNR LDAP server, because he needs it for sending requests to Piwik API
143
November 18, 2016:
144
  - michal.politowski added to groups "driver" & "joomla" on openaire.vls, because he wants to see the Apache logs
145
  - Moved /etc/apache2/sites-enabled/joomla.conf to /etc/apache2/sites-enabled/000-joomla.conf after Michal Politowski email about OpenAIRE portal SEO (hint SNI)
146
  - Fixed Google Analytics JavaScript code URL (from HTTP to HTTPS) on the portal using Apache's mod_substitute directive, see Redmine #"2449":https://issue.openaire.research-infrastructures.eu/issues/2449
147
November 17, 2016:
148
  - Started HBase-Master on openaire-dm-hadoop-hb-m1.vls because it was dead
149
  - Created "usage_openaire" account in Piwik and granted him the view access for all current and future websites we truck by Piwik, see Redmine #"2431":https://issue.openaire.research-infrastructures.eu/issues/2431
150
  - Created HDFS home directory for giorgos.alexiou on OCEAN IIS CDH5 Test cluster, see Redmine #"2393":https://issue.openaire.research-infrastructures.eu/issues/2393
151
November 16, 2016:
152
  - Tested the PHP script addsite.php for creating a new Piwik websites, see Redmine #"2463":https://issue.openaire.research-infrastructures.eu/issues/2463
153
  - Added the trusted NKUA/NTUA/Athena RC networks on the firewall of OCEAN IIS CDH5 Test cluster gateway, see Redmine #"2393":https://issue.openaire.research-infrastructures.eu/issues/2393
154
  - Added giorgos.alexiou to "driver" group there, see above
155
November 15, 2016:
156
  - Installed Java 8 on openaire-virtuoso-beta, asked by Shirin Ameri, see Redmine #"2344":https://issue.openaire.research-infrastructures.eu/issues/2344
157
  - Discussion about generating automatically $idsite of Piwik for a new aggregated repos, see Redmine #"2463":https://issue.openaire.research-infrastructures.eu/issues/2643
158
  - Started working on a PHP script for creating a new Piwik websites, see above
159
November 14, 2016:
160
  - Upgraded and restarted the production machines (furkot2, openaire-www, openaire-stats, openaire-solr, openaire-services, openaire-services-mongodb, openaire-services-postgresql, openaire-virtuoso) with a new kernel fixed against Dirty COW bug, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
161
November 10, 2016:
162
  - Added shirin.ameri to "driver" group on openaire-virtuoso-beta.vls, see Redmine #"2344":https://issue.openaire.research-infrastructures.eu/issues/2344
163
November 08, 2016:
164
  - Closed the Redmine tickets #2100, #2342
165
November 07, 2016:
166
  - Further cleaning of infected Wordpress on "https://blogs.openaire.eu/:":https://blogs.openaire.eu/: removed infected themes (guardian, twentythirteen & twentytwelve), restored infected wp-content/themes/wp-pinup/header.php file
167
  - Fixed sudo config on gateway.hadoop.iis.openaire.eu (now `sudo su - dnet ...` & `sudo su dnet ...` commands are defined separately), reported by K.Zamlynska
168
  - Fixed also sudo on gateway.hadoop.dm.openaire.eu, see above
169
  - Increased a NFS volume openaire_beta_objectstore_pdfs mounted on beta.services.openaire.eu as /mnt/objectstore_pdfs from 6TB to 8TB, because it was filled in 100%
170
  - Restarted Spark History Server of OCEAN CDH5 Test cluster, because it seemed to be dead, reported by M.Horst, see Mantis #"9675":https://mantis.icm.edu.pl/view.php?id=9675
171
November 04, 2016:
172
  - Cleaned infected Wordpress on "https://blogs.openaire.eu/":https://blogs.openaire.eu/
173
  - Sent to Claudio the current numbers of the hardware resources at ICM
174
  - Downgraded Java 8u91 to 8u66 on ci-test.hadoop5.iis.openaire.eu, because of a problem with Oozie, reported by M.Horst, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
175
November 03, 2016:
176
  - Renewed SSL cert of Puppet for all OpenAIRE machines at ICM because of expired Puppet master SSL cert
177
  - Fixed a network issue on eos-m2-gw machine where iis-cdh5-test-gw is hosted after its reboot, reported by M.Horst, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
178
  - Enabled IP forwarding on the OCEAN IIS CDH5 Test cluster gateway, but it won't be used because the cluster slaves get IP address and a default gateway from DHCP server...
179
  - Fixed broken routing on a default gateway for the OCEAN IIS CDH5 Test cluster after its reboot (hint: net.ipv4.ip_forward=1 & net.ipv4.conf.all.rp_filter=0), reported by M.Horst, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
180
  - Purged the old logs of HDFS, YARN and Oozie on ci-test.hadoop5.iis.openaire.eu because of a near full-filled / partition
181
November 02, 2016:
182
  - Closed the Redmine tickets #2249, #2284, #2311, #2323, #2330, #2344, #2375
183
  - Configured clustershell for OCEAN IIS CDH5 Test cluster on the cluster gateway
184
  - Upgraded and restarted OCEAN IIS CDH5 Test cluster related machines (iis-cdh5-test-gw, iis-cdh5-test-m[1-3], eos-m2-gw, eos-m2-mn[1-3], eos-m2-sn0[1-8], eos-m2-sn[35-42]) with a new kernel fixed against Dirty COW bug, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
185
  - Erased "chrony" package from some OCEAN IIS CDH5 Test cluster related machines, because there was in a conflict with "ntpd" service
186
  - Upgraded and restarted openaire-beta-(www|stats|solr|services).vls and openaire-services-pilot with a new kernel fixed against Dirty COW bug, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
187
October 28, 2016:
188
  - Upgraded and restarted openaire-www-test.vls with a new kernel fixed against Dirty COW bug, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
189
  - Upgraded and restarted openaire-dm-hadoop[1-3]-dom0 with a new kernel fixed against Dirty COW bug, see above
190
  - Upgraded and restarted openaire-iis-hadoop[1-4]-dom0 with a new kernel fixed against Dirty COW bug, see above
191
October 27, 2016:
192
  - Started 8380 on openaire-services-pilot.vls, because it was dead, reported by Natalia
193
  - Added forgotten monitoring of 8380 on openaire-services-pilot.vls, see above
194
October 24, 2016:
195
  - Fixed sudo for becoming "dnet" user on DM/IIS Hadoop cluster gateway, see Redmine #"2413":https://issue.openaire.research-infrastructures.eu/issues/2413
196
  - Increased size (from 400GB to 500GB) of /srv partition on beta.solr.openaire.eu
197
October 21, 2016:
198
  - Allowed connections from DM Hadoop cluster to MongoDB on mongodb.services.openaire.eu, see Redmine #"2175":https://issue.openaire.research-infrastructures.eu/issues/2175
199
October 19, 2016:
200
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.16.2 to 2.16.5.
201
  - Upgraded ownCloud on box.openaire.eu from 8.2.2 to 8.2.7
202
October 18, 2016:
203
  - Fixed a content of /var/run/tomcat7.pid file on openaire-virtuoso-beta.vls, because Monit unmonitored Tomcat there, but it was running well
204
  - Generated Let's Encrypt SSL certificates for (beta.)virtuoso.openaire.eu
205
  - Closed Redmine #"2390":https://issue.openaire.research-infrastructures.eu/issues/2390 ticket
206
  - Upgraded ownCloud on box-test.openaire.eu from 8.2.2 to 8.2.7
207
October 17, 2016:
208
  - Generated Let's Encrypt SSL certificates for (analytics|api|beta|beta.services|box|box-test|goldoapilot|lareferencia|old|services|validator).openaire.eu
209
October 7, 2016:
210
  - Generated and installed a test SSL cert from Let's Encrypt CA on test.openaire.eu
211
  - Generated only a new SSL cert from Let's Encrypt CA on www.openaire.eu, because Natalia don't want to buy a new one (see Redmine #"2291":https://issue.openaire.research-infrastructures.eu/issues/2291)
212
October 6, 2016:
213
  - Started Spark Worker on ci-test.hadoop5.iis.openaire.eu
214
  - Firewall rules for Hadoop daemons web UIs cleanup, see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567
215
October 5, 2016:
216
  - Enabled an access to port 8980 on openaire-services.vls and openaire-services-beta.vls from OCEAN IIS Hadoop, see Redmine #"2352":https://issue.openaire.research-infrastructures.eu/issues/2352
217
October 4, 2016:
218
  - Enabled an access to openaire-services-(mongodb|postgresql).vls via SSH from CNR IPv6 network, see Redmine #"2175":https://issue.openaire.research-infrastructures.eu/issues/2175
219
  - Enabled IPv6 support for MongoDB on openaire-services-mongodb.vls, see above
220
October 3, 2016:
221
  - Enabled an access from openaire-services.vls to 27017 port (MongoDB) on openaire-services-mongodb.vls, see Redmine #"2175":https://issue.openaire.research-infrastructures.eu/issues/2175
222
September 30, 2016:
223
  - Investigated an issue with Oozie and MySQL timeouts, see Redmine #"2324":https://issue.openaire.research-infrastructures.eu/issues/2324
224
SEPTEMBER 29, 2016:
225
  - Restarted 8580 container on openaire-services-pilot.vls, because it seems that it hanged (the process was running, but it wasn't listening at 8580 port)
226
September 28, 2016:
227
  - Upgraded CDH (from 4.3.1 to 4.7.0) on DM Hadoop cluster, see Redmine #"2324":https://issue.openaire.research-infrastructures.eu/issues/2324
228
  - Upgraded Java (from 7u80 to 8u101) there, see above
229
September 27, 2016:
230
  - Removed the old logs (from 2012 to 2014) of koprowy on the logserver on mnich because of a lack of free disk space on / there
231
September 26, 2016:
232
  - Reported an error with sh404sef plugin of a production Joomla (Sh404sefHelperLanguage::getUrlCodeFromTag::182:  Language tag en-GB not in installed language list), see Redmine #"2342":https://issue.openaire.research-infrastructures.eu/issues/2342
233
  - Purged the old logs of HDFS, YARN and Oozie on ci-test.hadoop5.iis.openaire.eu because of a near full-filled / partition
234
  - Investigated Alessia's issue with accessing 8980 on openaire-services.vls and openaire-services-beta.vls, see Redmine #"2323":https://issue.openaire.research-infrastructures.eu/issues/2323
235
  - Added Alessia's IP address to a list of IPs allowed to access 8980 on both services machines, see above
236
  - Created a Cron job for "postgres" user on openaire-services-postgresql.vls and openaire-services-beta.vls for refreshing some materialized views of dnet_openaireplus database, asked by Alessia, see Redmine #"2343":https://issue.openaire.research-infrastructures.eu/issues/2343
237
  - Set Nginx rules for authentication of "https://services.openaire.eu/is/mvc/api/publications/":https://services.openaire.eu/is/mvc/api/publications/, see Redmine #"2323":https://issue.openaire.research-infrastructures.eu/issues/2323
238
September 24, 2016:
239
  - Removed the old Joomla backups and gzipped sh404sef logs because of lack of free disk space on /srv on openaire-www.vls
240
September 23, 2016:
241
  - Investigating an issue with offline regions of HBase on DM Hadoop cluster, reported by Claudio, Alessia and Tsampikos
242
  - Restarted HBase masters of DM Hadoop cluster
243
September 21, 2016:
244
  - Helping with an issue with Jenkins for IIS, see Mantis #"9656":https://mantis.icm.edu.pl/view.php?id=9656
245
  - Restarted openaire-www.vls in order to increase its resources (8GB -> 18GB RAM, 4 CPU cores -> 8 CPU cores), see Redmine #"2330":https://issue.openaire.research-infrastructures.eu/issues/2330
246
  - Decreased CPU of openaire-www.vls (8 CPU cores -> 6 CPU cores) and restarted it again because of issue with a big load, the stolen CPUs etc
247
  - Shutdowned openaire-www-(proxy|front|back)2 on prod2-dom0, see above
248
September 20, 2016:
249
  - Announced restart of openaire-www.vls in order to increase the resources, see Redmine #"2330":https://issue.openaire.research-infrastructures.eu/issues/2330
250
September 19, 2016:
251
  - Set Nginx rules for authentication of "https://beta.services.openaire.eu/is/mvc/api/publications/":https://beta.services.openaire.eu/is/mvc/api/publications/, see Redmine #"2323":https://issue.openaire.research-infrastructures.eu/issues/2323
252
  - Investigating Sahar's troubles with access to beta.lod.openaire.eu, see Redmine #"1748":https://issue.openaire.research-infrastructures.eu/issues/1748
253
  - Bumped a limit of the requests per minute in Fail2Ban (apache-badhosts jail) on www.openaire.eu, because it was making the troubles with the portal access (ERR_CONNECTION_REFUSED reported by Katerina, Paolo & Natalia)
254
September 16, 2016:
255
  - Set .deb packages source for CDH 4.7.0 on DM Hadoop cluster machines, see Redmine #"2324":https://issue.openaire.research-infrastructures.eu/issues/2324
256
September 15, 2016:
257
  - Prepared .tar file with the Apache logs of the production Joomla for Dimitris Pierrakos, he needs them for any NKUA student
258
September 14, 2016:
259
  - Fixed .htaccess for (www|beta|test).openaire.eu, because it didn't support index.html for DirectoryIndex, see Redmine #"2231":https://issue.openaire.research-infrastructures.eu/issues/2231
260
  - Fixed Apache auth configuration for /administration requests
261
September 13, 2016:
262
  - Fixed monitoring of 8380 on openaire-services-beta.vls, added monitoring of 8480 and switched monitoring of the search to 8480, see Redmine #"2274":https://issue.openaire.research-infrastructures.eu/issues/2274
263
  - Blocked permanently communication between beta.services.openaire.eu and services.openaire.eu, asked by Alessia, see above
264
  - Investigating an issue with distcp from OCEAN IIS CDH5 Test cluster to OpenAIRE DM cluster, seecluster to OpenAIRE DM cluster, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
265
  - Fixed the firewall rules on the gateway of OpenAIRE DM cluster (added 213.135.60.145 for 50071 port), see above
266
  - Decreased Apache2 limits on openaire-www.vls (ServerLimit=MaxRequestWorkers=120)
267
September 12, 2016:
268
  - Investigating an issue with Monit alerts about the failed beta search, asked by Katerina, see Redmine #"2274":https://issue.openaire.research-infrastructures.eu/issues/2274
269
  - Fixed checking the search on beta.services.openaire.eu, see above
270
  - Copied 8480 from the production services to the beta one, asked by Katerina, see above
271
  - Investigating ERR_CONNECTION_REFUSED errors for some portal pages, see Redmine #"2284":https://issue.openaire.research-infrastructures.eu/issues/2284
272
September 8, 2016:
273
  - Enabled access to OCEAN CDH5 Hadoop Test cluster from OpenAIRE services machines (both production & beta), asked by Claudio, see Redmine #"2297":https://issue.openaire.research-infrastructures.eu/issues/2297
274
  - Granted access to OCEAN CDH5 Hadoop Test cluster web UIs for Claudio, see above
275
September 7, 2016:
276
  - Installed "siege" package on openaire-services-beta.vls, asked by Katerina, see Redmine #"2274":https://issue.openaire.research-infrastructures.eu/issues/2274
277
  - Checking what Piwik sites can be accessed by Dimitris Pierrakos, asked by Dimitris
278
  - Granted the admin privileges for OpenAIRE portal beta site in Piwik to Dimitris, see above
279
  - Filled a ticket about renewal of SSL cert for .openaire.eu, see Redmine #"2291":https://issue.openaire.research-infrastructures.eu/issues/2291
280
September 5, 2016:
281
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
282
September 1, 2016:
283
  - Fixed home & siteurl parameters for blogs.openaire.eu Wordpress (was HTTPS instead of HTTP there and caused a redirection loop for /wp-login.php), reported by Ross & Pedro
284
August 31, 2016:
285
  - Reported issue with stats.openaire.eu murdered by the stats SELECTs from test.openaire.eu, see Redmine #"2282":https://issue.openaire.research-infrastructures.eu/issues/2282
286
  - Restarted Apache on test.openaire.eu and killed SELECT processes coming from test.openaire.eu on stats.openaire.eu, see above
287
August 30, 2016:
288
  - Investigated issues with test.openaire.eu (failed workflows, internal errors etc), reported by Claudio, Tsmapikos & Katerina
289
  - Production Joomla redirect from HTTP to HTTPS returns now status code 301 (Moved Permanently) instead of 302 (Moved Temporarily)
290
August 29, 2016:
291
  - Created a ticket for investigating last issues with the search (see Redmine #"2274":https://issue.openaire.research-infrastructures.eu/issues/2274)
292
  - Investigated 500 errors for jobtracker1.hadoop.dm.openaire.eu (reported by Claudio again, see Redmine #"2249":https://issue.openaire.research-infrastructures.eu/issues/2249)
293
  - Restarted preemptively both JobTrackers of DM Hadoop cluster (see above)
294
  - Replaced Eri Katsari by Tsampikos Livisianos in the Monit alert lists, asked by Eri
295
  - Purged the old logs of HBase and Zookeeper on hbase-master1.hadoop.dm.openaire.eu because of a near full-filled / partition
296
  - Purged the old logs of HDFS and YARN on ci-test.hadoop5.iis.openaire.eu because of a near full-filled / partition
297
  - Restarted Virtuoso on virtuoso-beta.openaire.eu, because SPARQL endpoint was down (reported by Sahar, see Redmine #"2277":https://issue.openaire.research-infrastructures.eu/issues/2277)
298
  - Investigated issues with Googlebot requests for /robots.txt, see Redmine #"2280":https://issue.openaire.research-infrastructures.eu/issues/2280
299
  - Configured Apache on openaire-www.vls for serving also "http://www.openaire.eu/sitemap.xml":http://www.openaire.eu/sitemap.xml without redirecting to HTTPS (see Redmine #"2065":https://issue.openaire.research-infrastructures.eu/issues/2065)
300
August 12, 2016:
301
  - Restarted a few machines of OCEAN IIS CDH5 Hadoop cluster in order to fix YARN NodeManager issue, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
302
  - Fixed OpenAIRE blogs Wordpress settings broken by Pedro
303
  - Polished some Apache rules for fixing URLs on blogs.openaire.eu
304
August 11, 2016:
305
  - Removed a default gateway for IB network interface (mlx4_ib0.8002) from a routing table of OCEAN IIS CDH5 Test Hadoop cluster slave nodes
306
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.16.1 to 2.16.2.
307
August 10, 2016:
308
  - Fixed also HTTPS links for blogs.openaire.eu, see Redmine #"1888":https://issue.openaire.research-infrastructures.eu/issues/1888
309
  - Investigated an issue with HDFS distcp invoked by Ooozie for OCEAN IIS CDH5 Hadoop cluster, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
310
August 9, 2016:
311
  - Investigated MongoDB backup issue on services.openaire.eu which failed a few days ago because of "Failed: error reading collection: EOF" error
312
  - Deployed monitoring of memory used by JobTracker of IIS Hadoop cluster (helpful together with the script for a preventive restart, see below)
313
  - Fixed JavaScript HTTP links for blogs.openaire.eu, reported by Pedro Principe, see Redmine #"1888":https://issue.openaire.research-infrastructures.eu/issues/1888
314
August 4, 2016:
315
  - "driver" group can manage Redis on stats.openaire.eu & beta.stats.openaire.eu now (asked by Antonis)
316
  - "driver" group can manage Tomcat7 on beta.stats.openaire.eu now (the same like for stats.openaire.eu)
317
  - "driver" group can become "www-data" user on stats.openaire.eu now (the same like for beta.stats.openaire.eu)
318
  - Enabled a preventive restart of JobTracker by Cron on master[12].hadoop.iis.openaire.eu (asked by Marek Horst)
319
  - Synced Redis database the beta and the production stats machines (asked by Antonis)
320
  - Enabled monitoring of Redis server on the beta stats machine
321
August 3, 2016:
322
  - Fixed a replica placement policy issue (block should be additionally replicated on 1 more rack(s)) for HDFS of DM Hadoop cluster
323
  - Moved a reverse proxy for blogs.openaire.eu from furkot2.vls to openaire-www.vls (see Redmine #"1888":https://issue.openaire.research-infrastructures.eu/issues/1888)
324
  - Moved a reverse proxy for mining.openaire.eu from furkot2.vls to openaire-www.vls
325
August 2, 2016:
326
  - Removed Nikon Gasparis from Monit alert list on openaire-services-pilot.vls
327
  - Investigated an unsucessfully finished MongoDB backup on services.openaire.eu
328
  - Investigated an unbalanced HDFS of DM Hadoop cluster (from 44.19% for slave9 to 54.09% for slave5)
329
  - tsampikos.livisianos added to "driver" group on beta.stats.openaire.eu (see Redmine #"2152":https://issue.openaire.research-infrastructures.eu/issues/2152)
330
  - Enabled monitoring of nscd & nslcd daemons on the machines which authenticate users against CNR LDAP server (see Redmine #"2258":https://issue.openaire.research-infrastructures.eu/issues/2258)
331
August 1, 2016:
332
  - Deployed Webalizer for beta.virtuoso.openaire.eu
333
July 29, 2016:
334
  - Continued getting the search stats from Apache logs of the portal (see Redmine #"2144":https://issue.openaire.research-infrastructures.eu/issues/2144)
335
  - tsampikos.livisianos added to "driver" & "joomla" groups on www.openaire.eu, beta.openaire.eu & test.openaire.eu (see Redmine #"2152":https://issue.openaire.research-infrastructures.eu/issues/2152)
336
  - Fixed Nginx monitoring on furkot2.vls (now it checks old.openaire.eu, not www.openaire.eu)
337
July 28, 2016:
338
  - Investigated 500 errors for jobtracker1.hadoop.dm.openaire.eu (reported by Claudio, see Redmine #"2249":https://issue.openaire.research-infrastructures.eu/issues/2249)
339
  - Switched "http://api.openaire.eu/search":http://api.openaire.eu/search request from 8380 to 8480 on services.openaire.eu
340
  - Getting the search stats from Apache logs of the portal (see Redmine #"2144":https://issue.openaire.research-infrastructures.eu/issues/2144)
341
July 27, 2016:
342
  - Continued investigating usage of api.openaire.research-infrastructures.eu (see Redmine #"2246":https://issue.openaire.research-infrastructures.eu/issues/2246)
343
  - Deployed Webalizer for beta.lod.openaire.eu (see Redmine #"2197":https://issue.openaire.research-infrastructures.eu/issues/2197)
344
July 26, 2016:
345
  - Started YARN ResourceManager on ci-test.hadoop5.iis.openaire.eu, because it was dead and was reason of restaring YARN NodeManager there
346
  - Fixed hostname for CNR LDAP server (asked by Claudio, see Redmine #"2245":https://issue.openaire.research-infrastructures.eu/issues/2245)
347
  - Investigated usage of api.openaire.research-infrastructures.eu (reported by Alessia, see Redmine #"2246":https://issue.openaire.research-infrastructures.eu/issues/2246)
348
July 25, 2016:
349
  - ioannis.foufoulas added to "driver" group on beta.services.openaire.eu (see Redmine #"2232":https://issue.openaire.research-infrastructures.eu/issues/2232)
350
  - Started Nginx at furkot2.vls, because it was down because of invalid domain name (kiczora.vls.icm.edu.pl) for Highcharts proxy (see Redmine #"2239":https://issue.openaire.research-infrastructures.eu/issues/2239 & #"2240":https://issue.openaire.research-infrastructures.eu/issues/2240)
351
  - Fixed Monit monitoring of Apache2 at openaire-www.vls (now restarts MySQL using Monit commands stop & start)
352
July 14, 2016:
353
  - Created a new LUN on the Dell MD3620F disk array and mounted it as /srv on openaire-services-mongodb
354
  - andrea.dellamico added to "driver" group on services-postgresql.openaire.eu (asked by Alessia, see Redmine #"2174":https://issue.openaire.research-infrastructures.eu/issues/2174)
355
  - Dumped PostgreSQL of openaire-services.vls and restored it on openaire-services-postgresql.vls, see above
356
  - Increased /srv on ci-test.hadoop5.iis.openaire.eu to 60GB (from 40GB) because it was near full-filled by HDFS data
357
July 12, 2016:
358
  - Bumped memory usage limit for Monit on services.openaire.eu (from 85% to 90%), because of a lot of the Monit alerts
359
July 11, 2016:
360
  - Purged the old logs of HDFS and Zookeeper on namenode2.hadoop.dm.openaire.eu because of a near full-filled / partition
361
  - Granted a view access for ALL websites tracked by OpenAIRE Piwik to Jochen Schirrwagen
362
  - Mirrored "http://search.driver.research-infrastructures.eu":http://search.driver.research-infrastructures.eu on the portal machine, asked by Claudio, see Redmine #"2208":https://issue.openaire.research-infrastructures.eu/issues/2208
363
  - Purged the old logs of HBase on hbase-master2.hadoop.dm.openaire.eu because of a near full-filled / partition
364
June 29, 2016:
365
  - Created dnet.production and dnet.beta accounts on OCEAN IIS CDH5 Test gateway and HDFS, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
366
  - Configured an user's authentication against CNR LDAP on OCEAN IIS CDH5 Test gateway
367
June 28, 2016:
368
  - Configured in DNS the aliases (mongodb|postgresql).services.openaire.eu and services-(mongodb|postgresql).openaire.eu pointing to openaire-services-(mongodb|postgresql).vls
369
  - Mounted via NFS netapp2-nfs:/vol/skalny_mongodb_tmp/ (as /mnt/mongodb_tmp) and netapp2-nfs:/vol/openaire_mongodb_backup/ (as /mnt/mongodb_backup) on openaire-services-mongodb.vls
370
  - Enabled monitoring of MongoDB on openaire-services-mongodb.vls
371
  - Configuration of MongoDB on openaire-services-mongodb.vls synced with openaire-services.vls
372
  - Configuration of PostgreSQL on openaire-services-postgresql.vls synced with openaire-services.vls
373
June 27, 2016:
374
  - Deployed openaire-services-postgresql.vls machine as a PostgreSQL backend of services.openaire.eu, asked by CNR, see Redmine #"2174":https://issue.openaire.research-infrastructures.eu/issues/2174
375
  - Deployed openaire-services-mongodb.vls machine as a MongoDB backend of services.openaire.eu, asked by CNR, see Redmine #"2175":https://issue.openaire.research-infrastructures.eu/issues/2174
376
  - Upgraded Java 8 (from 8u66 to 8u91) on ci-test.hadoop5.iis.openaire.eu
377
June 24, 2016:
378
  - Purged the old logs of Mapreduce and Zookeeper on jobtracker1.hadoop.dm.openaire.eu because of a near full-filled / partition
379
  - Fixed 8480 monitoring on services.openaire.eu and the search monitoring on www.openaire.eu
380
June 23, 2016:
381
  - Restarted HBase Masters of DM Hadoop cluster because of hanged tasks, see Redmine #"2167":https://issue.openaire.research-infrastructures.eu/issues/2167
382
June 22, 2016:
383
  - Created a FTP account "dovepress" on openaire-www.vls (asked by Jochen and Tracy Cleary from Dove Medical Press)
384
  - Increased a NFS volume openaire_objectstore_pdfs mounted on services.openaire.eu as /mnt/objectstore_pdfs from 6TB to 8TB, because it was filled in 91%
385
June 21, 2016:
386
  - Fixed PostgreSQL monitoring by Monit on services.openaire.eu, see Redmine #"2155":https://issue.openaire.research-infrastructures.eu/issues/2155
387
June 20, 2016:
388
  - tsampikos.livisianos added to "driver" group on services.openaire.eu, beta.services.openaire.eu, stats.openaire.eu & gateway.hadoop.dm.openaire.eu (see Redmine #"2152":https://issue.openaire.research-infrastructures.eu/issues/2152)
389
  - Fixed one column in TABLE_PARAMS table of hive_metastore database of Hive for OCEAN IIS CDH5 Test cluster (see Mantis #"7911":https://mantis.icm.edu.pl/view.php?id=7911)
390
  - Created on openaire-www-back2.vls the shell scripts for checking slapd master-slave replication status and showing a difference if the slapd servers are not synchronized
391
June 18, 2016:
392
  - Fixed monitoring tomcat-instance-8480 & openaire-search (can't be restarted in the same time, now Monit alerts if 8480 fails and restarts 8480 if openaire-search fails)
393
June 17, 2016:
394
  - Configured Monit for restarting 8380 on services.openaire.eu if openaire-search issue occurs
395
  - Replaced a failed disk in openaire-iis-hadoop2-dom0, see Mantis #"9637":https://mantis.icm.edu.pl/view.php?id=9637
396
  - Enabled monitoring of 8480 on services.openaire.eu, see Redmine #"2144":https://issue.openaire.research-infrastructures.eu/issues/2144
397
  - Configured Monit for restarting 8480 on services.openaire.eu if openaire-search issue occurs (see above)
398
June 15, 2016:
399
  - Synced LDAP on openaire-www-back[12].vls with configuration and content of LDAP on openaire-www.vls
400
  - Configured LDAP master-slave replication between openaire-www-back1.vls (provider) and openaire-www-back2.vls (consumer)
401
  - Configured Apache redirection from indexed by Bing "http://openaire.eu/index.php?lang=en-GB":http://openaire.eu/index.php?lang=en-GB to "https://www.openaire.eu/":https://www.openaire.eu/, asked by Argiro
402
June 14, 2016:
403
  - Purged the old logs of HDFS and Oozie on ci-test.hadoop5.iis.openaire.eu because of a near full-filled / partition
404
  - Deployed openaire-www-back2.vls, a second (backup) back-end machine for OpenAIRE portal cluster
405
  - Configured MySQL replication between openaire-www-back1.vls (master) and openaire-www-back2.vls (slave)
406
  - Deployed 8480 container on services.openaire.eu, see Redmine #"2144":https://issue.openaire.research-infrastructures.eu/issues/2144
407
June 13, 2016:
408
  - Restarted 8380 on services.openaire.eu because the portal was down
409
  - Decreased Apache2 limits on openaire-www.vls (ServerLimit=MaxRequestWorkers=200), see above
410
  - Deployed openaire-www-proxy2.vls, a second (backup) proxy machine for OpenAIRE portal cluster
411
June 09, 2016:
412
  - Increased resources for dm_import pool of OCEAN IIS CDH5 Test cluster (max 30 vcores & max 180GB of memory), see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
413
June 07, 2016:
414
  - Patched s3cmd 1.0.0 on gateway.hadoop.iis.openaire.eu, asked by Kasia Zamlynska
415
  - Changed a mount point for the PDFs uploaded via FTP from /mnt/ftp to /mnt/uploaded_dumps, see Redmine #"1929":https://issue.openaire.research-infrastructures.eu/issues/1929
416
June 04, 2016:
417
  - Restarted 8380 on services.openaire.eu because of OOM error
418
  - Increased / on services.openaire.eu to 40GB because it was near full-filled by .hprof files of 8380
419
  - Set -Xmx10G for 8380 on services.openaire.eu because of too many OOM errors last time
420
  - Removed option -XX:HeapDumpOnOutOfMemoryError (because we don't want unused .hprof file anymore) and set -XX:OnOutOfMemoryError="/bin/kill -9 %p" instead of -XX:OnOutOfMemoryError="/etc/init.d/tomcat-instance-8380 restart" (because "driver" is not allowed for restarting container) for all D-Net containers on services.openaire.eu
421
June 03, 2016:
422
  - Tuned YARN resources settings on OCEAN IIS CDH5 Test cluster
423
  - Unbanned IP 161.53.254.14 on a firewall of the OpenAIRE portal (see Redmine #"2130":https://issue.openaire.research-infrastructures.eu/issues/2130)
424
  - Unbanned all blocked IPs on a firewall of the OpenAIRE portal
425
  - Installed awscli & s3cmd tools on gateway.hadoop.iis.openaire.eu, asked by Kasia Zamlynska
426
  - Restarted 8380 on services.openaire.eu because of OOM error
427
June 02, 2016:
428
  - Installed pydoop 1.0.0 on iis-cdh5-test-gw.ocean.icm.edu.pl (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
429
  - Increased size of / partition of OCEAN IIS CDH5 Test gateway from 20GB to 100GB (see above)
430
  - Increased memory for YARN applications on OCEAN IIS CDH5 Test cluster: 6GB for mappers & 8GB for reducers (see above)
431
  - Downgraded Java on ci-test.hadoop5.iis.openaire.eu from version 8u91 to 8u66 in order to fix Oozie issue with JSP (see Mantis #"9631":https://mantis.icm.edu.pl/view.php?id=9631)
432
  - Updated Oozie sharelibs on ci-test.hadoop5.iis.openaire.eu (see above)
433
  - Tuned YARN resources settings on OCEAN IIS CDH5 Test cluster
434
June 01, 2016:
435
  - Increased size of / partition of OCEAN IIS CDH5 Test master machines from 20GB to 100GB
436
  - Installed python-pip & avroknife on iis-cdh5-test-gw.ocean.icm.edu.pl (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
437
  - Installed Hive on OCEAN IIS CDH5 Test cluster (see above)
438
  - Changed a password for FTP account "jochen" on openaire-www.vls (asked by Jochen Schirrwagen)
439
  - Mounted via NFS openaire_ftp NetApp volume on both services machines (prod & beta)
440
May 31, 2016:
441
  - Group "driver" can check status of Solr on solr.openaire.eu and beta.solr.openaire.eu now, see Redmine #"2120":https://issue.openaire.research-infrastructures.eu/issues/2120
442
  - Updated packages on eos-cr-mgmt*, eos-m2-gw, iis-cdh5-test-* and eos-m2-sn* machines
443
  - Updated Cloudera Manager (CM) server on eos-cr-mgmt1 and Cloudera Manager agents on eos-cr-mgmt1 and all OCEAN IIS CDH5 Test cluster from version 5.5.0 to 5.7.0, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
444
  - Updated CDH on ci-test.hadoop5.iis.openaire.eu from version 5.4.7 to 5.2.2 (see Mantis #"9631":https://mantis.icm.edu.pl/view.php?id=9631)
445
May 30, 2016:
446
  - Granted permissions to "driver" group for launching `tcpflow` with any arguments on services.openaire.eu and beta.services.openaire.eu (see Redmine #"2114":https://issue.openaire.research-infrastructures.eu/issues/2114)
447
  - Removed the logs for job_201605162019_0683 and job_201605162019_0687, because they consumed most of the disk space of DM Hadoop cluster data disks (see Redmine #"2115":https://issue.openaire.research-infrastructures.eu/issues/2115)
448
  - Added the new INFN CA SSL certificate to Java keyring on services.openaire.eu and beta.services.openaire.eu (see Redmine #"2117":https://issue.openaire.research-infrastructures.eu/issues/2117)
449
  - Restarted openaire-virtuoso-beta.vls, asked by Giorgos Alexiou, see Redmine #"2118":https://issue.openaire.research-infrastructures.eu/issues/2118)
450
  - Now a dynamic pool "dm_import" on OCEAN IIS CDH5 Test cluster can use only 20 VCPUs and 40GB RAM (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
451
  - Created a new dynamic pools "marek_dot_horst" and "michal_dot_politkowski" on OCEAN IIS CDH5 Test cluster, see above
452
  - Changed a password for FTP account "copernicus" on openaire-www.vls (asked by Vitalij Mik from Copernicus)
453
May 25, 2016:
454
  - Fixed typo in HAProxy config for hdfs-namenode on gateway.hadoop.(dm|iis).openaire.eu
455
  - Installed apsw on OCEAN IIS CDH5 Test slaves (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
456
  - Set -Xmx512m fot Tomcat 7 on stats.openaire.eu (see Redmine #"2100":https://issue.openaire.research-infrastructures.eu/issues/2100)
457
  - Configured cache for WiredTiger engine of MongoDB on beta.services.openaire.eu, see Redmine #"2062":https://issue.openaire.research-infrastructures.eu/issues/2062
458
May 24, 2016:
459
  - Configured a smart proxy for 50070 of the NameNodes using HAProxy cool health check feature on the IIS Hadoop cluster gateway
460
  - "driver" group can manage Tomcat7 on stats.openaire.eu now (see Redmine #"2100":https://issue.openaire.research-infrastructures.eu/issues/2100)
461
  - Created a dynamic pool "dm_import" for managing resources on OCEAN IIS CDH5 Test cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
462
May 23, 2016:
463
  - Fixed an issue with the permissions of /tmp/logs direcory owned by YARN on OCEAN IIS CDH5 Test cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
464
  - Fixed an issue with a file browsing in DM Hadoop Hue by changing an active HDFS NameNode (see Redmine #"2094":https://issue.openaire.research-infrastructures.eu/issues/2094)
465
  - Configured a smart proxy for 50070 of the NameNodes using HAProxy cool health check feature on the DM Hadoop cluster gateway (see above)
466
May 20, 2016:
467
  - Installed Ext JS for Ooozie on iis-cdh5-test-m3.ocean.icm.edu.pl (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
468
  - Installed "mc" package on iis-cdh5-test-gw.ocean.icm.edu.pl, asked by Marek Horst (see above)
469
  - Installed Oozie ShareLib on OCEAN IIS CDH5 Test Hadoop cluster (see above)
470
  - Stopped and disabled in systemd wpa_supplicant on all machines in module #2 of OCEAN Hadoop infrastructure
471
  - Alessia Bardi will be receiving Monit alerts from DM Hadoop slaves as well (see Redmine #"2090":https://issue.openaire.research-infrastructures.eu/issues/2090)
472
  - aenne.loehden added to "driver" group on services.openaire.eu & beta.services.openaire.eu (asked by Jochen)
473
  - Open Solr port (8983) for UNIBI networks (asked by Jochen too)
474
  - Granted a "view" access to 26 Portugal repos to Jochen, see Redmine #"2059":https://issue.openaire.research-infrastructures.eu/issues/2059
475
  - Purged the old logs of HDFS and Zookeeper on namenode1.hadoop.dm.openaire.eu because of a near full-filled / partition
476
  - Installed LaTeX packages on openaire-www.vls for generating PDF of the OpenAIRE Guidelines (see Redmine #"2067":https://issue.openaire.research-infrastructures.eu/issues/2067)
477
May 19, 2016:
478
  - Configured Apache on iis-cdh5-test-gw.ocean.icm.edu.pl as a reverse proxy for OCEAN IIS CDH5 Test master slaves (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
479
  - Restarted HDFS DataNodes on slave[9-10].hadoop.dm.openaire.eu to fix an issue with the missing blocks (see Redmine #"2086":https://issue.openaire.research-infrastructures.eu/issues/2086)
480
  - Configured an user's authentication against CNR LDAP for all web services of OCEAN IIS CDH5 Test cluster behind a reverse proxy on iis-cdh5-test-gw.ocean.icm.edu.pl
481
  - Increased (from 60s to 180s) a proxy timeout of Nginx for api.openaire.eu (see Redmine #"2085":https://issue.openaire.research-infrastructures.eu/issues/2085)
482
  - iis-cdh5-test-gw.ocean.icm.edu.pl (instead eos-m2-sn01.ocean.icm.edu.pl) is now allowed to access gateway.hadoop.(dm|iis).openaire.eu without LDAP authentication (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
483
  - Installed "screen" package on iis-cdh5-test-gw.ocean.icm.edu.pl, asked by Marek Horst (see above)
484
May 18, 2016:
485
  - katarzyna.zamlynska added to group driver on gateway.hadoop.iis.openaire.eu (see Mantis #"9630":https://mantis.icm.edu.pl/view.php?id=9630)
486
  - Configured Apache on iis-cdh5-test-gw.ocean.icm.edu.pl as a reverse proxy for OCEAN IIS CDH5 Test master machines (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
487
May 17, 2016:
488
  - katerina.iatropoulou added to group "driver" on gateway.hadoop.dm.openaire.eu (see Redmine #"2078":https://issue.openaire.research-infrastructures.eu/issues/2078)
489
  - Created an account for Katerina Iatropoulou & Eri Katsari on all slaves of DM Hadoop cluster (see above)
490
  - Granted permissions to Katerina & Eri for becoming "mapred" user on all slaves of DM Hadoop cluster (see above)
491
  - Moved YARN, Zookeeper & HBase master daemons of OCEAN IIS CDH5 Test cluster to iis-cdh5-test-m[1-3] machines (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
492
  - Deployed HDFS, YARN & HBase services on eos-m2-sn01 & eos-m2-sn35 machines (see above)
493
May 16, 2016:
494
  - Deployed KVM virtual machines iis-cdh5-test-m[1-3] for OCEAN IIS CDH5 Test cluster
495
  - Moved HDFS master daemons of OCEAN IIS CDH5 Test cluster to iis-cdh5-test-m[1-3] machines (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
496
May 13, 2016:
497
  - MongoDB on openaire-services.vls and openaire-services-beta.vls now listens at all network interfaces, because it needs to be reachable from DM Hadoop cluster (see Redmine #"2076":https://issue.openaire.research-infrastructures.eu/issues/2076)
498
  - Purged the old logs of HBase and Zookeeper on hbase-master1.hadoop.dm.openaire.eu because of a near full-filled / partition
499
  - Created a new website in Piwik for Spanish E-Archivo repo, asked by Dimitris (see Redmine #"2069":https://issue.openaire.research-infrastructures.eu/issues/2069)
500
  - Created the new website in Piwik for 2 Croatian repos (FULIR & HRCAK), asked by Dimitris (see Redmine #"2073":https://issue.openaire.research-infrastructures.eu/issues/2073)
501
  - Created a new website in Piwik for Bulgarian OpenAIRE repo, asked by Dimitris (see Redmine #"2074":https://issue.openaire.research-infrastructures.eu/issues/2074)
502
  - Granted a "view" access to 26 Portugal repos to the users who has an account in Piwik, see Redmine #"2059":https://issue.openaire.research-infrastructures.eu/issues/2059
503
  - Created a shell script /usr/local/bin/build-guidelines-html.sh for building HTML code of "http://guidelines.openaire.eu/":http://guidelines.openaire.eu/ site on openaire-www.vls (see Redmine #"2067":https://issue.openaire.research-infrastructures.eu/issues/2067)
504
  - "http://guidelines.openaire.eu/":http://guidelines.openaire.eu/ now handled by Apache on openaire-www.vls, see above and Redmine #"1889":https://issue.openaire.research-infrastructures.eu/issues/1889
505
  - Increased size (from 200GB to 250GB) of /srv partition on beta.stats.openaire.eu
506
May 12, 2016:
507
  - Retarted Apache and MySQL on openaire-www.vls because of memory lack (Error displaying the error page: Application Instantiation Error: Could not connect to MySQL.), thanks to doe.isti.gov
508
  - Enabled fail2ban apache-badhosts jail on openaire-www.vls for protection against too many requests from clients, for example doe.isti.gov
509
  - Installed Sphinx on openaire-www.vls in order to build HTML code for "http://guidelines.openaire.eu":http://guidelines.openaire.eu (cloned from "https://github.com/openaire/guidelines)":https://github.com/openaire/guidelines) and configured Apache for serving it (see Redmine #"2067":https://issue.openaire.research-infrastructures.eu/issues/2067)
510
May 11, 2016:
511
  - Retarted Apache and MySQL on openaire-www.vls because of memory lack (Error displaying the error page: Application Instantiation Error: Could not connect to MySQL.), thanks to doe.isti.gov
512
  - Configured Apache on openaire-www.vls for serving "http://www.openaire.eu/sitemap":http://www.openaire.eu/sitemap without redirecting to HTTPS (see Redmine #"2065":https://issue.openaire.research-infrastructures.eu/issues/2065)
513
  - Built HTML code for "http://guidelines.openaire.eu":http://guidelines.openaire.eu (cloned from "https://github.com/openaire/guidelines)":https://github.com/openaire/guidelines) using Sphinx installed on my laptop and uploaded it on futkot2.vls, because we had an issue with ReadTheDocs service (see Redmine #"2067":https://issue.openaire.research-infrastructures.eu/issues/2067)
514
May 10, 2016:
515
  - Investigating the memory issues on services.openaire.eu (see Redmine #"2062":https://issue.openaire.research-infrastructures.eu/issues/2062)
516
  - "driver" group can monitor/unmonitor Java containers on services.openaire.eu now
517
  - Helping Sahar to find DocumentRoot of "http://beta.lod.openaire.eu":http://beta.lod.openaire.eu (see Redmine #"2063":https://issue.openaire.research-infrastructures.eu/issues/2063)
518
  - Created the Piwik websites for 26 Portugal repositories, asked by Pedro, see Redmine #"2059":https://issue.openaire.research-infrastructures.eu/issues/2059
519
May 09, 2016:
520
  - Restarted ci-test.hadoop.iis.openaire.eu and removed the old MapReduce & Oozie logs, because the machine was unreacheable (see Mantis #[9141>>"https://mantis.icm.edu.pl/view.php?id=9141":https://mantis.icm.edu.pl/view.php?id=9141]])
521
  - Restared slave2.hadoop.dm.openaire.eu and replaced a failed disk in openaire-dm-hadoop1-dom0.vls (see Redmine #"2057":https://issue.openaire.research-infrastructures.eu/issues/2057)
522
  - Restarted openaire-iis-hadoop4-dom0.vls Xen Dom0 machine because of hanged Dell DRAC, see Mantis #[9628>>"https://mantis.icm.edu.pl/view.php?id=9628":https://mantis.icm.edu.pl/view.php?id=9628]]
523
May 06, 2016:
524
  - Upgraded MongoDB on openaire-services.vls & openaire-services-beta.vls from version 3.2.5 to 3.2.6 (see Redmine #"2043":https://issue.openaire.research-infrastructures.eu/issues/2043)
525
May 05, 2016:
526
  - Restored all MongoDB databases of openaire-services.vls on ciemniak2.vls (see Redmine #"2043":https://issue.openaire.research-infrastructures.eu/issues/2043)
527
  - Updated CA root cert of CNR LDAP server on piwik.vls (see Redmine #"2049":https://issue.openaire.research-infrastructures.eu/issues/2049)
528
  - Created dump of MongoDB mdstore, objectStore & dnet_logs databases on openaire-services.vls and restored them on ciemniak2.vls
529
  - Increased size (from 150GB to 200GB) of /srv partition on beta.stats.openaire.eu (see Redmine #"1999":https://issue.openaire.research-infrastructures.eu/issues/1999)
530
  - Transfered MongoDB 3.5.2 databases from ciemniak2.vls on openaire-services.vls (see Redmine #"2043":https://issue.openaire.research-infrastructures.eu/issues/2043)
531
May 04, 2016:
532
  - Fixed `facter` on openaire-virtuoso.vls (/usr/lib/ruby/1.8/facter/vls/exim4.rb for checking Exim4's keep_environment was missing)
533
  - Enabled Puppet agent there, because it was disabled
534
  - Fixed a huge CPU load on openaire-services-beta.vls because of MongoDB 3.2 (`sudo date -s now` did the magic), see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019
535
  - Restored MongoDB oaistore* databases of openaire-services.vls on openaire-services-pilot.vls (see Redmine #"2043":https://issue.openaire.research-infrastructures.eu/issues/2043
536
  - Disabled temporarily verification of SSL cert of CNR LDAP in Apache2 on the OpenAIRE portal machines (production, beta & test) and Hadoop gateways, because it has expired today (see Redmine #"2049":https://issue.openaire.research-infrastructures.eu/issues/2049)
537
  - Updated CA root cert of CNR LDAP server and enabled its verification again (see above)
538
April 28, 2016:
539
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.16.0 to 2.16.1.
540
  - Copied logrotate config file for MongoDB from openaire-services.vls to openaire-services-beta.vls, because it seems that mongodb-org-server package from 10gen doesn't include it
541
April 27, 2016:
542
  - Deployed MongoDB 3.5.2 on ciemniak2.vls and restored there mdstore database of MongoDB 2.6 from openaire-services-beta.vls (see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019)
543
  - Created an account for Claudio and Alessia on ciemniak2.vls (see above)
544
  - Transfered MongoDB 3.5.2 databases from ciemniak2.vls on openaire-services-beta.vls (see above)
545
April 26, 2016:
546
  - Restored mdstore database of MongoDB 2.6 on openaire-services-beta.vls (see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019)
547
  - Fixed Puppet template of MongoDB for Monit, because MongoDB 3.x (from 10gen) listens at a different port (21017) now and it's managed only by Upstart init script
548
April 25, 2016:
549
  - Upgraded MongoDB on openaire-services-beta.vls from version 2.4 to 2.6 (see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019)
550
  - Upgraded MongoDB on openaire-services-beta.vls from version 2.6 to 3.0 (see above)
551
April 22, 2016:
552
  - Configured MySQL for Joomla on openaire-www-back1.vls machine
553
  - Tuned YARN on OCEAN IIS CDH5 Test cluster (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
554
April 21, 2016:
555
  - Restarted Zookeeper service & HBase Masters of DM Hadoop cluster (see Redmine #"1998":https://issue.openaire.research-infrastructures.eu/issues/1998)
556
  - Configured Nginx for Joomla on openaire-www-proxy1.vls machine
557
  - Configured Apache2 for Joomla on openaire-www-front[1-3].vls machines
558
April 20, 2016:
559
  - Disabled and removed snapshots of openaire_mongodb_backup volume on netapp1 because of lack of free disk space for MongoDB backup on openaire-services-beta.vls (see below)
560
  - Created a backup of MongoDB on openaire-services-beta.vls (see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019)
561
  - Deployed openaire-www-proxy1.vls machine
562
  - Deployed openaire-www-front[1-3].vls machines
563
  - Deployed openaire-www-back1.vls machine
564
April 19, 2016:
565
  - Increased CPU (from 4 to 8) and RAM (from 8GB to 16GB) for openaire-www.vls
566
  - Decreased CPU (from 18 to 4) and RAM (from 32GB to 8GB) for furkot2.vls
567
  - Restarted furkot2.vls (it had 830 days uptime!!!)
568
April 18, 2016:
569
  - Tuned YARN on OCEAN IIS CDH5 Test cluster (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
570
April 15, 2016:
571
  - Shutdowned slave6.hadoop.dm.openaire.eu because it has hanged up because of OOMs, see Redmine #"2008":https://issue.openaire.research-infrastructures.eu/issues/2008
572
April 14, 2016:
573
  - Enabled /etc/cron.d/cleanup-mnt-tmp Cron job which removes the files older then 3 weeks from /mnt/tmp on gateway.hadoop.(dm|iis).openaire.eu (the files located under preserved/ subdirectory are still preserved), see Redmine #"1768":https://issue.openaire.research-infrastructures.eu/issues/1768
574
April 13, 2016:
575
  - Installed unzipped version of Python APSW 2.11.1-r1 on ci-test.hadoop5.iis.openaire.eu (see Mantis #[9622>>"https://mantis.icm.edu.pl/view.php?id=9622":https://mantis.icm.edu.pl/view.php?id=9622]])
576
  - Restarted HBase RegionServer on slave4.hadoop.iis.openaire.eu, because HBase Master couldn't see it
577
  - Tuned YARN on OCEAN IIS CDH5 Test cluster (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
578
  - Created an account for Marek Horst for all slaves of OCEAN IIS CDH5 Test cluster (see above)
579
  - Installed Tomcat7 on openaire-virtuoso-beta.vls & configured sudo for "driver" group (see Redmine #"2005":https://issue.openaire.research-infrastructures.eu/issues/2005)
580
  - Configured Apache2 on openaire-virtuoso-beta.vls for handling "http://beta.lod.openaire.eu/api":http://beta.lod.openaire.eu/api requests (see above)
581
  - Added 4 new slaves to OCEAN IIS CDH5 Test cluster (eos-m2-sn0[78] & eos-m2-sn4[12])
582
April 7, 2016:
583
  - Installed php5-psql package on beta.stats.openaire.eu, asked by Ioannis Diplas (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
584
  - Granted admin rights to Dimitris Pierrakos for OpenAIRE portal (idSite=5) and API website (idSite=18) in Piwik
585
April 6, 2016:
586
  - 10.0.6.0/26 network (VLAN 406) is now allowed to access gateway.hadoop.(dm|iis).openaire.eu without LDAP authentication (see Mantis #"7593":https://mantis.icm.edu.pl/view.php?id=7593)
587
  - Granted admin rights to Natalia for OpenAIRE portal web site (idSite=5) in Piwik
588
March 31, 2016:
589
  - ioannis.diplas added to group driver on beta.stats.openaire.eu & beta.services.openaire.eu (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
590
April 5, 2016:
591
  - Grabbed 504 return code lines of Nginx logs for api.openaire.eu, asked by Alessia
592
  - Installed the latest version of Mikoomi's MongoDB plugin/template for Zabbix on services.openaire.eu and beta.services.openaire.eu
593
  - Configured Nginx on beta.services.openaire.eu for handling beta.repomanager.openaire.eu (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
594
  - Configured Apache2 on beta.stats.openaire.eu for handling /stats locally and passing the rest requests to "http://beta.services.openaire.eu:8380/statsConfig/":http://beta.services.openaire.eu:8380/statsConfig/ (see above)
595
  - Tuned YARN on ci-test.hadoop5.iis.openaire.eu (see Mantis #[9567>>"https://mantis.icm.edu.pl/view.php?id=9567":https://mantis.icm.edu.pl/view.php?id=9567]])
596
April 4, 2016:
597
  - Memory tuning of IIS CDH5 Test (OCEAN) Hadoop cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
598
  - Created an account for Frederic Merceur in OpenAIRE Piwik (see Redmine #"1972":https://issue.openaire.research-infrastructures.eu/issues/1972)
599
April 1, 2016:
600
  - CIS IP 213.135.59.178 (default gateway for the slave machines of OCEAN IIS CDH5 Test cluster) is now allowed to access gateway.hadoop.(dm|iis).openaire.eu without LDAP authentication (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
601
March 31, 2016:
602
  - Enabled monitoring of /mnt/mongodb_tmp on services.openaire.eu
603
  - Increased size of /mnt/objectstore_pdfs from 4TB to 6TB on services.openaire.eu
604
  - Configured Apache2 on openaire-stats-beta.vls for handling beta.stats.openaire.eu & beta.topics.openaire.eu domains (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
605
  - nikolaos.begetis added to group driver on beta.stats.openaire.eu & beta.services.openaire.eu (see above)
606
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.15.0 to 2.16.0.
607
  - eos-m2-sn01.ocean.icm.edu.pl is now allowed to access gateway.hadoop.(dm|iis).openaire.eu without LDAP authentication (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
608
March 30, 2016:
609
  - Set JAVA_HOME=/usr/java/jdk1.8.0_77 on IIS CDH5 Test (OCEAN) Hadoop cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
610
  - Created an account krzysztof.madry on eos-m2-sn(01|35).ocean.icm.edu.pl (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
611
  - Installed PHP5 and Sqlite 3.8.2 on beta.stats.openaire.eu (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
612
  - Configured beta.topics.openaire.eu & beta.repomanager.openaire.eu domain names in DNS (see above)
613
  - spark-gw.vls.icm.edu.pl is now allowed to access gateway.hadoop.iis.openaire.eu without LDAP authentication (see Mantis #"9487":https://mantis.icm.edu.pl/view.php?id=9487)
614
  - Granted access to Claudio for reading logs in /srv/data/*/mapred/local/userlogs/job_201602171053_1254/ of DM cluster worker nodes
615
  - Tuned IIS CDH5 Test (OCEAN) Hadoop cluster (oozie.action.max.output.data=8192, oozie.subworkflow.classpath.inheritance=true), see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
616
  - Increased size of /mnt/objectstore_pdfs from 4TB to 6TB on beta.services.openaire.eu (see Redmine #"1973":https://issue.openaire.research-infrastructures.eu/issues/1973)
617
  - Enabled monitoring of /mnt/objectstore_pdfs on services.openaire.eu & beta.services.openaire.eu (see above)
618
March 29, 2016:
619
  - Removed Java 6 and installed Java 8 on IIS CDH5 Test (OCEAN) Hadoop cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
620
  - Create a new website in Piwik for French Archimer Repository (see Redmine #"1972":https://issue.openaire.research-infrastructures.eu/issues/1972)
621
March 24, 2016:
622
  - Purged python-apsw 3.7.6.3-r1 package on ci-test.hadoop.iis.openaire.eu & ci-test.hadoop5.iis.openaire.eu and installed there Python APSW 2.11.1-r1 built on the gateway of IIS Hadoop cluster (see Mantis #[9622>>"https://mantis.icm.edu.pl/view.php?id=9622":https://mantis.icm.edu.pl/view.php?id=9622]])
623
  - Restarted HBase Master & all RegionServers of DM Hadoop cluster
624
March 22, 2016:
625
  - Removed some .hprof files of 8380 on services.openaire.eu, because of lack of free disk space on / partition (see Redmine #"1967":https://issue.openaire.research-infrastructures.eu/issues/1967)
626
  - Deployed IIS CDH5 Test (OCEAN) Hadoop cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
627
March 21, 2016:
628
  - Purged python-apsw 3.7.6.3-r1 package on the slaves of IIS Hadoop cluster and installed there Python APSW 2.11.1-r1 built on the gateway (see Redmine #"1212":https://issue.openaire.research-infrastructures.eu/issues/1212)
629
March 18, 2016:
630
  - Purged the old logs of Oozie on master3.hadoop.iis.openaire.eu because of a near full-filled / partition
631
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
632
March 16, 2016:
633
  - ioannis.foufoulas added to group driver on gateway.hadoop.iis.openaire.eu (see Mantis #"9620":https://mantis.icm.edu.pl/view.php?id=9620)
634
  - Deleted unused arxiv_pdf-old/ directory from /mnt/downloaded_dumps volume (see Redmine #"1950":https://issue.openaire.research-infrastructures.eu/issues/1950)
635
March 11, 2016:
636
  - Enabled monitoring of usage of /home and /mnt/tmp on gateway.hadoop.iis.openaire.eu
637
  - Enabled monitoring of usage of /mnt/downloaded_dumps on services.openaire.eu
638
March 10, 2016:
639
  - Disabled forgotten commands `chown -R dnet:monkeys /srv/dnet/` & `chown -R root:monkeys /usr/share/dnet/bundles/` in the root's crontab both on services.openaire.eu and beta.services.openaire.eu
640
  - Now Monit on services.openaire.eu and beta.services.openaire.eu will be restarting Tomcat containers (if neccessary) instead only sending e-mail alerts, asked by Claudio
641
March 09, 2016:
642
  - michal.politowski added to driver group at gateway.hadoop.iis.openaire.eu (see Redmine #"1936":https://issue.openaire.research-infrastructures.eu/issues/1936)
643
  - Moved MongoDB mdstore & oaistore* on services.openaire.eu from /srv & /srv3 to /srv2 (see Redmine #"1940":https://issue.openaire.research-infrastructures.eu/issues/1940)
644
  - Fixed HDFS balancer on master1.hadoop.iis.openaire.eu which was causing the load peaks there
645
March 08, 2016:
646
  - Replaced a failed disk in RAID-0 (available as /dev/sdc on openaire-iis-hadoop2-dom0.vls) for HDFS in slave3.hadoop.iis.openaire.eu (available as /dev/xvde and mounted as /srv/data/3)
647
  - Replaced a failed disk in RAID-1 (available as /dev/sdg) for LVM on openaire-iis-hadoop2-dom0.vls
648
  - Started again slave3.hadoop.iis.openaire.eu
649
  - Created a testing account for Jochen in the FTP service on ftp.openaire.eu (alias for www.openaire.eu), see Redmine #"1929":https://issue.openaire.research-infrastructures.eu/issues/1929
650
March 07, 2016:
651
  - Shutdowned slave3.hadoop.iis.openaire.eu because of HDFS disk failure
652
  - Restarted DataNodes of IIS Hadoop cluster, because of HBase Master issue ("org.apache.hadoop.hbase.util.FSUtils: Waiting for dfs to exit safe mode...", reported by Claudio, see Redmine #"1931":https://issue.openaire.research-infrastructures.eu/issues/1931)
653
  - Launched manually /usr/local/sbin/get-piwik-users-actions.sh script of gateway.hadoop.iis.openaire.eu, because it failed because of IIS Hadoop HDFS issue ("Name node is in safe mode", see above)
654
  - Increased size (from 100GB to 150GB) of /srv partition on beta.stats.openaire.eu
655
  - Eri Katsari & Andrea Mannocci added to a recipient list of Monit alerts for /srv on stats.openaire.eu & beta.stats.openaire.eu
656
March 04, 2016:
657
  - Installed MongoDB on pilot.services.openaire.eu and restored there objectStore db for a testing purpose (see Redmine #"1747":https://issue.openaire.research-infrastructures.eu/issues/1747)
658
  - Dropped objectStore db of MongoDB on services.openaire.eu and restored it from a backup (see above)
659
  - Purged the old logs of Zookeeper of {namenode1,jobtracker1,hbase-master1}.hadoop.dm.openaire.eu because of a near full-filled / partition
660
March 03, 2016:
661
  - Unsuccessful attempt to repair MongoDB on services.openaire.eu (see Redmine #"1747":https://issue.openaire.research-infrastructures.eu/issues/1747)
662
March 02, 2016:
663
  - Installed python-pip and python-libxml2 Debian packages and also beautifulsoup4 Python package on services.openaire.eu and beta.services.openaire.eu (asked by Sandro La Bruzzo, see Redmine #"1930":https://issue.openaire.research-infrastructures.eu/issues/1930)
664
February 29, 2016:
665
  - Restarted MySQL on openaire-www.vls, because Joomla had an issue with connecting its database
666
February 27, 2016:
667
  - Restarted openaire-virtuoso-beta.vls, asked by Giorgos Alexiou
668
February 26, 2016:
669
  - Deleted the local user logs of MapReduce on all slaves of the DM Hadoop cluster (asked by Giorgos, see Redmine #"1917":https://issue.openaire.research-infrastructures.eu/issues/1917)
670
  - Increased a number of CPU cores (from 12 to 16) and memory (from 32GB to 48GB) on openaire-virtuoso-beta.vls (see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
671
  - Launched 8580 on pilot.services.openaire.eu, because it was dead
672
February 24, 2016:
673
  - Deployed the new Xen DomUs called slave9.hadoop.dm.openaire.eu and slave10.hadoop.dm.openaire.eu for the DM Hadoop cluster
674
  - Deployed Ganglia on the master servers of DM Hadoop cluster
675
February 23, 2016:
676
  - Created a new Xen DomUs called slave9.hadoop.dm.openaire.eu and slave10.hadoop.dm.openaire.eu for the DM Hadoop cluster, because HDFS is near full-filled (see Redmine #"1904":https://issue.openaire.research-infrastructures.eu/issues/1904)
677
  - Deleted the old local user logs of MapReduce on all slaves of the DM Hadoop cluster (see Redmine #"1904":https://issue.openaire.research-infrastructures.eu/issues/1904)
678
February 22, 2016:
679
  - Created a new Xen Dom0 called openaire-dm-hadoop3-dom0.vls for the DM Hadoop cluster slaves, because HDFS is near full-filled (see Redmine #"1904":https://issue.openaire.research-infrastructures.eu/issues/1904)
680
February 19, 2016:
681
  - Removed doe.osti.gov (IP 192.107.175.11) from a list of DROPed IP addresses on the openaire-www.vls firewall, after Natalia request
682
  - Bumped LIMIT (from 30 to 50) of /usr/local/sbin/antiloris.sh on openaire-www.vls
683
  - Increased a number of CPU cores (from 8 to 12) on openaire-virtuoso-beta.vls (see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
684
  - Installed Ganglia on the master servers of DM Hadoop cluster
685
  - HDFS balancer threshold set to 3 in cron.d/hadoop-hdfs-balancer at DM Hadoop cluster
686
February 17, 2016:
687
  - Updated Java (from version 6 to 7) on DM Hadoop cluster (see Redmine #"1892":https://issue.openaire.research-infrastructures.eu/issues/1892)
688
  - Restarted openaire-virtuoso-beta.vls, asked by Giorgos Alexiou
689
February 16, 2016:
690
  - Fixed an ownership of the files under /etc (in particular /etc/default/tomcat-instance-8*80) on openaire-services-beta.vls which belong now to "driver" group instead of an old and inactive "monkeys" group, reported by Nikon Gasparis who couldn't change the memory settings for 8380 container
691
  - The same action on openaire-services.vls (see Redmine #"1891":https://issue.openaire.research-infrastructures.eu/issues/1891)
692
February 15, 2016:
693
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
694
  - Increased a number of CPU cores (from 4 to 8) and amount of memory (from 16GB to 32GB) on openaire-virtuoso-beta.vls (see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
695
  - Created backup of Joomla on test.openaire.eu, asked by Argiro
696
  - Synchronised test.openaire.eu with www.openaire.eu, asked by Argiro
697
  - Fixed Apache2 config for blogs.openaire.eu site on openaire-www.vls (enabled and used proxy_html module for fixing "http://blogs.openaire.eu/":http://blogs.openaire.eu/ links)
698
February 12, 2016:
699
  - Activated and configured LoginLDAP plugin of Piwik (see Redmine #"1828":https://issue.openaire.research-infrastructures.eu/issues/1828)
700
  - Opened access to port 1111 on openaire-virtuoso-beta.vls from openaire-dm-hadoop-gw (asked by Giorgos Alexiou, see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
701
February 11, 2016:
702
  - Imported to Piwik the latest Nginx logs of api.openaire.eu starting from January 16 until to February 11 (see Redmine #"1828":https://issue.openaire.research-infrastructures.eu/issues/1828)
703
  - Created a script import-api-logs.sh on piwik.vls for importing API logs to Piwik via Cron nightly (see above)
704
  - Installed LoginLDAP plugin of Piwik (see above)
705
February 10, 2016:
706
  - Upgraded ownCloud of box.openaire.eu from version 8.2.1 to 8.2.2
707
February 3, 2016:
708
  - Purged the old logs of Hadoop HDFS/MapReduce and Oozie of ci-test.hadoop.iis.openaire.eu because of a near full-filled / partition
709
  - Athena RC networks are allowed now to log in at gateway.hadoop.dm.openaire.eu (see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
710
  - Added more CPU cores (4) and memory (16GB) for beta.virtuoso.openaire.eu (see above)
711
February 2, 2016:
712
  - Increased -Xmx size (from 2GB to 4GB) for JobTracker HA on master[12].hadoop.iis.openaire.eu (see Redmine #"1859":https://issue.openaire.research-infrastructures.eu/issues/1859)
713
January 29, 2016:
714
  - Created a new instance of ownCloud ("http://box-test.openaire.eu/)":http://box-test.openaire.eu/) on farm-www.vls for the update testing
715
January 28, 2016:
716
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
717
January 27, 2016:
718
  - Assisting Claudio with resolving his issue with accessing the DM Hadoop slaves in order to check the job logs (changed his SSH public key, fixed the job directory permissions from 700 to 755)
719
January 25, 2016:
720
  - Disabled a shell script for cross-backup with CERN on orli, because our account at CERN wasn't working starting from May 2015
721
January 21, 2016:
722
  - Removed the old .hprof files of 8380 container on services.openaire.eu, because of a near full-filled / partition
723
January 20, 2016:
724
  - Reported to Pisa team that their 8290 container is dead on services.openaire.eu and beta.services.openaire.eu (see Redmine #"1836":https://issue.openaire.research-infrastructures.eu/issues/1836)
725
January 19, 2016:
726
  - Purged the old logs of Zookeeper of hbase-master1.hadoop.dm.openaire.eu because of a near full-filled / partition
727
  - Create a new website in Piwik for Portugal Cocum Repository (see Redmine #"1671":https://issue.openaire.research-infrastructures.eu/issues/1671)
728
  - Open access to port 6379 (Redis) on test.openaire.eu from beta.services.openaire.eu (see Redmine #"1833":https://issue.openaire.research-infrastructures.eu/issues/1833)
729
January 18, 2016:
730
  - Set rotate 730 for rotating the Nginx logs on furkot2.vls, because Natalia wanted the numbers of api.openaire.eu for a report for EC
731
  - Created a new website for api.openaire.eu in Piwik (see Redmine #"1828":https://issue.openaire.research-infrastructures.eu/issues/1828)
732
  - Imported Nginx logs of api.openaire.eu to Piwik (see above)
733
January 11, 2016:
734
  - Purged the old logs of Hadoop HDFS/MapReduce and Oozie of ci-test.hadoop.iis.openaire.eu because of a near full-filled / partition
735
  - Increased size of /mnt/mongodb_backup partition of services.openaire.eu from 5TB to 6TB, changed a backup policy (dump.old/ directory for a previous dump and dump/ for a current dump), enabled the snapshots feature of NetApp for the appropriate volume (see Redmine #"1806":https://issue.openaire.research-infrastructures.eu/issues/1806)
736
  - Launched JobTracker on master1.hadoop.iis.openaire.eu, because it was dead
737
January 9, 2016:
738
  - Purged the old dumps of MongoDB of services.openaire.eu because of a near full-filled /mnt/mongodb_backup partition (see Redmine #"1806":https://issue.openaire.research-infrastructures.eu/issues/1806)
739
January 8, 2016:
740
  - Launched 8380 on services.openaire.eu, because it was dead (see Redmine #"1801":https://issue.openaire.research-infrastructures.eu/issues/1801)
741
  - Investigating a timeout issue reported by Dimitris Pierrakos which was trying to download UMINHO data from Piwik
742
January 7, 2016:
743
  - Launched 8580 on pilot.services.openaire.eu, because it was dead
744
  - Re-processed all data in Piwik for OpenAIRE Post-grant Pilot site, because a report for a year period was broken (reported by Natalia)
745
  - Enabled processing the unique visitors for a year period in Piwik and re-processed all data for every OpenAIRE related site (enabled by Natalia)
746
January 4, 2016:
747
  - Installed Java 7 on virtuoso.openaire.eu and virtuoso-beta.openaire.eu and deployed Tarql 1.0a there (see Redmine #"1390":https://issue.openaire.research-infrastructures.eu/issues/1390)
748
December 26, 2015:
749
  - Purged the old logs of Hadoop HDFS/MapReduce and Oozie of ci-test.hadoop.iis.openaire.eu because of a near full-filled / partition
750
December 24, 2015:
751
  - Increased size of /srv partition on ci-test.hadoop.iis.openaire.eu from 20GB to 40GB
752
December 21, 2015:
753
  - Renamed /mnt/harvested_pdfs to /mnt/downloaded_dumps on services.openaire.eu, beta.services.openaire.eu and gateway.hadoop.iis.openaire.eu (see Redmine #"1776":https://issue.openaire.research-infrastructures.eu/issues/1776)
754
December 18, 2015:
755
  - Making beta.lod.openaire.eu and virtuoso-beta.openaire.eu ready for testing (see Redmine #"1748":https://issue.openaire.research-infrastructures.eu/issues/1748)
756
  - Configured a redirection from lod.openaire.eu to beta.lod.openaire.eu
757
December 15, 2015:
758
  - Installed python-apsw package on pyszny.vls & nosal.vls, because it's necessary for running IIS jobs on Jenkins (asked by Lukasz Dumiszewski)
759
  - Increased size of NetApp volume mounted via NFS on gw.hadoop.iis.openaire.eu as /mnt/harversed_pdfs from 1TB to 1.5TB (Mantis #"9595":https://mantis.icm.edu.pl/view.php?id=9595)
760
  - Resolved Claudio's problem with launching `sudo su - dnet` on gw.hadoop.dm.openaire.eu (see Redmine #"1765":https://issue.openaire.research-infrastructures.eu/issues/1765)
761
December 11, 2015:
762
  - Fixed a content of /var/run/mongodb/mongodb.pid file on services.openaire.eu which causes an issue with Monit, because it contaided an invalid PID number of MongoDB process (see Redmine #"1746":https://issue.openaire.research-infrastructures.eu/issues/1746)
763
December 9, 2015:
764
  - Fixed an issue with an invalid SSH key on solr.openaire.eu which caused that making of a system backup was impossible
765
  - Removed an old and unused logrotate config for MongoDB on services.openaire.eu which caused "duplicate log entry for /var/log/mongodb/mongodb.log" error
766
  - Purged an old and unused postgresql-common package on furkot2.vls which caused "error accessing /var/log/postgresql: No such file or directory" error
767
December 7, 2015:
768
  - Upgraded ownCloud of box.openaire.eu from version 7.0.4 to 8.2.1
769
  - Created a new VM beta.virtuoso.openaire.eu for Virtuoso server (see Redmine #"1748":https://issue.openaire.research-infrastructures.eu/issues/1748)
770
December 5, 2015:
771
  - Increased /srv from 400GB to 500GB on services.openaire.eu (see Redmine #"1746":https://issue.openaire.research-infrastructures.eu/issues/1746)
772
December 2, 2015:
773
  - Created an account for Dimitris Pierrakos in OpenAIRE Piwik (see Redmine #"1695":https://issue.openaire.research-infrastructures.eu/issues/1695)
774
  - Fixed the write rights for some HDFS directories on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
775
  - Opened ports on the firewall for the web interfaces of HDFS, MapReduce, YARN and Spark (see above)
776
December 1, 2015:
777
  - Installed and configured Spark on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
778
  - Created a website and an user for Zenodo in Piwik on analytics.openaire.eu (see Redmine #"1695":https://issue.openaire.research-infrastructures.eu/issues/1695)
779
November 30, 2015:
780
  - Enabled monitoring of YARN {Node,Resource}Manager and Mapreduce HistoryServer on ci-test.hadoop5.iis.openaire.eu
781
November 26, 2015:
782
  - Installed Java 8 on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
783
  - Fixed file "https://www.openaire.eu/cerif_schema/cerif-1.6-2_openaire-1.0.xsd":https://www.openaire.eu/cerif_schema/cerif-1.6-2_openaire-1.0.xsd (copied from furkot2.vls to openaire-www.vls), reported by Jan Dvorak
784
  - Made box8.openaire.eu accessible for testing for Natalia and Pedro
785
November 25, 2015:
786
  - Removed old and unused Zookeeper files on jobtracker1.hadoop.dm.openaire.eu because of near full-filled / partition
787
  - Enabled /usr/local/sbin/make-hdfs-user-home script in PAM on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
788
November 24, 2015:
789
  - Increased quota for Natalia (from 1GB to 5GB) in box.openaire.eu
790
  - Installed YARN on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
791
November 19, 2015:
792
  - Investigating an issue with near full-filled / partition on services.openaire.eu where 8380 container created a few huge .hprof files (removed my Nikon after my request)
793
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
794
  - Assisting during Joomla Security update on www.openaire.eu, done by Argiro
795
November 18, 2015:
796
  - Killed a hunged process for 8586 port on pilot.services.openaire.eu and started 8580 again (reported by Nikon)
797
November 17, 2015:
798
  - Investigating an issue with a bad encoding of the validator messages (reported by Nikon, see Redmine #"921":https://issue.openaire.research-infrastructures.eu/issues/921)
799
  - Investigating an issue with uploading files to box.openaire.eu: "Your storage is full, files can not be updated or synchronized anymore!" (reported by Sahar)
800
  - Set scheduled execution of VACUUM ANALYZE on the dnet_openaireplus database on services.openaire.eu and beta.services.openaire.eu (see Redmine #"1694":https://issue.openaire.research-infrastructures.eu/issues/1694)
801
November 13, 2015:
802
  - Configured authorized SSH keys of jenkins at ci-test.hadoop(5).iis.openaire.eu for SSH connections from ci.ceon.pl (see Mantis #"9573":https://mantis.icm.edu.pl/view.php?id=9573) for running IIS integration tests
803
November 5:
804
  - increased client_max_body_size (to 10M) for postgrantoapilot.openaire.eu (asked by Antonis) 
805
November 4:
806
  - Created Piwik accounts for Portugal pilot repositories (asked by Pedro)
807
  - Fixed broken LDAP configuration of box.openaire.eu
808
November 1, 2015:
809
  - Security upgrade of PHP and MySQL on {beta,test,www}.openaire.eu
810
October 27, 2015:
811
  - Installed php5-gmp package on www.openaire.eu (asked by Eri)
812
  - Copied Joomla directory and database from www.openaire.eu to {beta,test}.openaire.eu (asked by Argiro)
813
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.14.3 to 2.15.0.
814
October 26, 2015:
815
  - Installed composer.phar ("https://getcomposer.org/)":https://getcomposer.org/) on www.openaire.eu (asked by Eri)
816
October 23, 2015:
817
  - Security upgrade of PostgreSQL 9.3 on beta.services.openaire.eu (see Redmine #"1646":https://issue.openaire.research-infrastructures.eu/issues/1646) 
818
October 22, 2015:
819
  - Deployed ci-test.hadoop5.iis.openaire.eu machine for a new pseudo Hadoop CDH5 cluster for running IIS integration tests (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
820
  - Security upgrade of PostgreSQL 9.3 on services.openaire.eu (see Redmine #"1646":https://issue.openaire.research-infrastructures.eu/issues/1646) 
821
  - Security upgrade of PostgreSQL 9.3 on stats.openaire.eu & beta.stats.openaire.eu (see Redmine #"1645":https://issue.openaire.research-infrastructures.eu/issues/1645) 
822
October 21, 2015:
823
  - Security upgrade of PostgreSQL 9.3 on pilot.services.openaire.eu (see Redmine #"1646":https://issue.openaire.research-infrastructures.eu/issues/1646) 
824
October 16, 2015:
825
  - Helping Dimitris Pierrakos with his trouble with accessing the portal Joomla logs stored on HDFS of IIS Hadoop cluster
826
  - Helping Natalia & Antonis with their trouble with accessing Piwik stats for blogs.openaire.eu and Post-Grant Pilot
827
  - Answering Antonis who asked about the backups of Post-Grant Pilot DB
828
  - Removed old and unused logs of HDFS, MapReduce and Oozie on ci-test.hadoop.iis.openaire.eu, because they near full-filled / partition
829
October 15, 2015:
830
  - Reported the portal Apache errors to Argiro Kokogiannaki
831
  - Copied Redis server content from stats.openaire.eu to beta.stats.openaire.eu (asked by Eri Katsari)
832
  - Investigating the issues with wrong URLs ("http://localhost:8890/)":http://localhost:8890/) for lod.openaire.eu (see Redmine #"1632":https://issue.openaire.research-infrastructures.eu/issues/1632) 
833
October 14, 2015:
834
  - andrea.mannocci added to driver group at stats.openaire.eu (see Redmine #"1441":https://issue.openaire.research-infrastructures.eu/issues/1441)
835
  - Reported the portal Apache errors to Argiro Kokogiannaki
836
October 13, 2015:
837
  - Created Piwik account for Pedro Principe and given him an access to the stats for all Portugal pilot services (see Redmine #"1483":https://issue.openaire.research-infrastructures.eu/issues/1483)
838
October 12, 2015:
839
  - Fixed LDAP authentication for "https://analytics.openaire.eu/":https://analytics.openaire.eu/ (see Redmine #"1622":https://issue.openaire.research-infrastructures.eu/issues/1622)
840
  - Investigating the issue with unreachable MySQL server of the portal ("/usr/sbin/mysqld: Got an error writing communication packets")
841
October 09, 2015:
842
  - Copied 1.0/ and 0.3/ schema from furkot2.vls to openaire-www.vls (see Redmine #"1617":https://issue.openaire.research-infrastructures.eu/issues/1617)
843
  - alessia.bardi added to driver & joomla groups at www.openaire.eu (see Redmine #"1617":https://issue.openaire.research-infrastructures.eu/issues/1617)
844
October 07, 2015:
845
  - Removed the old and unused ZooKeeper/Hadoop logs on hbase-master[12].hadoop.dm.openaire.eu
846
  - Investigating the issue with LDAP/DAV authentication for "http://virtuoso.openaire.eu/":http://virtuoso.openaire.eu/ (see Redmine #"1391":https://issue.openaire.research-infrastructures.eu/issues/1391)
847
  - Enabled access to HFTP (50070 port) on gateway.hadoop.dm.openaire.eu from spark-gw.vls.icm.edu.pl (see Mantis #"9561":https://mantis.icm.edu.pl/view.php?id=9561)
848
October 06, 2015:
849
  - Continued polishing the rewrite/proxy rules for lod.openaire.eu (see Redmine #"1408":https://issue.openaire.research-infrastructures.eu/issues/1408)
850
October 02, 2015:
851
  - Fixed an issue of Anja Oberländer (<Anja.Oberlaender@uni-konstanz.de>) who couldn't see some documents under "http://box.openaire.eu":http://box.openaire.eu, because she didn't belong to "Reviewers" group (forwarded by Claudio Atzori)
852
  - Polished the rewrite/proxy rules for lod.openaire.eu (see Redmine #"1408":https://issue.openaire.research-infrastructures.eu/issues/1408)
853
October 01, 2015:
854
  - Ported the missing reverse proxy rules for /validator-{admin,services} from furkot2.vls (old.openaire.eu, Nginx) to openaire-www.vls (www.openaire.eu, Apache2) (reported by Nikon Gasparis, see Redmine #"1577":https://issue.openaire.research-infrastructures.eu/issues/1577)
855
  - Created /mnt/virtuoso/upload directory writable by driver group on virtuoso.openaire.eu (asked by Giorgos Alexiou, see Redmine #"1408":https://issue.openaire.research-infrastructures.eu/issues/1408)
856
  - A new proxy rules for ^/data/ requests on lod.openaire.eu (see above)
857
September 30, 2015:
858
  - Enabled a redirection from "https://guidelines.openaire.eu/wiki/OpenAIRE_Guidelines:_For_Literature_repositories":https://guidelines.openaire.eu/wiki/OpenAIRE_Guidelines:_For_Literature_repositories to "https://guidelines.openaire.eu/en/latest/literature/index.html":https://guidelines.openaire.eu/en/latest/literature/index.html (asked by Nikon Gasparis, see Redmine #"1571":https://issue.openaire.research-infrastructures.eu/issues/1571)
859
  - Updated avroknife from 0.9.3 to 1.0.5 on gateway.hadoop.iis.openaire.eu (asked by Mateusz Kobos, see Mantis #"9559":https://mantis.icm.edu.pl/view.php?id=9559)
860
September 29, 2015:
861
  - Open access to virtuoso.openaire.eu via SSH from Athena RC network (asked by Giorgos Alexiou)
862
  - Open access to lod.openaire.eu via HTTP from the whole world (asked by Christoph Lange)
863
  - /var/www/lod directory made writable for driver group at virtuoso.openaire.eu (see Redmine #"1569":https://issue.openaire.research-infrastructures.eu/issues/1569)
864
  - christoph.lange & george.papastefanatos added to driver group at virtuoso.openaire.eu (see Redmine #"1568":https://issue.openaire.research-infrastructures.eu/issues/1568)
865
September 28, 2015:
866
  - Installed missing packages for Virtuoso, e.g. iSPARQL, Conductor, BPEL, etc
867
  - Configured a reverse proxy for "http://lod.openaire.eu/sparql":http://lod.openaire.eu/sparql
868
  - Added permissions for managing Virtuoso server and editing virtuoso.ini file for "driver" group
869
September 25, 2015:
870
  - Restored a backup dump of dnet_openaireplus database of PostgreSQL on services.openaire.eu (asked by Alessia Bardi & Michele Artini)
871
September 24, 2015:
872
  - Increased /srv from 400GB to 500GB on solr.openaire.eu
873
  - Configured lod.openaire.eu (see Redmine #"1408":https://issue.openaire.research-infrastructures.eu/issues/1408)
874
September 23, 2015:
875
  - Granted the privileges for Dimitris Pierrakos to an access Piwik statistics of pilot Portugal repositories (see Redmine #"1483":https://issue.openaire.research-infrastructures.eu/issues/1483)
876
September 22, 2015:
877
  - Now Virtuoso server on virtuoso.openaire.eu runs as an unprivileged "virtuoso" user
878
  - Configured a reverse proxy for virtuoso.openaire.eu
879
September 21, 2015:
880
  - Created a new VM virtuoso.openaire.eu for Virtuoso server (see Redmine #"1391":https://issue.openaire.research-infrastructures.eu/issues/1391)
881
  - Deployed Virtuoso Opensource 7 server there
882
September 17, 2015:
883
  - Removed .hprof file of 8380 (it had 4.8GB) on services.openaire.eu, because its / partition was near full-filled
884
  - Asked Alessia & Claudio for removing old versions of is.war on services.openaire.eu, because of the same issue (see above)
885
  - Removed old logs of HDFS, MapReduce and Oozie on ci-test.hadoop.ci.openaire.eu, because its / partition was near full-filled
886
  - Fixed DNS settings for openaire.eu (see Redmine #"1532":https://issue.openaire.research-infrastructures.eu/issues/1532)
887
September 16, 2015:
888
  - Increased /srv on stats.openaire.eu from 150GB to 200GB
889
  - Configured Joomla for Piwik tracking on www.openaire.eu (we forgot about it yesterday)
890
  - Debugging an issue with a big load and poor I/O performance on stats.openaire.eu, because of a lot of long running SELECTs of PostgreSQL
891
September 15, 2015:
892
  - Migrated Joomla portal from furkot2.vls to openaire-www.vls
893
  - Stopped and uninstalled Redis on openaire-www.vls
894
September 14, 2015:
895
  - Created backup of Joomla on new.openaire.eu, asked by Argiro
896
September 10, 2015:
897
  - Created backup of Joomla on new.openaire.eu, asked by Argiro
898
  - Created backup of Joomla on www.openaire.eu, asked by Katerina
899
September 8, 2015:
900
  - Installed and configured Fail2Ban on test.openaire.eu (after Eri's email)
901
  - Patched apache-{auth,common}.conf rules of Fail2Ban, because the maintainer rules don't work with Apache2 error logs
902
  - Deployed Fail2Ban also on new.openaire.eu and beta.openaire.eu
903
September 7, 2015:
904
  - Installed Redis server on stats.openaire.eu and moved there Redis database content from furkot2 (see Redmine #"1515":https://issue.openaire.research-infrastructures.eu/issues/1515)
905
  - Stopped furkot2 Redis (see the Redmine ticket above)
906
  - Open access to port 6379 (Redis) on test.openaire.eu from services.openaire.eu (asked by Alessia, see the Redmine ticket above)
907
  - Copied Redis database content from test.openaire.eu to new.openaire.eu (see the Redmine ticket above)
908
September 3, 2015:
909
  - Reporting that a production portal search is not working, because Thrift on services.openaire.eu (7911 port) is dead
910
  - Added a new recipients of DNet monitoring on services.openaire.eu and beta.services.openaire.eu
911
  - Enabled monitoring of a beta portal search by Monit at beta.services.openaire.eu
912
September 2, 2015:
913
  - Reconfigured Hive on hue.hadoop.dm.openaire.eu and created MySQL database for it on hbase-master2.hadoop.dm.openaire.eu, deployed Java connector for MySQL
914
  - Enabled web console of DM Oozie
915
  - Installed hue-plugins on DM Hadoop JobTrackers
916
September 1, 2015:
917
  - Debugging an issue with validating repositories available only via HTTPS (see Redmine #"1479":https://issue.openaire.research-infrastructures.eu/issues/1479)
918
  - Debugging an issue with Hue of DM Hadoop (reported by Eri)
919
August 31, 2015:
920
  - Restarted Hue server on hue.hadoop.dm.openaire.eu, because it was unresponsible (reported by Eri)
921
  - Synchronised beta.openaire.eu with new.openaire.eu (asked by Katerina)
922
  - Increased the actions limits for OpenAIRE Piwik (asked by Dimitris Pierrakos)
923
  - Updated Ubuntu from Precise to Trusty on beta.openaire.eu (asked by Katerina)
924
August 28, 2015:
925
  - Debugging I/O issues on beta.services.openaire.eu (see Redmine #"1502":https://issue.openaire.research-infrastructures.eu/issues/1502)
926
  - lukasz.dumiszewski and krzysztof.madry added to "driver" group on gateway.hadoop.iis.openaire.eu (see Mantis #[9545>>"https://mantis.icm.edu.pl/view.php?id=9545":https://mantis.icm.edu.pl/view.php?id=9545]])
927
  - Restarted solr.openaire.eu in order to bump memory there
928
August 27, 2015:
929
  - Increased memory from 24GB to 32GB on openaire-solr
930
  - Changed permissions for /etc/apache2/ssl/STAR_openaire_eu.key on new.openaire.eu, because SimpleSAMLphp (asked by Eri) couldn't read it
931
August 26, 2015:
932
  - Started nslcd daemon on test.openaire.eu, because it was dead and Eri & Argiro couldn't access there via SSH
933
  - Synchronised test.openaire.eu with new.openaire.eu (asked by Katerina & Argiro)
934
  - Moved some NKUA stuff from /srv to /srv2 on services.openaire.eu and gzipped some .csv files under /srv/dnet, because /srv partition was a near full-filled
935
  - Added self-signed CNR certificate to Java keystore on services.openaire.eu and beta.services.openaire.eu (asked by Andrea Mannocci, see Redmine #"1442":https://issue.openaire.research-infrastructures.eu/issues/1442)
936
August 25, 2015:
937
  - Configured Nginx proxy rules for /dfm on services.openaire.eu (see Redmine #"1387":https://issue.openaire.research-infrastructures.eu/issues/1387)
938
August 24, 2015:
939
  - Created data_flow_monitoring database owned by dfm user in PostgreSQL and /var/lib/dfm directory on openaire-services.vls (asked by Alessia Bardi)
940
  - Added a new IP address of Glykeria Katsari in Puppet and on a local PostgreSQL instances for OpenAIRE stats & services
941
  - Enabled Piwik tracking in Wordpress for "http://blogs.openaire.eu":http://blogs.openaire.eu (asked by Pedro Miguel Oliveira Bento Príncipe)
942
August 19, 2015:
943
  - Updated Ubuntu from Precise to Trusty on test.openaire.eu (asked by Katerina)
944
August 17, 2015:
945
  - Created backup of Joomla on beta.openaire.eu, asked by Katerina
946
  - Synchronised beta.openaire.eu with new.openaire.eu (asked by Katerina)
947
August 12, 2015:
948
  - Added an user's authentication against a local .htpasswd file on "https://analytics.openaire.eu/":https://analytics.openaire.eu/ (Dimitris Pierrakos asked for a remote access to Piwik data for UMINHO Pilot website)
949
August 6, 2015:
950
  - Created a new Piwik websites for 3 Portugal repositories (see Redmine #"1483":https://issue.openaire.research-infrastructures.eu/issues/1483)
951
  - Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.14.1 to 2.14.3.
952
August 5, 2015:
953
  - Updated Ubuntu from Precise to Trusty on services.openaire.eu (see Redmine #"1481":https://issue.openaire.research-infrastructures.eu/issues/1481)
954
  - Also migrated there PostgreSQL 9.1 to 9.3
955
  - Also upgraded there MongoDB to 2.4.9
956
August 3, 2015:
957
  - Created a reverse proxy rules for "http://api.openaire.eu/provision/mvc/resources":http://api.openaire.eu/provision/mvc/resources (see Redmine #[844>>"https://issue.openaire.research-infrastructures.eu/issues/844":https://issue.openaire.research-infrastructures.eu/issues/844]])
958
  - Created a reverse proxy rules for "http://api.openaire.eu/search/openSearchDescriptor":http://api.openaire.eu/search/openSearchDescriptor (see Redmine #[348>>"https://issue.openaire.research-infrastructures.eu/issues/348":https://issue.openaire.research-infrastructures.eu/issues/348]])
959
  - Created an account openaire-blogs in OpenAIRE's Piwik ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) for accessing by Wordpress on blogs.openaire.eu (asked by Pedro Miguel Oliveira Bento Príncipe)
960
  - Synced with Zenodo "https://www.openaire.eu/cerif_schema/cerif-1.6-2_openaire-1.0.xsd":https://www.openaire.eu/cerif_schema/cerif-1.6-2_openaire-1.0.xsd file (asked by Jan.Dvorak@ff.cuni.cz)
961
July 17, 2015:
962
  - Removed the old logs of Zookeeper on the masters of DM Hadoop cluster in order to take some free disk space on / partition
963
  - Removed the old logs of Zookeeper, Hadoop HDFS and Mapreduce on the masters of test-ci.hadoop.iis.openaire.eu because of the same reason like above
964
  - Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.13.1 to 2.14.1.
965
July 16, 2015:
966
  - Increased memory from 24GB to 32GB on openaire-solr-beta
967
  - Enabled basic authentication in Nginx for "https://beta.services.openaire.eu/dfm/":https://beta.services.openaire.eu/dfm/ (see Redmine #"1442":https://issue.openaire.research-infrastructures.eu/issues/1442)
968
July 15, 2015:
969
  - Enabled the users authentication against CNR LDAP on solr.openaire.eu and beta.solr.openaire.eu (see Redmine #"1438":https://issue.openaire.research-infrastructures.eu/issues/1438)
970
  - Disabled "monkeys" account on solr.openaire.eu and beta.solr.openaire.eu (see above)
971
  - alessia.bardi and claudio.atzori added to "driver" group on solr.openaire.eu and beta.solr.openaire.eu (see above)
972
  - Enabled the users authentication against CNR LDAP on solr.openaire.eu and beta.solr.openaire.eu (see Redmine #"1439":https://issue.openaire.research-infrastructures.eu/issues/1439)
973
  - Disabled "monkeys" and "joomla" accounts on solr.openaire.eu and beta.solr.openaire.eu (see above)
974
  - eri.katsari, katerina.iatropoulou and antonis.lempesis added to "driver" group on solr.openaire.eu and beta.solr.openaire.eu (see above)
975
  - Synchronised beta.openaire.eu with new.openaire.eu (asked by Argiro)
976
  - andrea.mannocci and alessia.bardi added to "driver" group on beta.stats.openaire.eu (see Redmine #"1441":https://issue.openaire.research-infrastructures.eu/issues/1441)
977
July 14, 2015:
978
  - Disabled "monkeys" account on services.openaire.eu (see Redmine #"1434":https://issue.openaire.research-infrastructures.eu/issues/1434)
979
  - christoph.broschinski added to "driver" group on services.openaire.eu (see Redmine #"1434":https://issue.openaire.research-infrastructures.eu/issues/1434)
980
July 13, 2015:
981
  - Added a public SSH key of Argiro Kokogiannaki to keyring of "monkeys" user, because she needs an access to the claims database on services.openaire.eu
982
  - Open access to port 7911 (Thrift) on services.openaire.eu from scoobydoo.di.uoa.gr (asked by Argiro)
983
  - Enabled the users authentication against CNR LDAP on services.openaire.eu (see Redmine #"1434":https://issue.openaire.research-infrastructures.eu/issues/1434)
984
July 10, 2015:
985
  - Debugging an issue (504 Gateway Timeout) for guidelines.openaire.eu (see Redmine #"1425":https://issue.openaire.research-infrastructures.eu/issues/1425)
986
  - Fixed UID/GID for "dnet" user on gateway.hadoop.iis.openaire.eu (see Redmine #"903":https://issue.openaire.research-infrastructures.eu/issues/903)
987
  - Untared the newest bunch of arXiv PDFs: arXiv_pdf_150[456]_*.tar (see Redmine #"903":https://issue.openaire.research-infrastructures.eu/issues/903)
988
July 09, 2015:
989
  - Intervention on beta.services.openaire.eu because of a full-filed / partition because of a huge 8380 catelina.out log file (Katerina fixed it quickly and punished a guilty person)
990
  - Deployed vsftpd on openaire-www.vls (asked by Jochen), because it can be helpful for uploading metadata by enternal publishers (e.g. F-1000)
991
July 08, 2015:
992
  - Configured a reverse proxy for /search/api on beta.services.openaire.eu (asked by Katerina for an external parties)
993
July 07, 2015:
994
  - Modified a reverse proxy for guidelines.openaire.eu (asked by Jochen Schirrwagen). Now we use guidelines.readthedocs.org site instead of MediaWiki instance on posredni.vls
995
  - Made a backup of MediaWiki for guidelines.openaire.eu
996
  - Create a redirect rule for old URLs for MediaWiki for guidelines.openaire.eu
997
July 06, 2015:
998
  - jochen.schirrwagen added to "driver" group on beta.services.openaire.eu (see Redmine #"1378":https://issue.openaire.research-infrastructures.eu/issues/1378)
999
July 02, 2015:
1000
  - Restarted HBase on DM Hadoop cluster after nightly issues
1001
  - Enabled CNR LDAP authentication for the users of {beta,test}.openaire.eu (see Redmine #"1405":https://issue.openaire.research-infrastructures.eu/issues/1405)
1002
July 01, 2015: Rescued OpenAIRE2020 machines from a leap second armaggeddon
1003
June 30, 2015: Replaced a failed disk in slave4.hadoop.dm.openaire.eu
1004
June 29, 2015:
1005
  - Created a database for DFM on beta.services.openaire.eu (see Redmine #"1355":https://issue.openaire.research-infrastructures.eu/issues/1355)
1006
  - Configured Nginx on pilot.services.openaire.eu for supporting domain postgrantoapilot.openaire.eu instead of goldoapilot.openaire.eu (asked byStefania Martziou)
1007
June 26, 2015:
1008
  - Changed permissions for /var/lib/dfm on beta.services.openaire.eu on dnet:dnet (see Redmine #"1355":https://issue.openaire.research-infrastructures.eu/issues/1355)
1009
  - Disabled "monkeys" user on beta.services.openaire.eu (see Redmine #"1387":https://issue.openaire.research-infrastructures.eu/issues/1387)
1010
June 25, 2015:
1011
  - Open access to Redis & PostgreSQL port on beta.stats.openaire.eu from new.openaire.eu (asked by Eri)
1012
  - stefania.martziou added to "driver" group on pilot.services.openaire.eu and granted the same permissions like for Antonis to her (asked by Antonis)
1013
  - Created backup of Joomla on beta.openaire.eu, asked by Eri
1014
  - Synchronised beta.openaire.eu with new.openaire.eu (asked by Eri)
1015
  - Configured Nginx for a reverse proxy for DFM on beta.services.openaire.eu (see Redmine #"1387":https://issue.openaire.research-infrastructures.eu/issues/1387)
1016
June 19, 2015:
1017
  - eri.katsari, nikon.gasparis also added to "driver" group on beta.services.openaire.eu (see Redmine #"1378":https://issue.openaire.research-infrastructures.eu/issues/1378)
1018
June 18, 2015:
1019
  - andrea.manocci, sandro.labruzzo also added to "driver" group on beta.services.openaire.eu (see Redmine #"1378":https://issue.openaire.research-infrastructures.eu/issues/1378)
1020
  - Set the same rights in /etc/sudoers for "driver" group like for "monkeys" user
1021
  - Removed the rights from /etc/sudoers for the commands delivered by dnet-* packages, because they have been uninstalled during the distribution upgrade 
1022
June 17, 2015:
1023
  - Enabled CNR LDAP authentication for the users of beta.services.openaire.eu (see Redmine #"1378":https://issue.openaire.research-infrastructures.eu/issues/1378)
1024
  - alessia.bardi, claudio.atzori, michele.artini, antonis.lempesis, katerina.iatropoulou added to "driver" group there
1025
  - Mounted /home via NFS there
1026
June 16, 2015:
1027
  - Upgraded beta.services.openaire.eu from Ubuntu Precise to Trusty (see Redmine #"1355":https://issue.openaire.research-infrastructures.eu/issues/1355)
1028
June 15, 2015:
1029
  - michele.artini (CNR) added to "driver" group on gateway.hadoop.dm.openaire.eu (see Redmine #"1023":https://issue.openaire.research-infrastructures.eu/issues/1023)
1030
  - Open access to port 6379 (Redis) on new.openaire.eu from test.openaire.eu (asked by Eri)
1031
  - Open access to port 389 (Slapd) on new.openaire.eu from services.openaire.eu
1032
June 10, 2015:
1033
  - Restarted DataNodes & RegionServers of DM Hadoop cluster (see Redmine #"1367":https://issue.openaire.research-infrastructures.eu/issues/1367)
1034
  - Created backup of Joomla 3 on openaire-www.vls (aka new.openaire.eu), asked by Argiro
1035
June 9, 2015: Removed old logs of Oozie on master3.hadoop.iis.openaire.eu because of a lack of a free disk space on / partition
1036
June 8, 2015:
1037
  - Uploaded a fixed versions of Java SSL related .jar files (local_policy.jar & US_export_policy.jar) on services.openaire.eu and beta.services.openaire.eu (see Redmine #"1351":https://issue.openaire.research-infrastructures.eu/issues/1351)
1038
June 3, 2015:
1039
  - Fixed logrotate's config for rotating catalina.log and localhost_access.log on services.openaire.eu and beta.services.openaire.eu
1040
  - Killed hunged mongodump process on services.openaire.eu and restarted MongoDB there (see Redmine #"1342":https://issue.openaire.research-infrastructures.eu/issues/1342)
1041
  - giorgos.alexiou (ATHENA) added to "driver" group on gateway.hadoop.{dm,iis}.openaire.eu (asked by Eri)
1042
June 2, 2015: Open access to port 7911 (Thrift) on beta.services.openaire.eu from scoobydoo.di.uoa.gr (asked by Argiro)
1043
June 1, 2015:
1044
  - Set client_max_body_size 200M for Nginx on furkot2.vls (see Redmine #"1343":https://issue.openaire.research-infrastructures.eu/issues/1343)
1045
  - Set ssl = false for PostgreSQL on openaire-services-{beta,pilot}.vls, because we don't need SSL there
1046
May 31, 2015:
1047
  - Started PostgreSQL server on openaire-services.vls, because it was dead because of issues with permissions to a private SSL certificate
1048
  - Set ssl = false, because we don't need SSL there
1049
May 29, 2015:
1050
  - Untared and next bzipped the newest bunch of arXiv PDFs: arXiv_pdf_1412_*.tar & arXiv_pdf_150[1-3]_*.tar (see Redmine #"904":https://issue.openaire.research-infrastructures.eu/issues/904)
1051
May 28, 2015:
1052
  - Started container 8580 on openaire-services-pilot.vls, because it was dead (asked by Nikon)
1053
  - Disabled an user's authentication for goldoapilot.openaire.eu, because it's a public available now (asked by Antonis)
1054
May 28, 2015: Debuged an issue with sending messages from openaire-services-pilot.vls (asked by Nikon)
1055
May 26, 2015: Created a directory (/srv/www/static/openaire2020/wp10/deadlines/) on oscypek.vls for OpenAIRE2020 WP10 deadlines pages (asked by Mateusz Kobos)
1056
May 25, 2015: Installed php5-mcrypt package on openaire-www.vls (asked by Eri)
1057
May 22, 2015:
1058
  - Removed some old logs of IS (8280) and 8380's .hprof files on services.openaire.eu, because / partition was full-filled.
1059
  - Created backup of Joomla 3 on openaire-www.vls (aka new.openaire.eu), asked by Argiro
1060
  - Restored Joomla from furkot2 on test.openaire.eu, asked by Argiro
1061
May 21, 2015:
1062
  - Migrated a proxy rules for {blogs,box,guidelines,mining,validator}.openaire.eu from furkot2 (Nginx) to openaire-www.vls (Apache2)
1063
May 20, 2015:
1064
  - jyunyao.huang (UBONN) added to "driver" group on gateway.hadoop.dm.openaire.eu
1065
  - Migrated a proxy rules for api.openaire.eu from furkot2 (Nginx) to openaire-www.vls (Apache2)
1066
May 19, 2015:
1067
  - Created a new Piwik website for tracking UMINHO repository (asked by Dimitris)
1068
  - Restarted slave8.hadoop.dm.openaire.eu because of issue with Java zombie processes (see Redmine #"1326":https://issue.openaire.research-infrastructures.eu/issues/1326)
1069
May 14, 2015: Disabled authentication for /simplesaml requests on new.openaire.eu (asked by Eri, see Redmine #"1251":https://issue.openaire.research-infrastructures.eu/issues/1251)
1070
May 12, 2015:
1071
  - Installed python-pip and pymongo on beta.services.openaire.eu (asked by Sandro La Bruzzo, see Redmine #"1271":https://issue.openaire.research-infrastructures.eu/issues/1271)
1072
  - Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.12.0 to 2.13.1.
1073
May 11, 2015:
1074
  - Created NetApp volumes (4TB) for objectStore's PDFs files (see Redmine #"1271":https://issue.openaire.research-infrastructures.eu/issues/1271) adnd mounted via NFS on services.openaire.eu and beta.services.openaire.eu
1075
  - Deployed a new .war files of 8380 container on services.openaire.eu which includes a new settings of webapps log4j.properties
1076
May 8, 2015:
1077
  - Prepared Nginx rules (/validator-admin/ & /validator-service/) for a new production validator (see Redmine #"1303":https://issue.openaire.research-infrastructures.eu/issues/1303)
1078
  - Disabled the last changes for an access policy for goldoapilot.openaire.eu, now it's protected by a basic authentication again
1079
  - Installed python-pip and pymongo on services.openaire.eu (asked by Sandro La Bruzzo, see Redmine #"1271":https://issue.openaire.research-infrastructures.eu/issues/1271)
1080
May 7, 2015: Enabled an open access to goldoapilot.openaire.eu for NKUA's networks, the rest can see a static page
1081
May 6, 2015: Enabled a basic authentication for goldoapilot.openaire.eu, because it's still not ready for a public access (asked by Natalia)
1082
May 4, 2015: Applied a new logging.properties for 8280 and 8980 on beta.services.openaire.eu (see Redmine #"1289":https://issue.openaire.research-infrastructures.eu/issues/1289)
1083
April 30, 2015: Configured goldoa-pilot.openaire.eu as an alias for goldoapilot.openaire.eu 
1084
April 29, 2015:
1085
  - Antonis Lampesis added to the user aliases POSTGRES_ADMINS and DNET_ADMINS in /etc/sudoers on pilot.services.openaire.eu
1086
  - Configured goldoapilot.openaire.eu domain in DNS and Nginx for it on pilot.services.openaire.eu 
1087
  - Removed unused data folder jenshaarld.aasheim/ on box.openaire.eu (Jens Harald Aasheim changed his username to j.aasheim)
1088
April 28, 2015:
1089
  - Created backup of Joomla 3 on openaire-www.vls (aka new.openaire.eu), asked by Argiro
1090
  - Changed symlinks for the logs of 8280 (/var/log/dnet/is instead of /var/log/tomcat_dnet/8280) and 8980 (/var/log/dnet/provision instead of /var/log/tomcat_dnet/8980) containers on beta.services.openaire.eu and services.openaire.eu (see Redmine #"1289":https://issue.openaire.research-infrastructures.eu/issues/1289)
1091
  - Applied a new logging.properties for 8380 on beta.services.openaire.eu (see Redmine #"1289":https://issue.openaire.research-infrastructures.eu/issues/1289)
1092
April 24, 2015:
1093
  - Created backup of Joomla 3 on openaire-www.vls (aka new.openaire.eu), asked by Argiro
1094
  - Allowed access of new.openaire.eu to 7911 port on beta.services.openaire.eu, asked by Argiro
1095
April 19, 2015: Set log_min_duration_statement = 10000 in /etc/postgresql/9.1/main/postgresql.conf on stats.openaire.eu and beta.stats.openaire.eu
1096
April 17, 2015: Set log_min_duration_statement = 100 in /etc/postgresql/9.1/main/postgresql.conf on stats.openaire.eu and beta.stats.openaire.eu, because postgresql.log was too big because of many logged INSERT statements
1097
April 16, 2015: Created group "joomla" on openaire-www.vls (new.openaire.eu) in order to give NKUA people an access to Apache server logs
1098
April 14, 2015: Increased size of /srv2 partition (MongoDB's objectStore) on beta.services.openaire.eu from 1.5TB to 1.7TB (see Redmine #"1271":https://issue.openaire.research-infrastructures.eu/issues/1271)
1099
April 15, 2015: Deployed ci-test.hadoop.iis.openaire.eu, a new pseudo Hadoop cluster for running IIS integration tests (see Redmine #"781":https://issue.openaire.research-infrastructures.eu/issues/781)
1100
April 3, 2015: Deployed SimpleSAMLphp on new.openaire.eu (see Redmine #"1251":https://issue.openaire.research-infrastructures.eu/issues/1251)
1101
March 30, 2015: Removed unused Nginx proxy rules for /usagestats on furkot2 (asked by Eri)
1102
March 30, 2015: Restored /var/www/templates/yoo_solar/styles/openaire/css/*.css files from a weekly snapshot of the backup (asked by Argiro)
1103
March 30, 2015: Created /var/log/dnet/validator/ directory for the validator logs on openaire-services, openaire-services-beta and openaire-services-pilot (asked by Nikon)
1104
March 26, 2015: Created a new Piwik website for tracking the beta validator (asked by Nikon)
1105
March 25, 2015: Restored Joomla from furkot2 on new.openaire.eu, because it has been damaged by Natalia
1106
March 24, 2015: Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.11.0 to 2.12.0.
1107
March 24, 2015: Moved analytics.openaire.eu to piwik.vls.icm.edu.pl which is running under control of Debian Jessie (Apache 2.4.10 & PHP 5.6.6)
1108
March 24, 2015: Configured a reverse proxy (by Nginx) for La Referencia ("http://lareferencia.openaire.eu/)":http://lareferencia.openaire.eu/)
1109
March 24, 2015: Assisting during the upgrade of the openaire Joomla component on the production and 8380 container on services.openaire.eu (asked by Katerina Iatropoulou).
1110
March 23, 2015: Deployed Tomcat instances for Gold Open Access (see Redmine #"1168":https://issue.openaire.research-infrastructures.eu/issues/1168 and La Referencia (see Redmine #"1138":https://issue.openaire.research-infrastructures.eu/issues/1138), added permissions to Nikon Gasparis for managing PostgreSQL server and Tomcat services on openaire-services-pilot machine
1111
March 20, 2015: Fixed proxy rules for "http://api.openaire.eu/projects/":http://api.openaire.eu/projects/{dspace,eprints,tsv}/ requests, now handled by provision.war container at services.openaire.eu:8980 (see Redmine #"1136":https://issue.openaire.research-infrastructures.eu/issues/1136)
1112
March 17, 2015:
1113
  - Unpacked NKUA's .tar files with ArXiv PDF files (arXiv_pdf_1409_*.tar & arXiv_pdf_141[01]_*.tar)
1114
  - Created README file in /mnt/harvested_pdfs/ on openaire-services
1115
  - Compressed NKUA's .tar files (arXiv_pdf_130[89]_*.tar, arXiv_pdf_1409_*.tar & arXiv_pdf_141[01]_*.tar)
1116
March 9-11, 2015: Investigation on why home page of production portal ("http://www.openaire.eu/)":http://www.openaire.eu/) is so slowly (noticed by Natalia). The reason was a huge k0wx9_sh404sef_urls table of Joomla and long running SELECT queries which needed a few seconds to finish and get hundreds of thousands of records and many mega bytes of data.
1117
March 10, 2015: Configured on beta.openaire.eu a reverse proxy to new separated validator services (/validator, /validator-admin, /validator-service) (asked Nikon Gasparis)
1118
March 10, 2015: Directory /var/www/images/ writable for joomla user on furkot2, openaire-www, openaire-www-{beta,test} (asked Katerina)
1119
March 9, 2015: Created dnet.beta and dnet.production users on IIS Hadoop cluster (asked by Claudio and Marek Horst)
1120
March 9, 2015: Installed advancecomp package (which delivers advpng utility) for PNG optimization on furkot2, openaire-www, openaire-www-{beta,test} (asked Katerina)
1121
March 7, 2015: Increased (to 5GB) quota for najla.rettberg on "http://box.openaire.eu/":http://box.openaire.eu/, removed doubled account Najla.Rettberg
1122
March 6, 2015: Installed optipng & pngcrush packages for PNG optimization on furkot2, openaire-www, openaire-www-{beta,test} (asked Katerina)
1123
March 5, 2015: Deployed a new VM openaire-services-pilot for handling OpenAIRE pilot services, for example LaReferencia (#"1138":https://issue.openaire.research-infrastructures.eu/issues/1138) or Gold Open Access (see Redmine #"1168":https://issue.openaire.research-infrastructures.eu/issues/1168)
1124
March 4, 2015: Stopped PostgreSQL on furkot2, openaire-www, openaire-www-{beta,test}, because it's unused there
1125
March 3, 2015: Deployed a new VM openaire-www for upgrading the portal Joomla to version 3.x (asked by Natalia). It will replaces furkot2 in a few months.
1126
March 3, 2015: Integrated Piwik (analytics.openaire.eu) with guidelines.openaire.eu
1127
March 3, 2015: Configured Piwik (analytics.openaire.eu) for validator.openaire.eu, guidelines.openaire.eu, blogs.openaire.eu and goldpilot.openaire.eu (asked by Natalia)
1128
March 3, 2015: Created /user/dnet.beta and /user/dnet.production directories in DM HDFS (asked by Claudio and Marek Horst)
1129
March 3, 2015: Created backup of /var/www/components/com_openaire/ and /var/www/templates/yoo_solar/ directories on openaire-www-beta and assisting during the upgrade of the openaire Joomla component
1130
March 2, 2015: Created /user/dnet.beta and /user/dnet.production directories in IIS HDFS (asked by Claudio and Marek Horst)
1131
March 2, 2015: Fixed LDAP settings on "http://box.openaire.eu/":http://box.openaire.eu/ broken by Natalia
1132
February 27, 2015: Removed doubled account Natalia.manola on "http://box.openaire.eu/":http://box.openaire.eu/
1133
February 20, 2015: Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.10.0 to 2.11.0.
1134
February 17, 2015: Increased memory from 16GB to 24GB on openaire-solr and openaire-solr-beta machines (see Redmine #"1136":https://issue.openaire.research-infrastructures.eu/issues/1136)
1135
February 16, 2015: Fixing a broken search feature of the portal ("https://www.openaire.eu/search/find)":https://www.openaire.eu/search/find) because of java.lang.OutOfMemoryError on openaire-solr machine with the index (please Redmine issue #"1136":https://issue.openaire.research-infrastructures.eu/issues/1136)
1136
February 11, 2015: Added SSH public key of Andrea Mannocci to authorized_keys of "monkeys" user
1137
February 10, 2015: Deployed OwnCloud instance at "https://box.openaire.eu/":https://box.openaire.eu/ (asked by Natalia)
1138
February 6, 2015: Made /srv/www/joomla/api-docs/ on furkot2 writable for "www-data" group (and "joomla" user) (asked by Natalia who wanted to change CSS)
1139
February 4, 2015: Created accounts on the gateway of DM Hadoop cluster for Sahar Vahdati and Christoph Lange from UBONN (please see Redmine issue #"1089":https://issue.openaire.research-infrastructures.eu/issues/1089).
1140
February 4, 2015: Configured a proxy rule for a new API exporting TSV of projects (please see Redmine issue #"1106":https://issue.openaire.research-infrastructures.eu/issues/1106).
1141
February 2, 2015: Renamed the mailing list openaireplus-wp7@bwnmail.icm.edu.pl to openaire-mining@bwnmail.icm.edu.pl (asked by Mateusz Kobos).
1142
January 30, 2015: Increased size of /srv2 partition (from 2 TB to 2.4 TB) on services.openaire.eu.
1143
January 27, 2015: Increased size of /srv3 partition (from 400 GB to 600 GB) on services.openaire.eu.
1144
January 26, 2015: Increased value of Nginx timeouts on www.openaire.eu (please see Redmine issue #"1079":https://issue.openaire.research-infrastructures.eu/issues/1079).
1145
January 26, 2015: Increased size of /srv partition (from 450 GB to 500 GB) on services.openaire.eu.
1146
January 23, 2015: Increased size of /srv partition (from 400 GB to 450 GB) on services.openaire.eu.
1147
January 23, 2015: Installed xmlstarlet package on services.openaire.eu and beta.services.openaire.eu (asked by Alessia Bardi, please see Redmine issue #"1076":https://issue.openaire.research-infrastructures.eu/issues/1076).
1148
January 22, 2015: Assisting during the upgrade of the openaire Joomla component on the production and 8380 container on services.openaire.eu (asked by Katerina Iatropoulou). Fixed the write permissions to /var/www/joomla/components/com_openaire/ directory for joomla user on beta.openaire.eu.
1149
January 16, 2015: Synchronised test.openaire.eu with the production (asked by Katerina Iatropoulou).
1150
January 14, 2015: Assisting during the upgrade of 8380 container on services.openaire.eu (asked by Katerina Iatropoulou).
1151
January 7, 2015: Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.9.1 to 2.10.0.