Project

General

Profile

D64 Servers Administration Operations Changelog » History » Version 4

Marek Horst, 15/06/2018 12:06 PM
Supplementing 2nd period with tasks recorded in redmine for 2017

1 1 Marek Horst
h1. Change Log for servers administration operations
2
3 2 Marek Horst
h2. 2nd Period (14/12/2016 - 30/06/2018)
4
5 4 Marek Horst
2nd period list of tasks was based on tickets defined in OpenAIRE's redmine issue tracker and mantis - ICM's internal task tracker.
6
7 2 Marek Horst
June 2018:
8
9
May 2018:
10
11 3 Marek Horst
* "mantis#9574":https://mantis.icm.edu.pl/view.php?id=9574 Uploading (repeatedly) two updated configuration files required by integration tests suite on ci.ceon.pl
12 2 Marek Horst
13
April 2018:
14
15 3 Marek Horst
* "mantis#9736":https://mantis.icm.edu.pl/view.php?id=9736 Making ResourceManager being responsive again on IIS CI Test cluster
16 2 Marek Horst
17
March 2018:
18
19
February 2018:
20
21
January 2018:
22
23
December 2017:
24 4 Marek Horst
* #2284	 www.openaire.eu returns sometimes ERR_CONNECTION_REFUSED
25
* #3362	Clean up tmp diretory of services.openaire.eu
26
* #3334	user account
27
* #2855	Prepare dedicated machine for PTM
28
* #3348	Unable to connect with sites via HTTPS requiring AES 256 ciphers
29
* #3354	Remove authentication from demo.openaire.eu
30
* #3301	monitor.openaire.eu/administrator returns internal server error
31
* #3212	OpenAIRE newsletter statistics
32
* #3333	guidelines.openaire.eu does not rebuild from github repo sources
33
* #3312	Connection problem to hadoop
34 2 Marek Horst
35
November 2017:
36 4 Marek Horst
* #3329	In demo.openaire.eu: add alias  beta.explore.openaire.eu
37
* #3325	api.openaire.eu: add hostname develop.openaire.eu
38
* #2809	Bots and deep paging 
39
* #3306	is there a postgres available for beta.repomanager.openaire.eu
40
* #3261	New node js app for demo portal
41
* #3294	Freestyle support plugin, need of a table
42
* #3241	provide access to the hadoop cluster
43
* #3017	A new vm machine for monitoring - Joomla
44
* #3287	check monitor.openaire.eu after rrecovery due to crash
45
* #3284	www.openaire.eu returns 403 forbidden
46
* #3159	503 Service Unavailable when opening 10 tabs with publication details
47
* #3277	install curl on gateway.hadoop.dm.openaire.eu
48
* #2984	A new vm machine for Joomla
49
* #3279	please help with ssh login
50
* #2597	Bad response from api.openaire.eu/oai_pmh
51 2 Marek Horst
52
October 2017:
53 4 Marek Horst
* #3223	Need to run dist-upgrade on beta.services.openaire.eu and services.openaire.eu
54
* #2566	Stats tab of big aggregators like La Referencia does not load in reasonable time
55
* #3217	Domain for datathon
56
* #3179	New api documentation pages
57
* #3160	URL encoding: different settings on beta and production?
58
* #3143	Production upgrade to Java8
59 2 Marek Horst
60
September 2017:
61 4 Marek Horst
* #3161	Update proxy mappings for api.openaire.eu
62
* #2950	Upgrade beta aggregator to java8
63
* #3121	Disable connections from beta.services.openaire.eu to postgresql.services.openaire.eu
64
* #3083	Federeted Queries over SPARQL endpoint give different results
65 3 Marek Horst
66
August 2017:
67 4 Marek Horst
* #3071	CNR LDAP - request for account
68 3 Marek Horst
69 1 Marek Horst
July  2017:
70 4 Marek Horst
* #3016	Problem accessing project API: 503 Service Unavailable 
71
* #2840	setup ldap authentication for OCEAN hadoop services
72
* #2999	New spring boot web application to deploy
73
* #2549	Machine for a new portal
74
* #2246	investigate usage of api.openaire.research-infrastructures.eu
75
* #2876	LOD Ontology (vocabs)
76
* #3006	enable CORS at analytics.openaire.eu/piwik.php
77
* #2541	Enable CORS for Vocabularies API
78
* #2313	dismiss dnet-hadoop-parent
79
* #2763	struts2 vulnerability in the validator
80
* #2754	Hardening the services machines
81
* #2998	analytics.openaire.eu is not responding
82
* #2979	Spark History Server on IIS cluster is down
83
* #2974	enable access from claims service to user-management service
84 2 Marek Horst
* "mantis#9693":https://mantis.icm.edu.pl/view.php?id=9693 Making spark history server available again on CDH5 cluster
85
* "mantis#9675":https://mantis.icm.edu.pl/view.php?id=9675 Fixing spark history server webapp returning 503 error
86
* "mantis#9654":https://mantis.icm.edu.pl/view.php?id=9654 Configuring apache httpd on hadoop clusters
87 3 Marek Horst
* "mantis#9525":https://mantis.icm.edu.pl/view.php?id=9525 Adjusting puppeta and monit configuration on hadoop-ci-test
88 2 Marek Horst
* "mantis#9738":https://mantis.icm.edu.pl/view.php?id=9738 Dropping openaire libs out of local maven repo on jenkins machine
89
* "mantis#9737":https://mantis.icm.edu.pl/view.php?id=9737 Providing jenkins worker SSH access to iis-ci-test.ocean.icm.edu.pl
90 1 Marek Horst
91
June 2017:
92 4 Marek Horst
* #2968	information system backup frequency
93
* #2957	openaire-dm-hadoop-s4 problems
94
* #2945	Pilot proxy changes
95
* #2463	trigger the generation of $idsite in Piwik for dataproviders
96
* #2705	new datasource: glasstree
97
* #2947	IIS CDH5 Ocean cluster is down
98
* #1828	Monitor the access to the OpenAIRE API
99
* #2865	Access to Google webmaster tools
100
* #2914	jobtracker(s) temporarily unavailable 
101
* #2323	Limit access to the direct index API
102
* #2798	catalina.out of 8280: record is not compliant, transformation is interrupted.
103 2 Marek Horst
* "mantis#9735":https://mantis.icm.edu.pl/view.php?id=9735 Fixing IIS build failures
104 1 Marek Horst
105
May 2017:
106 4 Marek Horst
* #2813	Preparing demo.openaire.eu
107
* #2837	User Management log files
108
* #2804	Enable https in demo.openaire.eu
109
* #2639	More RAM for openaire-solr-beta.vls
110
* #2580	Environment Preparation
111
* #2761	Different containers logs design for a production & beta services
112
* #2800	Cannot login on the validator
113
* #2831	Metrics API
114
* #2825	disk space on beta solr server
115
* #2812	"dnet8480" in 8480 has no "w" rights on /var/log/dnet/search/
116
* #2817	UBONN access to ocean cluster
117 1 Marek Horst
118
April 2017:
119 4 Marek Horst
* #2477	Use cached values for information coming from IS
120
* #2799	More RAM for openaire-services.vls
121
* #2790	Different size of PostgreSQL "stats" databases on openaire-stats-beta.vls and openaire-stats.vls
122
* #2771	create dnet8280 user on DM cluster
123
* #2769	Shutdown of furkot2 (aka old.openaire.eu)
124 1 Marek Horst
* "mantis#9725":https://mantis.icm.edu.pl/view.php?id=9725 Hooking up OpenAIRE IIS with sonar.ceon.pl
125
* "mantis#9678":https://mantis.icm.edu.pl/view.php?id=9678 Optimizing memory configuration IIS CDH5 cluster
126
127
March 2017: 
128 4 Marek Horst
* #2760	Copy directories from netapp1-nfs:/vol/openaire_objectstore_pdfs to netapp2-nfs:/vol/openaire_beta_objectstore_pdfs
129
* #2758	Switching api.openaire.eu from furkot2.vls to openaire-www.vls
130
* #2753	Need access to the IIS HDFS
131
* #2249	jobtracker returns error 500
132
* #2581	Virtuoso for LOD production
133
* #2175	MongoDB backend for the production services
134
* #2584	ftp account for exeley
135
* #2431	Piwik Authentication Token
136
* #2280	google fails to fetch robots.txt
137
* #2520	Java and SSL: Could not generate DH keypair
138
* #2051	Jobtracker@DM error 500
139 3 Marek Horst
* "mantis#9723":https://mantis.icm.edu.pl/view.php?id=9723 Fixing lost node on hadoop-ci-test.vls.icm.edu.pl
140 1 Marek Horst
* "mantis#9724":https://mantis.icm.edu.pl/view.php?id=9724 Providing access to yarn web interfaces on hadoop-ci-test
141
* "mantis#9719":https://mantis.icm.edu.pl/view.php?id=9719 Fixing Resource Manager failures ON IIS CI Test cluster
142
* "mantis#9709":https://mantis.icm.edu.pl/view.php?id=9709 Renaming OCEAN cluster hosts
143
144
February 2017:
145 4 Marek Horst
* #2513	Gathering portal piwik logs for website usage analysis
146
* #2637	DIGITAL.CSIC Piwik Tracking
147
* #2426	Comparison of usage logs
148
* #2603	[solr.openaire.eu] memory size
149
* #2594	Piwik Robots List Update
150
* #2393	Migration to new Cluster and SPARK for LOD
151 3 Marek Horst
* "mantis#9691":https://mantis.icm.edu.pl/view.php?id=9691 Updating iis-ci-test.ocean.icm.edu.pl requirements
152 1 Marek Horst
* "mantis#9699":https://mantis.icm.edu.pl/view.php?id=9699 Fixing random documents classification failures 
153
* "mantis#9710":https://mantis.icm.edu.pl/view.php?id=9710 Considering upgrade to 5.10.0, assessing potential risks
154
* "mantis#9711":https://mantis.icm.edu.pl/view.php?id=9711 Fixing virtual name node name resolution on CDH5 IIS cluster
155 3 Marek Horst
* "mantis#9716":https://mantis.icm.edu.pl/view.php?id=9716 Dealing with Internal Server Error on IIS OCEAN CDH5 cluster master nodes
156
157 1 Marek Horst
January 2017:
158 4 Marek Horst
* #2524	SSLHandshakeException when updating BETA stats caches 
159
* #2565	Security problem: SOAP methods are not protected
160
* #2558	ldap permissions to access test.openaire.eu
161 2 Marek Horst
* "mantis#9695":https://mantis.icm.edu.pl/view.php?id=9695 Fixing DataNode unavailable to NameNode on iis-ci-test.ocean.icm.edu.pl
162
163
December 2016:
164 4 Marek Horst
* #2494	Stats update job failed on BETA
165
* #2511	IIS CDH4 cluster resource re-allocation
166
* #2521	Secured access to mining.openaire.eu
167
* #2523	wild tomcat running on services.openaire.eu
168 3 Marek Horst
* "mantis#9688":https://mantis.icm.edu.pl/view.php?id=9688 Updating CDH5 cluster versions to 5.9.0 
169
* "mantis#9687":https://mantis.icm.edu.pl/view.php?id=9687 Purging and reallocating old CDH4 cluster resources
170
* "mantis#9636":https://mantis.icm.edu.pl/view.php?id=9636 Fixing CDH5 integration test cluster jobs deadlock
171
* "mantis#9631":https://mantis.icm.edu.pl/view.php?id=9631 Upgrading CDH5 integration test cluster
172 2 Marek Horst
173 1 Marek Horst
h2. 1st Period (01/01/2015 - 13/12/2016)
174
175
December 13, 2016:
176
  - Updated Oozie sharelibs on ci-test.hadoop5.iis.openaire.eu, see Mantis #"9691":https://mantis.icm.edu.pl/view.php?id=9691
177
  - Generated SSL cert signed by Let's Encrypt for mining.openaire.eu and enabled HTTPS for that site, see Redmine #"2521":https://issue.openaire.research-infrastructures.eu/issues/2521
178
  - Removed old and unused LVM volumes on Xen openaire-dm-hadoop[45]-dom0 machines (they replaced openaire-iis-hadoop[12]-dom0)
179
  - Created LVM volumes for openaire-dm-hadoop-s[11-16] on openaire-dm-hadoop[45]-dom0, see Redmine #"2511":https://issue.openaire.research-infrastructures.eu/issues/2511
180
December 12, 2016:
181
  - Deployed iis-ci-test.ocean.icm.edu.pl, a new pseudo Hadoop cluster for running IIS integration tests on CDH5, see Mantis #"9688":https://mantis.icm.edu.pl/view.php?id=9688
182
  - Created a new pseudo Hadoop cluster (IIS CI Test) for running IIS integration tests on CDH5 maintained by Cloudera Manager on eos-cr-mgmt1.ocean.icm.edu.pl, see above
183
December 09, 2016:
184
  - Upgraded CDH (from 5.7.5 to 5.9.0) also on ci-test.hadoop5.iis.openaire.eu, see Mantis #"9681":https://mantis.icm.edu.pl/view.php?id=9681
185
  - Removed HBase from ci-test.hadoop5.iis.openaire.eu, see above
186
  - Shutdowned all machines of the old IIS CDH4 Hadoop cluster, see Redmine #"2512":https://issue.openaire.research-infrastructures.eu/issues/2512
187
  - Shutdowned openaire-iis-hadoop4-dom0 machine
188
  - Renamed openaire-iis-hadoop1-dom0 machine to openaire-dm-hadoop4-dom0 and openaire-iis-hadoop2-dom0 machine to openaire-dm-hadoop5-dom0
189
December 08, 2016:
190
  - Upgraded CDH (from 5.7.5 to 5.9.0) on OCEAN IIS CDH5 Test cluster, see Mantis #"9681":https://mantis.icm.edu.pl/view.php?id=9681
191
December 07, 2016:
192
  - Created a ticket for announcing shutdown of IIS CDH4 Hadoop cluster (see Redmine #"2511":https://issue.openaire.research-infrastructures.eu/issues/2512)
193
  - Upgraded Cloudera Manager agents for OCEAN IIS CDH5 Test cluser from 5.7.0 to 5.9.0 because of Cloudera Manager server upgrade
194
December 06, 2016:
195
  - Closed the Redmine tickets #2344, #2431, #2463
196
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.16.5 to 2.17.1.
197
December 02, 2016:
198
  - Added missing index.html files in components/, modules/ and plugins/ subdirectories of the portal Joomla, see Redmine #"2484":https://issue.openaire.research-infrastructures.eu/issues/2484
199
  - Removed Disallow: lines from robots.txt of the portal Joomla for those subdirectories, see above
200
December 01, 2016:
201
  - Removed HBase from OCEAN IIS CDH5 Test cluster, see Mantis #"9678":https://mantis.icm.edu.pl/view.php?id=9678
202
  - Tuned some OCEAN IIS CDH5 Test settings for YARN (yarn.nodemanager.resource.cpu-vcores=40, yarn.nodemanager.resource.memory-mb=92GB), see above
203
  - Started ntpd on openaire-www-(proxy|front|back)2, because it seems it was inactive (dead), hint: "Could not send report: SSL_connect returned=1 errno=0 state=error: certificate verify failed.  This is often because the time is out of sync on the server or client"
204
November 30, 2016:
205
  - Fixed a broken backup of MongoDB on openaire-services.vls, because it failed a few days ago (November 26)
206
  - Enabled a backup of MongoDB on openaire-services-mongodb.vls
207
  - Removed an old & stale backup of MongoDB on openaire-services-beta.vls
208
  - Enabled a backup of MongoDB & PostgreSQL on openaire-services-beta.vls
209
  - Recreated a broken SSL cert for Puppet on openaire-www-(proxy|front|back)2.vls (Could not request certificate: stack level too deep)
210
  - Upgraded CDH (from 5.5.2 to 5.7.5) on OCEAN IIS CDH5 Test cluster because of CVE-2016-5393 Apache Hadoop Privilege escalation vulnerability, see Mantis #"9681":https://mantis.icm.edu.pl/view.php?id=9681
211
  - Fixed timezone on OCEAN IIS CDH5 Test cluster machines (now we use GMT everywhere), see above
212
  - Fixed /proc/sys/vm/swappiness on iis-cdh5-test-gw & iis-cdh5-test-m[1-3] machines, see above
213
  - Fixed /sys/kernel/mm/transparent_hugepage/defrag on eos-m2-sn40 machine, see above
214
  - Upgraded CDH (from 5.5.2 to 5.7.5) also on ci-test.hadoop5.iis.openaire.eu, see above
215
November 29, 2016:
216
  - Fixed Apache configuration of "http://guidelines.openaire.eu/":http://guidelines.openaire.eu/ for DocumenRoot
217
November 28, 2016:
218
  - Purged the old logs of HDFS NameNode, balancer and Zookeeper on namenode1.hadoop.dm.openaire.eu because of a near full-filled / partition
219
  - Fixed Exim4 aliases on namenode1.hadoop.dm.openaire.eu & master1.hadoop.iis.openaire.eu in order to send to me the messages from HDFS balancer script launched by Cron (Mail delivery failed: returning message to sender: hdfs@namenode1.hadoop.dm.openaire.eu retry timeout exceeded)
220
  - Tuned yarn.scheduler.maximum-allocation-mb (16GB) YARN setting of OCEAN IIS CDH5 Test cluster, see Mantis #"9678":https://mantis.icm.edu.pl/view.php?id=9678
221
  - Stopped HBase of OCEAN IIS CDH5 Test cluster, see above
222
  - Updated and restarted openaire-www-(proxy|front|back)1.vls & openaire-www-front3 machines
223
  - Started, updated and restarted again openaire-www-(proxy|front|back)2.vls machines
224
November 25, 2016:
225
  - Tuned yarn.scheduler.maximum-allocation-vcores (6) YARN setting of OCEAN IIS CDH5 Test cluster, see Mantis #"9678":https://mantis.icm.edu.pl/view.php?id=9678
226
November 24, 2016:
227
  - Recreated a broken SSL cert for Puppet on openaire-iis-hadoop3-dom0.vls (Could not send report: SSL_CTX_use_PrivateKey:: key values mismatch)
228
November 23, 2016:
229
  - Fixed Apache configuration for a reverse proxy for CM on eos-cr-mgmt1.ocean.icm.edu.pl, because the clusters settings were changable only in a classic layout of CM, see Cloudera Case #"117145":https://cloudera-portal.force.com/5003400000spXmZ
230
  - Fixed robots.txt of OpenAIRE portal, because Googlebot couldn't grab images/CSS/JavaScript/etc, see Redmine #"2484":https://issue.openaire.research-infrastructures.eu/issues/2484
231
November 22, 2016:
232
  - Recreated a broken SSL cert for Puppet on openaire-www-test.vls (Could not send report: SSL_CTX_use_PrivateKey:: key values mismatch)
233
  - Tuned some OCEAN IIS CDH5 Test settings for YARN (mapreduce.map.memory.mb=0, mapreduce.map.java.opts.max.heap=1638MB, mapreduce.reduce.memory.mb=0, mapreduce.reduce.java.opts.max.heap=3276MB), see Mantis #"9678":https://mantis.icm.edu.pl/view.php?id=9678
234
November 21, 2016:
235
  - Started container 8480 on openaire-services.vls, because it crashed by night, see Redmine #"2477":https://issue.openaire.research-infrastructures.eu/issues/2477
236
  - Fixed owner of /var/log/nginx/ directory (from www-data: to root:) on furkot2, because of CVE-2016-1247 vulnerability against Nginx, for more details see "https://legalhackers.com/advisories/Nginx-Exploit-Deb-Root-PrivEsc-CVE-2016-1247.html":https://legalhackers.com/advisories/Nginx-Exploit-Deb-Root-PrivEsc-CVE-2016-1247.html
237
  - Fixed Apache configuration of "http://guidelines.openaire.eu/":http://guidelines.openaire.eu/ for /robots.txt & /favicon.ico requests
238
  - Allowed connections to OpenAIRE Piwik from Dimitris Pierrakos machine without authentication against CNR LDAP server, because he needs it for sending requests to Piwik API
239
November 18, 2016:
240
  - michal.politowski added to groups "driver" & "joomla" on openaire.vls, because he wants to see the Apache logs
241
  - Moved /etc/apache2/sites-enabled/joomla.conf to /etc/apache2/sites-enabled/000-joomla.conf after Michal Politowski email about OpenAIRE portal SEO (hint SNI)
242
  - Fixed Google Analytics JavaScript code URL (from HTTP to HTTPS) on the portal using Apache's mod_substitute directive, see Redmine #"2449":https://issue.openaire.research-infrastructures.eu/issues/2449
243
November 17, 2016:
244
  - Started HBase-Master on openaire-dm-hadoop-hb-m1.vls because it was dead
245
  - Created "usage_openaire" account in Piwik and granted him the view access for all current and future websites we truck by Piwik, see Redmine #"2431":https://issue.openaire.research-infrastructures.eu/issues/2431
246
  - Created HDFS home directory for giorgos.alexiou on OCEAN IIS CDH5 Test cluster, see Redmine #"2393":https://issue.openaire.research-infrastructures.eu/issues/2393
247
November 16, 2016:
248
  - Tested the PHP script addsite.php for creating a new Piwik websites, see Redmine #"2463":https://issue.openaire.research-infrastructures.eu/issues/2463
249
  - Added the trusted NKUA/NTUA/Athena RC networks on the firewall of OCEAN IIS CDH5 Test cluster gateway, see Redmine #"2393":https://issue.openaire.research-infrastructures.eu/issues/2393
250
  - Added giorgos.alexiou to "driver" group there, see above
251
November 15, 2016:
252
  - Installed Java 8 on openaire-virtuoso-beta, asked by Shirin Ameri, see Redmine #"2344":https://issue.openaire.research-infrastructures.eu/issues/2344
253
  - Discussion about generating automatically $idsite of Piwik for a new aggregated repos, see Redmine #"2463":https://issue.openaire.research-infrastructures.eu/issues/2643
254
  - Started working on a PHP script for creating a new Piwik websites, see above
255
November 14, 2016:
256
  - Upgraded and restarted the production machines (furkot2, openaire-www, openaire-stats, openaire-solr, openaire-services, openaire-services-mongodb, openaire-services-postgresql, openaire-virtuoso) with a new kernel fixed against Dirty COW bug, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
257
November 10, 2016:
258
  - Added shirin.ameri to "driver" group on openaire-virtuoso-beta.vls, see Redmine #"2344":https://issue.openaire.research-infrastructures.eu/issues/2344
259
November 08, 2016:
260
  - Closed the Redmine tickets #2100, #2342
261
November 07, 2016:
262
  - Further cleaning of infected Wordpress on "https://blogs.openaire.eu/:":https://blogs.openaire.eu/: removed infected themes (guardian, twentythirteen & twentytwelve), restored infected wp-content/themes/wp-pinup/header.php file
263
  - Fixed sudo config on gateway.hadoop.iis.openaire.eu (now `sudo su - dnet ...` & `sudo su dnet ...` commands are defined separately), reported by K.Zamlynska
264
  - Fixed also sudo on gateway.hadoop.dm.openaire.eu, see above
265
  - Increased a NFS volume openaire_beta_objectstore_pdfs mounted on beta.services.openaire.eu as /mnt/objectstore_pdfs from 6TB to 8TB, because it was filled in 100%
266
  - Restarted Spark History Server of OCEAN CDH5 Test cluster, because it seemed to be dead, reported by M.Horst, see Mantis #"9675":https://mantis.icm.edu.pl/view.php?id=9675
267
November 04, 2016:
268
  - Cleaned infected Wordpress on "https://blogs.openaire.eu/":https://blogs.openaire.eu/
269
  - Sent to Claudio the current numbers of the hardware resources at ICM
270
  - Downgraded Java 8u91 to 8u66 on ci-test.hadoop5.iis.openaire.eu, because of a problem with Oozie, reported by M.Horst, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
271
November 03, 2016:
272
  - Renewed SSL cert of Puppet for all OpenAIRE machines at ICM because of expired Puppet master SSL cert
273
  - Fixed a network issue on eos-m2-gw machine where iis-cdh5-test-gw is hosted after its reboot, reported by M.Horst, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
274
  - Enabled IP forwarding on the OCEAN IIS CDH5 Test cluster gateway, but it won't be used because the cluster slaves get IP address and a default gateway from DHCP server...
275
  - Fixed broken routing on a default gateway for the OCEAN IIS CDH5 Test cluster after its reboot (hint: net.ipv4.ip_forward=1 & net.ipv4.conf.all.rp_filter=0), reported by M.Horst, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
276
  - Purged the old logs of HDFS, YARN and Oozie on ci-test.hadoop5.iis.openaire.eu because of a near full-filled / partition
277
November 02, 2016:
278
  - Closed the Redmine tickets #2249, #2284, #2311, #2323, #2330, #2344, #2375
279
  - Configured clustershell for OCEAN IIS CDH5 Test cluster on the cluster gateway
280
  - Upgraded and restarted OCEAN IIS CDH5 Test cluster related machines (iis-cdh5-test-gw, iis-cdh5-test-m[1-3], eos-m2-gw, eos-m2-mn[1-3], eos-m2-sn0[1-8], eos-m2-sn[35-42]) with a new kernel fixed against Dirty COW bug, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
281
  - Erased "chrony" package from some OCEAN IIS CDH5 Test cluster related machines, because there was in a conflict with "ntpd" service
282
  - Upgraded and restarted openaire-beta-(www|stats|solr|services).vls and openaire-services-pilot with a new kernel fixed against Dirty COW bug, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
283
October 28, 2016:
284
  - Upgraded and restarted openaire-www-test.vls with a new kernel fixed against Dirty COW bug, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
285
  - Upgraded and restarted openaire-dm-hadoop[1-3]-dom0 with a new kernel fixed against Dirty COW bug, see above
286
  - Upgraded and restarted openaire-iis-hadoop[1-4]-dom0 with a new kernel fixed against Dirty COW bug, see above
287
October 27, 2016:
288
  - Started 8380 on openaire-services-pilot.vls, because it was dead, reported by Natalia
289
  - Added forgotten monitoring of 8380 on openaire-services-pilot.vls, see above
290
October 24, 2016:
291
  - Fixed sudo for becoming "dnet" user on DM/IIS Hadoop cluster gateway, see Redmine #"2413":https://issue.openaire.research-infrastructures.eu/issues/2413
292
  - Increased size (from 400GB to 500GB) of /srv partition on beta.solr.openaire.eu
293
October 21, 2016:
294
  - Allowed connections from DM Hadoop cluster to MongoDB on mongodb.services.openaire.eu, see Redmine #"2175":https://issue.openaire.research-infrastructures.eu/issues/2175
295
October 19, 2016:
296
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.16.2 to 2.16.5.
297
  - Upgraded ownCloud on box.openaire.eu from 8.2.2 to 8.2.7
298
October 18, 2016:
299
  - Fixed a content of /var/run/tomcat7.pid file on openaire-virtuoso-beta.vls, because Monit unmonitored Tomcat there, but it was running well
300
  - Generated Let's Encrypt SSL certificates for (beta.)virtuoso.openaire.eu
301
  - Closed Redmine #"2390":https://issue.openaire.research-infrastructures.eu/issues/2390 ticket
302
  - Upgraded ownCloud on box-test.openaire.eu from 8.2.2 to 8.2.7
303
October 17, 2016:
304
  - Generated Let's Encrypt SSL certificates for (analytics|api|beta|beta.services|box|box-test|goldoapilot|lareferencia|old|services|validator).openaire.eu
305
October 7, 2016:
306
  - Generated and installed a test SSL cert from Let's Encrypt CA on test.openaire.eu
307
  - Generated only a new SSL cert from Let's Encrypt CA on www.openaire.eu, because Natalia don't want to buy a new one (see Redmine #"2291":https://issue.openaire.research-infrastructures.eu/issues/2291)
308
October 6, 2016:
309
  - Started Spark Worker on ci-test.hadoop5.iis.openaire.eu
310
  - Firewall rules for Hadoop daemons web UIs cleanup, see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567
311
October 5, 2016:
312
  - Enabled an access to port 8980 on openaire-services.vls and openaire-services-beta.vls from OCEAN IIS Hadoop, see Redmine #"2352":https://issue.openaire.research-infrastructures.eu/issues/2352
313
October 4, 2016:
314
  - Enabled an access to openaire-services-(mongodb|postgresql).vls via SSH from CNR IPv6 network, see Redmine #"2175":https://issue.openaire.research-infrastructures.eu/issues/2175
315
  - Enabled IPv6 support for MongoDB on openaire-services-mongodb.vls, see above
316
October 3, 2016:
317
  - Enabled an access from openaire-services.vls to 27017 port (MongoDB) on openaire-services-mongodb.vls, see Redmine #"2175":https://issue.openaire.research-infrastructures.eu/issues/2175
318
September 30, 2016:
319
  - Investigated an issue with Oozie and MySQL timeouts, see Redmine #"2324":https://issue.openaire.research-infrastructures.eu/issues/2324
320
SEPTEMBER 29, 2016:
321
  - Restarted 8580 container on openaire-services-pilot.vls, because it seems that it hanged (the process was running, but it wasn't listening at 8580 port)
322
September 28, 2016:
323
  - Upgraded CDH (from 4.3.1 to 4.7.0) on DM Hadoop cluster, see Redmine #"2324":https://issue.openaire.research-infrastructures.eu/issues/2324
324
  - Upgraded Java (from 7u80 to 8u101) there, see above
325
September 27, 2016:
326
  - Removed the old logs (from 2012 to 2014) of koprowy on the logserver on mnich because of a lack of free disk space on / there
327
September 26, 2016:
328
  - Reported an error with sh404sef plugin of a production Joomla (Sh404sefHelperLanguage::getUrlCodeFromTag::182:  Language tag en-GB not in installed language list), see Redmine #"2342":https://issue.openaire.research-infrastructures.eu/issues/2342
329
  - Purged the old logs of HDFS, YARN and Oozie on ci-test.hadoop5.iis.openaire.eu because of a near full-filled / partition
330
  - Investigated Alessia's issue with accessing 8980 on openaire-services.vls and openaire-services-beta.vls, see Redmine #"2323":https://issue.openaire.research-infrastructures.eu/issues/2323
331
  - Added Alessia's IP address to a list of IPs allowed to access 8980 on both services machines, see above
332
  - Created a Cron job for "postgres" user on openaire-services-postgresql.vls and openaire-services-beta.vls for refreshing some materialized views of dnet_openaireplus database, asked by Alessia, see Redmine #"2343":https://issue.openaire.research-infrastructures.eu/issues/2343
333
  - Set Nginx rules for authentication of "https://services.openaire.eu/is/mvc/api/publications/":https://services.openaire.eu/is/mvc/api/publications/, see Redmine #"2323":https://issue.openaire.research-infrastructures.eu/issues/2323
334
September 24, 2016:
335
  - Removed the old Joomla backups and gzipped sh404sef logs because of lack of free disk space on /srv on openaire-www.vls
336
September 23, 2016:
337
  - Investigating an issue with offline regions of HBase on DM Hadoop cluster, reported by Claudio, Alessia and Tsampikos
338
  - Restarted HBase masters of DM Hadoop cluster
339
September 21, 2016:
340
  - Helping with an issue with Jenkins for IIS, see Mantis #"9656":https://mantis.icm.edu.pl/view.php?id=9656
341
  - Restarted openaire-www.vls in order to increase its resources (8GB -> 18GB RAM, 4 CPU cores -> 8 CPU cores), see Redmine #"2330":https://issue.openaire.research-infrastructures.eu/issues/2330
342
  - Decreased CPU of openaire-www.vls (8 CPU cores -> 6 CPU cores) and restarted it again because of issue with a big load, the stolen CPUs etc
343
  - Shutdowned openaire-www-(proxy|front|back)2 on prod2-dom0, see above
344
September 20, 2016:
345
  - Announced restart of openaire-www.vls in order to increase the resources, see Redmine #"2330":https://issue.openaire.research-infrastructures.eu/issues/2330
346
September 19, 2016:
347
  - Set Nginx rules for authentication of "https://beta.services.openaire.eu/is/mvc/api/publications/":https://beta.services.openaire.eu/is/mvc/api/publications/, see Redmine #"2323":https://issue.openaire.research-infrastructures.eu/issues/2323
348
  - Investigating Sahar's troubles with access to beta.lod.openaire.eu, see Redmine #"1748":https://issue.openaire.research-infrastructures.eu/issues/1748
349
  - Bumped a limit of the requests per minute in Fail2Ban (apache-badhosts jail) on www.openaire.eu, because it was making the troubles with the portal access (ERR_CONNECTION_REFUSED reported by Katerina, Paolo & Natalia)
350
September 16, 2016:
351
  - Set .deb packages source for CDH 4.7.0 on DM Hadoop cluster machines, see Redmine #"2324":https://issue.openaire.research-infrastructures.eu/issues/2324
352
September 15, 2016:
353
  - Prepared .tar file with the Apache logs of the production Joomla for Dimitris Pierrakos, he needs them for any NKUA student
354
September 14, 2016:
355
  - Fixed .htaccess for (www|beta|test).openaire.eu, because it didn't support index.html for DirectoryIndex, see Redmine #"2231":https://issue.openaire.research-infrastructures.eu/issues/2231
356
  - Fixed Apache auth configuration for /administration requests
357
September 13, 2016:
358
  - Fixed monitoring of 8380 on openaire-services-beta.vls, added monitoring of 8480 and switched monitoring of the search to 8480, see Redmine #"2274":https://issue.openaire.research-infrastructures.eu/issues/2274
359
  - Blocked permanently communication between beta.services.openaire.eu and services.openaire.eu, asked by Alessia, see above
360
  - Investigating an issue with distcp from OCEAN IIS CDH5 Test cluster to OpenAIRE DM cluster, seecluster to OpenAIRE DM cluster, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
361
  - Fixed the firewall rules on the gateway of OpenAIRE DM cluster (added 213.135.60.145 for 50071 port), see above
362
  - Decreased Apache2 limits on openaire-www.vls (ServerLimit=MaxRequestWorkers=120)
363
September 12, 2016:
364
  - Investigating an issue with Monit alerts about the failed beta search, asked by Katerina, see Redmine #"2274":https://issue.openaire.research-infrastructures.eu/issues/2274
365
  - Fixed checking the search on beta.services.openaire.eu, see above
366
  - Copied 8480 from the production services to the beta one, asked by Katerina, see above
367
  - Investigating ERR_CONNECTION_REFUSED errors for some portal pages, see Redmine #"2284":https://issue.openaire.research-infrastructures.eu/issues/2284
368
September 8, 2016:
369
  - Enabled access to OCEAN CDH5 Hadoop Test cluster from OpenAIRE services machines (both production & beta), asked by Claudio, see Redmine #"2297":https://issue.openaire.research-infrastructures.eu/issues/2297
370
  - Granted access to OCEAN CDH5 Hadoop Test cluster web UIs for Claudio, see above
371
September 7, 2016:
372
  - Installed "siege" package on openaire-services-beta.vls, asked by Katerina, see Redmine #"2274":https://issue.openaire.research-infrastructures.eu/issues/2274
373
  - Checking what Piwik sites can be accessed by Dimitris Pierrakos, asked by Dimitris
374
  - Granted the admin privileges for OpenAIRE portal beta site in Piwik to Dimitris, see above
375
  - Filled a ticket about renewal of SSL cert for .openaire.eu, see Redmine #"2291":https://issue.openaire.research-infrastructures.eu/issues/2291
376
September 5, 2016:
377
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
378
September 1, 2016:
379
  - Fixed home & siteurl parameters for blogs.openaire.eu Wordpress (was HTTPS instead of HTTP there and caused a redirection loop for /wp-login.php), reported by Ross & Pedro
380
August 31, 2016:
381
  - Reported issue with stats.openaire.eu murdered by the stats SELECTs from test.openaire.eu, see Redmine #"2282":https://issue.openaire.research-infrastructures.eu/issues/2282
382
  - Restarted Apache on test.openaire.eu and killed SELECT processes coming from test.openaire.eu on stats.openaire.eu, see above
383
August 30, 2016:
384
  - Investigated issues with test.openaire.eu (failed workflows, internal errors etc), reported by Claudio, Tsmapikos & Katerina
385
  - Production Joomla redirect from HTTP to HTTPS returns now status code 301 (Moved Permanently) instead of 302 (Moved Temporarily)
386
August 29, 2016:
387
  - Created a ticket for investigating last issues with the search (see Redmine #"2274":https://issue.openaire.research-infrastructures.eu/issues/2274)
388
  - Investigated 500 errors for jobtracker1.hadoop.dm.openaire.eu (reported by Claudio again, see Redmine #"2249":https://issue.openaire.research-infrastructures.eu/issues/2249)
389
  - Restarted preemptively both JobTrackers of DM Hadoop cluster (see above)
390
  - Replaced Eri Katsari by Tsampikos Livisianos in the Monit alert lists, asked by Eri
391
  - Purged the old logs of HBase and Zookeeper on hbase-master1.hadoop.dm.openaire.eu because of a near full-filled / partition
392
  - Purged the old logs of HDFS and YARN on ci-test.hadoop5.iis.openaire.eu because of a near full-filled / partition
393
  - Restarted Virtuoso on virtuoso-beta.openaire.eu, because SPARQL endpoint was down (reported by Sahar, see Redmine #"2277":https://issue.openaire.research-infrastructures.eu/issues/2277)
394
  - Investigated issues with Googlebot requests for /robots.txt, see Redmine #"2280":https://issue.openaire.research-infrastructures.eu/issues/2280
395
  - Configured Apache on openaire-www.vls for serving also "http://www.openaire.eu/sitemap.xml":http://www.openaire.eu/sitemap.xml without redirecting to HTTPS (see Redmine #"2065":https://issue.openaire.research-infrastructures.eu/issues/2065)
396
August 12, 2016:
397
  - Restarted a few machines of OCEAN IIS CDH5 Hadoop cluster in order to fix YARN NodeManager issue, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
398
  - Fixed OpenAIRE blogs Wordpress settings broken by Pedro
399
  - Polished some Apache rules for fixing URLs on blogs.openaire.eu
400
August 11, 2016:
401
  - Removed a default gateway for IB network interface (mlx4_ib0.8002) from a routing table of OCEAN IIS CDH5 Test Hadoop cluster slave nodes
402
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.16.1 to 2.16.2.
403
August 10, 2016:
404
  - Fixed also HTTPS links for blogs.openaire.eu, see Redmine #"1888":https://issue.openaire.research-infrastructures.eu/issues/1888
405
  - Investigated an issue with HDFS distcp invoked by Ooozie for OCEAN IIS CDH5 Hadoop cluster, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
406
August 9, 2016:
407
  - Investigated MongoDB backup issue on services.openaire.eu which failed a few days ago because of "Failed: error reading collection: EOF" error
408
  - Deployed monitoring of memory used by JobTracker of IIS Hadoop cluster (helpful together with the script for a preventive restart, see below)
409
  - Fixed JavaScript HTTP links for blogs.openaire.eu, reported by Pedro Principe, see Redmine #"1888":https://issue.openaire.research-infrastructures.eu/issues/1888
410
August 4, 2016:
411
  - "driver" group can manage Redis on stats.openaire.eu & beta.stats.openaire.eu now (asked by Antonis)
412
  - "driver" group can manage Tomcat7 on beta.stats.openaire.eu now (the same like for stats.openaire.eu)
413
  - "driver" group can become "www-data" user on stats.openaire.eu now (the same like for beta.stats.openaire.eu)
414
  - Enabled a preventive restart of JobTracker by Cron on master[12].hadoop.iis.openaire.eu (asked by Marek Horst)
415
  - Synced Redis database the beta and the production stats machines (asked by Antonis)
416
  - Enabled monitoring of Redis server on the beta stats machine
417
August 3, 2016:
418
  - Fixed a replica placement policy issue (block should be additionally replicated on 1 more rack(s)) for HDFS of DM Hadoop cluster
419
  - Moved a reverse proxy for blogs.openaire.eu from furkot2.vls to openaire-www.vls (see Redmine #"1888":https://issue.openaire.research-infrastructures.eu/issues/1888)
420
  - Moved a reverse proxy for mining.openaire.eu from furkot2.vls to openaire-www.vls
421
August 2, 2016:
422
  - Removed Nikon Gasparis from Monit alert list on openaire-services-pilot.vls
423
  - Investigated an unsucessfully finished MongoDB backup on services.openaire.eu
424
  - Investigated an unbalanced HDFS of DM Hadoop cluster (from 44.19% for slave9 to 54.09% for slave5)
425
  - tsampikos.livisianos added to "driver" group on beta.stats.openaire.eu (see Redmine #"2152":https://issue.openaire.research-infrastructures.eu/issues/2152)
426
  - Enabled monitoring of nscd & nslcd daemons on the machines which authenticate users against CNR LDAP server (see Redmine #"2258":https://issue.openaire.research-infrastructures.eu/issues/2258)
427
August 1, 2016:
428
  - Deployed Webalizer for beta.virtuoso.openaire.eu
429
July 29, 2016:
430
  - Continued getting the search stats from Apache logs of the portal (see Redmine #"2144":https://issue.openaire.research-infrastructures.eu/issues/2144)
431
  - tsampikos.livisianos added to "driver" & "joomla" groups on www.openaire.eu, beta.openaire.eu & test.openaire.eu (see Redmine #"2152":https://issue.openaire.research-infrastructures.eu/issues/2152)
432
  - Fixed Nginx monitoring on furkot2.vls (now it checks old.openaire.eu, not www.openaire.eu)
433
July 28, 2016:
434
  - Investigated 500 errors for jobtracker1.hadoop.dm.openaire.eu (reported by Claudio, see Redmine #"2249":https://issue.openaire.research-infrastructures.eu/issues/2249)
435
  - Switched "http://api.openaire.eu/search":http://api.openaire.eu/search request from 8380 to 8480 on services.openaire.eu
436
  - Getting the search stats from Apache logs of the portal (see Redmine #"2144":https://issue.openaire.research-infrastructures.eu/issues/2144)
437
July 27, 2016:
438
  - Continued investigating usage of api.openaire.research-infrastructures.eu (see Redmine #"2246":https://issue.openaire.research-infrastructures.eu/issues/2246)
439
  - Deployed Webalizer for beta.lod.openaire.eu (see Redmine #"2197":https://issue.openaire.research-infrastructures.eu/issues/2197)
440
July 26, 2016:
441
  - Started YARN ResourceManager on ci-test.hadoop5.iis.openaire.eu, because it was dead and was reason of restaring YARN NodeManager there
442
  - Fixed hostname for CNR LDAP server (asked by Claudio, see Redmine #"2245":https://issue.openaire.research-infrastructures.eu/issues/2245)
443
  - Investigated usage of api.openaire.research-infrastructures.eu (reported by Alessia, see Redmine #"2246":https://issue.openaire.research-infrastructures.eu/issues/2246)
444
July 25, 2016:
445
  - ioannis.foufoulas added to "driver" group on beta.services.openaire.eu (see Redmine #"2232":https://issue.openaire.research-infrastructures.eu/issues/2232)
446
  - Started Nginx at furkot2.vls, because it was down because of invalid domain name (kiczora.vls.icm.edu.pl) for Highcharts proxy (see Redmine #"2239":https://issue.openaire.research-infrastructures.eu/issues/2239 & #"2240":https://issue.openaire.research-infrastructures.eu/issues/2240)
447
  - Fixed Monit monitoring of Apache2 at openaire-www.vls (now restarts MySQL using Monit commands stop & start)
448
July 14, 2016:
449
  - Created a new LUN on the Dell MD3620F disk array and mounted it as /srv on openaire-services-mongodb
450
  - andrea.dellamico added to "driver" group on services-postgresql.openaire.eu (asked by Alessia, see Redmine #"2174":https://issue.openaire.research-infrastructures.eu/issues/2174)
451
  - Dumped PostgreSQL of openaire-services.vls and restored it on openaire-services-postgresql.vls, see above
452
  - Increased /srv on ci-test.hadoop5.iis.openaire.eu to 60GB (from 40GB) because it was near full-filled by HDFS data
453
July 12, 2016:
454
  - Bumped memory usage limit for Monit on services.openaire.eu (from 85% to 90%), because of a lot of the Monit alerts
455
July 11, 2016:
456
  - Purged the old logs of HDFS and Zookeeper on namenode2.hadoop.dm.openaire.eu because of a near full-filled / partition
457
  - Granted a view access for ALL websites tracked by OpenAIRE Piwik to Jochen Schirrwagen
458
  - Mirrored "http://search.driver.research-infrastructures.eu":http://search.driver.research-infrastructures.eu on the portal machine, asked by Claudio, see Redmine #"2208":https://issue.openaire.research-infrastructures.eu/issues/2208
459
  - Purged the old logs of HBase on hbase-master2.hadoop.dm.openaire.eu because of a near full-filled / partition
460
June 29, 2016:
461
  - Created dnet.production and dnet.beta accounts on OCEAN IIS CDH5 Test gateway and HDFS, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
462
  - Configured an user's authentication against CNR LDAP on OCEAN IIS CDH5 Test gateway
463
June 28, 2016:
464
  - Configured in DNS the aliases (mongodb|postgresql).services.openaire.eu and services-(mongodb|postgresql).openaire.eu pointing to openaire-services-(mongodb|postgresql).vls
465
  - Mounted via NFS netapp2-nfs:/vol/skalny_mongodb_tmp/ (as /mnt/mongodb_tmp) and netapp2-nfs:/vol/openaire_mongodb_backup/ (as /mnt/mongodb_backup) on openaire-services-mongodb.vls
466
  - Enabled monitoring of MongoDB on openaire-services-mongodb.vls
467
  - Configuration of MongoDB on openaire-services-mongodb.vls synced with openaire-services.vls
468
  - Configuration of PostgreSQL on openaire-services-postgresql.vls synced with openaire-services.vls
469
June 27, 2016:
470
  - Deployed openaire-services-postgresql.vls machine as a PostgreSQL backend of services.openaire.eu, asked by CNR, see Redmine #"2174":https://issue.openaire.research-infrastructures.eu/issues/2174
471
  - Deployed openaire-services-mongodb.vls machine as a MongoDB backend of services.openaire.eu, asked by CNR, see Redmine #"2175":https://issue.openaire.research-infrastructures.eu/issues/2174
472
  - Upgraded Java 8 (from 8u66 to 8u91) on ci-test.hadoop5.iis.openaire.eu
473
June 24, 2016:
474
  - Purged the old logs of Mapreduce and Zookeeper on jobtracker1.hadoop.dm.openaire.eu because of a near full-filled / partition
475
  - Fixed 8480 monitoring on services.openaire.eu and the search monitoring on www.openaire.eu
476
June 23, 2016:
477
  - Restarted HBase Masters of DM Hadoop cluster because of hanged tasks, see Redmine #"2167":https://issue.openaire.research-infrastructures.eu/issues/2167
478
June 22, 2016:
479
  - Created a FTP account "dovepress" on openaire-www.vls (asked by Jochen and Tracy Cleary from Dove Medical Press)
480
  - Increased a NFS volume openaire_objectstore_pdfs mounted on services.openaire.eu as /mnt/objectstore_pdfs from 6TB to 8TB, because it was filled in 91%
481
June 21, 2016:
482
  - Fixed PostgreSQL monitoring by Monit on services.openaire.eu, see Redmine #"2155":https://issue.openaire.research-infrastructures.eu/issues/2155
483
June 20, 2016:
484
  - tsampikos.livisianos added to "driver" group on services.openaire.eu, beta.services.openaire.eu, stats.openaire.eu & gateway.hadoop.dm.openaire.eu (see Redmine #"2152":https://issue.openaire.research-infrastructures.eu/issues/2152)
485
  - Fixed one column in TABLE_PARAMS table of hive_metastore database of Hive for OCEAN IIS CDH5 Test cluster (see Mantis #"7911":https://mantis.icm.edu.pl/view.php?id=7911)
486
  - Created on openaire-www-back2.vls the shell scripts for checking slapd master-slave replication status and showing a difference if the slapd servers are not synchronized
487
June 18, 2016:
488
  - Fixed monitoring tomcat-instance-8480 & openaire-search (can't be restarted in the same time, now Monit alerts if 8480 fails and restarts 8480 if openaire-search fails)
489
June 17, 2016:
490
  - Configured Monit for restarting 8380 on services.openaire.eu if openaire-search issue occurs
491
  - Replaced a failed disk in openaire-iis-hadoop2-dom0, see Mantis #"9637":https://mantis.icm.edu.pl/view.php?id=9637
492
  - Enabled monitoring of 8480 on services.openaire.eu, see Redmine #"2144":https://issue.openaire.research-infrastructures.eu/issues/2144
493
  - Configured Monit for restarting 8480 on services.openaire.eu if openaire-search issue occurs (see above)
494
June 15, 2016:
495
  - Synced LDAP on openaire-www-back[12].vls with configuration and content of LDAP on openaire-www.vls
496
  - Configured LDAP master-slave replication between openaire-www-back1.vls (provider) and openaire-www-back2.vls (consumer)
497
  - Configured Apache redirection from indexed by Bing "http://openaire.eu/index.php?lang=en-GB":http://openaire.eu/index.php?lang=en-GB to "https://www.openaire.eu/":https://www.openaire.eu/, asked by Argiro
498
June 14, 2016:
499
  - Purged the old logs of HDFS and Oozie on ci-test.hadoop5.iis.openaire.eu because of a near full-filled / partition
500
  - Deployed openaire-www-back2.vls, a second (backup) back-end machine for OpenAIRE portal cluster
501
  - Configured MySQL replication between openaire-www-back1.vls (master) and openaire-www-back2.vls (slave)
502
  - Deployed 8480 container on services.openaire.eu, see Redmine #"2144":https://issue.openaire.research-infrastructures.eu/issues/2144
503
June 13, 2016:
504
  - Restarted 8380 on services.openaire.eu because the portal was down
505
  - Decreased Apache2 limits on openaire-www.vls (ServerLimit=MaxRequestWorkers=200), see above
506
  - Deployed openaire-www-proxy2.vls, a second (backup) proxy machine for OpenAIRE portal cluster
507
June 09, 2016:
508
  - Increased resources for dm_import pool of OCEAN IIS CDH5 Test cluster (max 30 vcores & max 180GB of memory), see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
509
June 07, 2016:
510
  - Patched s3cmd 1.0.0 on gateway.hadoop.iis.openaire.eu, asked by Kasia Zamlynska
511
  - Changed a mount point for the PDFs uploaded via FTP from /mnt/ftp to /mnt/uploaded_dumps, see Redmine #"1929":https://issue.openaire.research-infrastructures.eu/issues/1929
512
June 04, 2016:
513
  - Restarted 8380 on services.openaire.eu because of OOM error
514
  - Increased / on services.openaire.eu to 40GB because it was near full-filled by .hprof files of 8380
515
  - Set -Xmx10G for 8380 on services.openaire.eu because of too many OOM errors last time
516
  - Removed option -XX:HeapDumpOnOutOfMemoryError (because we don't want unused .hprof file anymore) and set -XX:OnOutOfMemoryError="/bin/kill -9 %p" instead of -XX:OnOutOfMemoryError="/etc/init.d/tomcat-instance-8380 restart" (because "driver" is not allowed for restarting container) for all D-Net containers on services.openaire.eu
517
June 03, 2016:
518
  - Tuned YARN resources settings on OCEAN IIS CDH5 Test cluster
519
  - Unbanned IP 161.53.254.14 on a firewall of the OpenAIRE portal (see Redmine #"2130":https://issue.openaire.research-infrastructures.eu/issues/2130)
520
  - Unbanned all blocked IPs on a firewall of the OpenAIRE portal
521
  - Installed awscli & s3cmd tools on gateway.hadoop.iis.openaire.eu, asked by Kasia Zamlynska
522
  - Restarted 8380 on services.openaire.eu because of OOM error
523
June 02, 2016:
524
  - Installed pydoop 1.0.0 on iis-cdh5-test-gw.ocean.icm.edu.pl (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
525
  - Increased size of / partition of OCEAN IIS CDH5 Test gateway from 20GB to 100GB (see above)
526
  - Increased memory for YARN applications on OCEAN IIS CDH5 Test cluster: 6GB for mappers & 8GB for reducers (see above)
527
  - Downgraded Java on ci-test.hadoop5.iis.openaire.eu from version 8u91 to 8u66 in order to fix Oozie issue with JSP (see Mantis #"9631":https://mantis.icm.edu.pl/view.php?id=9631)
528
  - Updated Oozie sharelibs on ci-test.hadoop5.iis.openaire.eu (see above)
529
  - Tuned YARN resources settings on OCEAN IIS CDH5 Test cluster
530
June 01, 2016:
531
  - Increased size of / partition of OCEAN IIS CDH5 Test master machines from 20GB to 100GB
532
  - Installed python-pip & avroknife on iis-cdh5-test-gw.ocean.icm.edu.pl (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
533
  - Installed Hive on OCEAN IIS CDH5 Test cluster (see above)
534
  - Changed a password for FTP account "jochen" on openaire-www.vls (asked by Jochen Schirrwagen)
535
  - Mounted via NFS openaire_ftp NetApp volume on both services machines (prod & beta)
536
May 31, 2016:
537
  - Group "driver" can check status of Solr on solr.openaire.eu and beta.solr.openaire.eu now, see Redmine #"2120":https://issue.openaire.research-infrastructures.eu/issues/2120
538
  - Updated packages on eos-cr-mgmt*, eos-m2-gw, iis-cdh5-test-* and eos-m2-sn* machines
539
  - Updated Cloudera Manager (CM) server on eos-cr-mgmt1 and Cloudera Manager agents on eos-cr-mgmt1 and all OCEAN IIS CDH5 Test cluster from version 5.5.0 to 5.7.0, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
540
  - Updated CDH on ci-test.hadoop5.iis.openaire.eu from version 5.4.7 to 5.2.2 (see Mantis #"9631":https://mantis.icm.edu.pl/view.php?id=9631)
541
May 30, 2016:
542
  - Granted permissions to "driver" group for launching `tcpflow` with any arguments on services.openaire.eu and beta.services.openaire.eu (see Redmine #"2114":https://issue.openaire.research-infrastructures.eu/issues/2114)
543
  - Removed the logs for job_201605162019_0683 and job_201605162019_0687, because they consumed most of the disk space of DM Hadoop cluster data disks (see Redmine #"2115":https://issue.openaire.research-infrastructures.eu/issues/2115)
544
  - Added the new INFN CA SSL certificate to Java keyring on services.openaire.eu and beta.services.openaire.eu (see Redmine #"2117":https://issue.openaire.research-infrastructures.eu/issues/2117)
545
  - Restarted openaire-virtuoso-beta.vls, asked by Giorgos Alexiou, see Redmine #"2118":https://issue.openaire.research-infrastructures.eu/issues/2118)
546
  - Now a dynamic pool "dm_import" on OCEAN IIS CDH5 Test cluster can use only 20 VCPUs and 40GB RAM (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
547
  - Created a new dynamic pools "marek_dot_horst" and "michal_dot_politkowski" on OCEAN IIS CDH5 Test cluster, see above
548
  - Changed a password for FTP account "copernicus" on openaire-www.vls (asked by Vitalij Mik from Copernicus)
549
May 25, 2016:
550
  - Fixed typo in HAProxy config for hdfs-namenode on gateway.hadoop.(dm|iis).openaire.eu
551
  - Installed apsw on OCEAN IIS CDH5 Test slaves (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
552
  - Set -Xmx512m fot Tomcat 7 on stats.openaire.eu (see Redmine #"2100":https://issue.openaire.research-infrastructures.eu/issues/2100)
553
  - Configured cache for WiredTiger engine of MongoDB on beta.services.openaire.eu, see Redmine #"2062":https://issue.openaire.research-infrastructures.eu/issues/2062
554
May 24, 2016:
555
  - Configured a smart proxy for 50070 of the NameNodes using HAProxy cool health check feature on the IIS Hadoop cluster gateway
556
  - "driver" group can manage Tomcat7 on stats.openaire.eu now (see Redmine #"2100":https://issue.openaire.research-infrastructures.eu/issues/2100)
557
  - Created a dynamic pool "dm_import" for managing resources on OCEAN IIS CDH5 Test cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
558
May 23, 2016:
559
  - Fixed an issue with the permissions of /tmp/logs direcory owned by YARN on OCEAN IIS CDH5 Test cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
560
  - Fixed an issue with a file browsing in DM Hadoop Hue by changing an active HDFS NameNode (see Redmine #"2094":https://issue.openaire.research-infrastructures.eu/issues/2094)
561
  - Configured a smart proxy for 50070 of the NameNodes using HAProxy cool health check feature on the DM Hadoop cluster gateway (see above)
562
May 20, 2016:
563
  - Installed Ext JS for Ooozie on iis-cdh5-test-m3.ocean.icm.edu.pl (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
564
  - Installed "mc" package on iis-cdh5-test-gw.ocean.icm.edu.pl, asked by Marek Horst (see above)
565
  - Installed Oozie ShareLib on OCEAN IIS CDH5 Test Hadoop cluster (see above)
566
  - Stopped and disabled in systemd wpa_supplicant on all machines in module #2 of OCEAN Hadoop infrastructure
567
  - Alessia Bardi will be receiving Monit alerts from DM Hadoop slaves as well (see Redmine #"2090":https://issue.openaire.research-infrastructures.eu/issues/2090)
568
  - aenne.loehden added to "driver" group on services.openaire.eu & beta.services.openaire.eu (asked by Jochen)
569
  - Open Solr port (8983) for UNIBI networks (asked by Jochen too)
570
  - Granted a "view" access to 26 Portugal repos to Jochen, see Redmine #"2059":https://issue.openaire.research-infrastructures.eu/issues/2059
571
  - Purged the old logs of HDFS and Zookeeper on namenode1.hadoop.dm.openaire.eu because of a near full-filled / partition
572
  - Installed LaTeX packages on openaire-www.vls for generating PDF of the OpenAIRE Guidelines (see Redmine #"2067":https://issue.openaire.research-infrastructures.eu/issues/2067)
573
May 19, 2016:
574
  - Configured Apache on iis-cdh5-test-gw.ocean.icm.edu.pl as a reverse proxy for OCEAN IIS CDH5 Test master slaves (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
575
  - Restarted HDFS DataNodes on slave[9-10].hadoop.dm.openaire.eu to fix an issue with the missing blocks (see Redmine #"2086":https://issue.openaire.research-infrastructures.eu/issues/2086)
576
  - Configured an user's authentication against CNR LDAP for all web services of OCEAN IIS CDH5 Test cluster behind a reverse proxy on iis-cdh5-test-gw.ocean.icm.edu.pl
577
  - Increased (from 60s to 180s) a proxy timeout of Nginx for api.openaire.eu (see Redmine #"2085":https://issue.openaire.research-infrastructures.eu/issues/2085)
578
  - iis-cdh5-test-gw.ocean.icm.edu.pl (instead eos-m2-sn01.ocean.icm.edu.pl) is now allowed to access gateway.hadoop.(dm|iis).openaire.eu without LDAP authentication (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
579
  - Installed "screen" package on iis-cdh5-test-gw.ocean.icm.edu.pl, asked by Marek Horst (see above)
580
May 18, 2016:
581
  - katarzyna.zamlynska added to group driver on gateway.hadoop.iis.openaire.eu (see Mantis #"9630":https://mantis.icm.edu.pl/view.php?id=9630)
582
  - Configured Apache on iis-cdh5-test-gw.ocean.icm.edu.pl as a reverse proxy for OCEAN IIS CDH5 Test master machines (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
583
May 17, 2016:
584
  - katerina.iatropoulou added to group "driver" on gateway.hadoop.dm.openaire.eu (see Redmine #"2078":https://issue.openaire.research-infrastructures.eu/issues/2078)
585
  - Created an account for Katerina Iatropoulou & Eri Katsari on all slaves of DM Hadoop cluster (see above)
586
  - Granted permissions to Katerina & Eri for becoming "mapred" user on all slaves of DM Hadoop cluster (see above)
587
  - Moved YARN, Zookeeper & HBase master daemons of OCEAN IIS CDH5 Test cluster to iis-cdh5-test-m[1-3] machines (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
588
  - Deployed HDFS, YARN & HBase services on eos-m2-sn01 & eos-m2-sn35 machines (see above)
589
May 16, 2016:
590
  - Deployed KVM virtual machines iis-cdh5-test-m[1-3] for OCEAN IIS CDH5 Test cluster
591
  - Moved HDFS master daemons of OCEAN IIS CDH5 Test cluster to iis-cdh5-test-m[1-3] machines (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
592
May 13, 2016:
593
  - MongoDB on openaire-services.vls and openaire-services-beta.vls now listens at all network interfaces, because it needs to be reachable from DM Hadoop cluster (see Redmine #"2076":https://issue.openaire.research-infrastructures.eu/issues/2076)
594
  - Purged the old logs of HBase and Zookeeper on hbase-master1.hadoop.dm.openaire.eu because of a near full-filled / partition
595
  - Created a new website in Piwik for Spanish E-Archivo repo, asked by Dimitris (see Redmine #"2069":https://issue.openaire.research-infrastructures.eu/issues/2069)
596
  - Created the new website in Piwik for 2 Croatian repos (FULIR & HRCAK), asked by Dimitris (see Redmine #"2073":https://issue.openaire.research-infrastructures.eu/issues/2073)
597
  - Created a new website in Piwik for Bulgarian OpenAIRE repo, asked by Dimitris (see Redmine #"2074":https://issue.openaire.research-infrastructures.eu/issues/2074)
598
  - Granted a "view" access to 26 Portugal repos to the users who has an account in Piwik, see Redmine #"2059":https://issue.openaire.research-infrastructures.eu/issues/2059
599
  - Created a shell script /usr/local/bin/build-guidelines-html.sh for building HTML code of "http://guidelines.openaire.eu/":http://guidelines.openaire.eu/ site on openaire-www.vls (see Redmine #"2067":https://issue.openaire.research-infrastructures.eu/issues/2067)
600
  - "http://guidelines.openaire.eu/":http://guidelines.openaire.eu/ now handled by Apache on openaire-www.vls, see above and Redmine #"1889":https://issue.openaire.research-infrastructures.eu/issues/1889
601
  - Increased size (from 200GB to 250GB) of /srv partition on beta.stats.openaire.eu
602
May 12, 2016:
603
  - Retarted Apache and MySQL on openaire-www.vls because of memory lack (Error displaying the error page: Application Instantiation Error: Could not connect to MySQL.), thanks to doe.isti.gov
604
  - Enabled fail2ban apache-badhosts jail on openaire-www.vls for protection against too many requests from clients, for example doe.isti.gov
605
  - Installed Sphinx on openaire-www.vls in order to build HTML code for "http://guidelines.openaire.eu":http://guidelines.openaire.eu (cloned from "https://github.com/openaire/guidelines)":https://github.com/openaire/guidelines) and configured Apache for serving it (see Redmine #"2067":https://issue.openaire.research-infrastructures.eu/issues/2067)
606
May 11, 2016:
607
  - Retarted Apache and MySQL on openaire-www.vls because of memory lack (Error displaying the error page: Application Instantiation Error: Could not connect to MySQL.), thanks to doe.isti.gov
608
  - Configured Apache on openaire-www.vls for serving "http://www.openaire.eu/sitemap":http://www.openaire.eu/sitemap without redirecting to HTTPS (see Redmine #"2065":https://issue.openaire.research-infrastructures.eu/issues/2065)
609
  - Built HTML code for "http://guidelines.openaire.eu":http://guidelines.openaire.eu (cloned from "https://github.com/openaire/guidelines)":https://github.com/openaire/guidelines) using Sphinx installed on my laptop and uploaded it on futkot2.vls, because we had an issue with ReadTheDocs service (see Redmine #"2067":https://issue.openaire.research-infrastructures.eu/issues/2067)
610
May 10, 2016:
611
  - Investigating the memory issues on services.openaire.eu (see Redmine #"2062":https://issue.openaire.research-infrastructures.eu/issues/2062)
612
  - "driver" group can monitor/unmonitor Java containers on services.openaire.eu now
613
  - Helping Sahar to find DocumentRoot of "http://beta.lod.openaire.eu":http://beta.lod.openaire.eu (see Redmine #"2063":https://issue.openaire.research-infrastructures.eu/issues/2063)
614
  - Created the Piwik websites for 26 Portugal repositories, asked by Pedro, see Redmine #"2059":https://issue.openaire.research-infrastructures.eu/issues/2059
615
May 09, 2016:
616
  - Restarted ci-test.hadoop.iis.openaire.eu and removed the old MapReduce & Oozie logs, because the machine was unreacheable (see Mantis #[9141>>"https://mantis.icm.edu.pl/view.php?id=9141":https://mantis.icm.edu.pl/view.php?id=9141]])
617
  - Restared slave2.hadoop.dm.openaire.eu and replaced a failed disk in openaire-dm-hadoop1-dom0.vls (see Redmine #"2057":https://issue.openaire.research-infrastructures.eu/issues/2057)
618
  - Restarted openaire-iis-hadoop4-dom0.vls Xen Dom0 machine because of hanged Dell DRAC, see Mantis #[9628>>"https://mantis.icm.edu.pl/view.php?id=9628":https://mantis.icm.edu.pl/view.php?id=9628]]
619
May 06, 2016:
620
  - Upgraded MongoDB on openaire-services.vls & openaire-services-beta.vls from version 3.2.5 to 3.2.6 (see Redmine #"2043":https://issue.openaire.research-infrastructures.eu/issues/2043)
621
May 05, 2016:
622
  - Restored all MongoDB databases of openaire-services.vls on ciemniak2.vls (see Redmine #"2043":https://issue.openaire.research-infrastructures.eu/issues/2043)
623
  - Updated CA root cert of CNR LDAP server on piwik.vls (see Redmine #"2049":https://issue.openaire.research-infrastructures.eu/issues/2049)
624
  - Created dump of MongoDB mdstore, objectStore & dnet_logs databases on openaire-services.vls and restored them on ciemniak2.vls
625
  - Increased size (from 150GB to 200GB) of /srv partition on beta.stats.openaire.eu (see Redmine #"1999":https://issue.openaire.research-infrastructures.eu/issues/1999)
626
  - Transfered MongoDB 3.5.2 databases from ciemniak2.vls on openaire-services.vls (see Redmine #"2043":https://issue.openaire.research-infrastructures.eu/issues/2043)
627
May 04, 2016:
628
  - Fixed `facter` on openaire-virtuoso.vls (/usr/lib/ruby/1.8/facter/vls/exim4.rb for checking Exim4's keep_environment was missing)
629
  - Enabled Puppet agent there, because it was disabled
630
  - Fixed a huge CPU load on openaire-services-beta.vls because of MongoDB 3.2 (`sudo date -s now` did the magic), see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019
631
  - Restored MongoDB oaistore* databases of openaire-services.vls on openaire-services-pilot.vls (see Redmine #"2043":https://issue.openaire.research-infrastructures.eu/issues/2043
632
  - Disabled temporarily verification of SSL cert of CNR LDAP in Apache2 on the OpenAIRE portal machines (production, beta & test) and Hadoop gateways, because it has expired today (see Redmine #"2049":https://issue.openaire.research-infrastructures.eu/issues/2049)
633
  - Updated CA root cert of CNR LDAP server and enabled its verification again (see above)
634
April 28, 2016:
635
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.16.0 to 2.16.1.
636
  - Copied logrotate config file for MongoDB from openaire-services.vls to openaire-services-beta.vls, because it seems that mongodb-org-server package from 10gen doesn't include it
637
April 27, 2016:
638
  - Deployed MongoDB 3.5.2 on ciemniak2.vls and restored there mdstore database of MongoDB 2.6 from openaire-services-beta.vls (see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019)
639
  - Created an account for Claudio and Alessia on ciemniak2.vls (see above)
640
  - Transfered MongoDB 3.5.2 databases from ciemniak2.vls on openaire-services-beta.vls (see above)
641
April 26, 2016:
642
  - Restored mdstore database of MongoDB 2.6 on openaire-services-beta.vls (see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019)
643
  - Fixed Puppet template of MongoDB for Monit, because MongoDB 3.x (from 10gen) listens at a different port (21017) now and it's managed only by Upstart init script
644
April 25, 2016:
645
  - Upgraded MongoDB on openaire-services-beta.vls from version 2.4 to 2.6 (see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019)
646
  - Upgraded MongoDB on openaire-services-beta.vls from version 2.6 to 3.0 (see above)
647
April 22, 2016:
648
  - Configured MySQL for Joomla on openaire-www-back1.vls machine
649
  - Tuned YARN on OCEAN IIS CDH5 Test cluster (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
650
April 21, 2016:
651
  - Restarted Zookeeper service & HBase Masters of DM Hadoop cluster (see Redmine #"1998":https://issue.openaire.research-infrastructures.eu/issues/1998)
652
  - Configured Nginx for Joomla on openaire-www-proxy1.vls machine
653
  - Configured Apache2 for Joomla on openaire-www-front[1-3].vls machines
654
April 20, 2016:
655
  - Disabled and removed snapshots of openaire_mongodb_backup volume on netapp1 because of lack of free disk space for MongoDB backup on openaire-services-beta.vls (see below)
656
  - Created a backup of MongoDB on openaire-services-beta.vls (see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019)
657
  - Deployed openaire-www-proxy1.vls machine
658
  - Deployed openaire-www-front[1-3].vls machines
659
  - Deployed openaire-www-back1.vls machine
660
April 19, 2016:
661
  - Increased CPU (from 4 to 8) and RAM (from 8GB to 16GB) for openaire-www.vls
662
  - Decreased CPU (from 18 to 4) and RAM (from 32GB to 8GB) for furkot2.vls
663
  - Restarted furkot2.vls (it had 830 days uptime!!!)
664
April 18, 2016:
665
  - Tuned YARN on OCEAN IIS CDH5 Test cluster (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
666
April 15, 2016:
667
  - Shutdowned slave6.hadoop.dm.openaire.eu because it has hanged up because of OOMs, see Redmine #"2008":https://issue.openaire.research-infrastructures.eu/issues/2008
668
April 14, 2016:
669
  - Enabled /etc/cron.d/cleanup-mnt-tmp Cron job which removes the files older then 3 weeks from /mnt/tmp on gateway.hadoop.(dm|iis).openaire.eu (the files located under preserved/ subdirectory are still preserved), see Redmine #"1768":https://issue.openaire.research-infrastructures.eu/issues/1768
670
April 13, 2016:
671
  - Installed unzipped version of Python APSW 2.11.1-r1 on ci-test.hadoop5.iis.openaire.eu (see Mantis #[9622>>"https://mantis.icm.edu.pl/view.php?id=9622":https://mantis.icm.edu.pl/view.php?id=9622]])
672
  - Restarted HBase RegionServer on slave4.hadoop.iis.openaire.eu, because HBase Master couldn't see it
673
  - Tuned YARN on OCEAN IIS CDH5 Test cluster (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
674
  - Created an account for Marek Horst for all slaves of OCEAN IIS CDH5 Test cluster (see above)
675
  - Installed Tomcat7 on openaire-virtuoso-beta.vls & configured sudo for "driver" group (see Redmine #"2005":https://issue.openaire.research-infrastructures.eu/issues/2005)
676
  - Configured Apache2 on openaire-virtuoso-beta.vls for handling "http://beta.lod.openaire.eu/api":http://beta.lod.openaire.eu/api requests (see above)
677
  - Added 4 new slaves to OCEAN IIS CDH5 Test cluster (eos-m2-sn0[78] & eos-m2-sn4[12])
678
April 7, 2016:
679
  - Installed php5-psql package on beta.stats.openaire.eu, asked by Ioannis Diplas (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
680
  - Granted admin rights to Dimitris Pierrakos for OpenAIRE portal (idSite=5) and API website (idSite=18) in Piwik
681
April 6, 2016:
682
  - 10.0.6.0/26 network (VLAN 406) is now allowed to access gateway.hadoop.(dm|iis).openaire.eu without LDAP authentication (see Mantis #"7593":https://mantis.icm.edu.pl/view.php?id=7593)
683
  - Granted admin rights to Natalia for OpenAIRE portal web site (idSite=5) in Piwik
684
March 31, 2016:
685
  - ioannis.diplas added to group driver on beta.stats.openaire.eu & beta.services.openaire.eu (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
686
April 5, 2016:
687
  - Grabbed 504 return code lines of Nginx logs for api.openaire.eu, asked by Alessia
688
  - Installed the latest version of Mikoomi's MongoDB plugin/template for Zabbix on services.openaire.eu and beta.services.openaire.eu
689
  - Configured Nginx on beta.services.openaire.eu for handling beta.repomanager.openaire.eu (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
690
  - Configured Apache2 on beta.stats.openaire.eu for handling /stats locally and passing the rest requests to "http://beta.services.openaire.eu:8380/statsConfig/":http://beta.services.openaire.eu:8380/statsConfig/ (see above)
691
  - Tuned YARN on ci-test.hadoop5.iis.openaire.eu (see Mantis #[9567>>"https://mantis.icm.edu.pl/view.php?id=9567":https://mantis.icm.edu.pl/view.php?id=9567]])
692
April 4, 2016:
693
  - Memory tuning of IIS CDH5 Test (OCEAN) Hadoop cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
694
  - Created an account for Frederic Merceur in OpenAIRE Piwik (see Redmine #"1972":https://issue.openaire.research-infrastructures.eu/issues/1972)
695
April 1, 2016:
696
  - CIS IP 213.135.59.178 (default gateway for the slave machines of OCEAN IIS CDH5 Test cluster) is now allowed to access gateway.hadoop.(dm|iis).openaire.eu without LDAP authentication (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
697
March 31, 2016:
698
  - Enabled monitoring of /mnt/mongodb_tmp on services.openaire.eu
699
  - Increased size of /mnt/objectstore_pdfs from 4TB to 6TB on services.openaire.eu
700
  - Configured Apache2 on openaire-stats-beta.vls for handling beta.stats.openaire.eu & beta.topics.openaire.eu domains (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
701
  - nikolaos.begetis added to group driver on beta.stats.openaire.eu & beta.services.openaire.eu (see above)
702
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.15.0 to 2.16.0.
703
  - eos-m2-sn01.ocean.icm.edu.pl is now allowed to access gateway.hadoop.(dm|iis).openaire.eu without LDAP authentication (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
704
March 30, 2016:
705
  - Set JAVA_HOME=/usr/java/jdk1.8.0_77 on IIS CDH5 Test (OCEAN) Hadoop cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
706
  - Created an account krzysztof.madry on eos-m2-sn(01|35).ocean.icm.edu.pl (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
707
  - Installed PHP5 and Sqlite 3.8.2 on beta.stats.openaire.eu (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
708
  - Configured beta.topics.openaire.eu & beta.repomanager.openaire.eu domain names in DNS (see above)
709
  - spark-gw.vls.icm.edu.pl is now allowed to access gateway.hadoop.iis.openaire.eu without LDAP authentication (see Mantis #"9487":https://mantis.icm.edu.pl/view.php?id=9487)
710
  - Granted access to Claudio for reading logs in /srv/data/*/mapred/local/userlogs/job_201602171053_1254/ of DM cluster worker nodes
711
  - Tuned IIS CDH5 Test (OCEAN) Hadoop cluster (oozie.action.max.output.data=8192, oozie.subworkflow.classpath.inheritance=true), see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
712
  - Increased size of /mnt/objectstore_pdfs from 4TB to 6TB on beta.services.openaire.eu (see Redmine #"1973":https://issue.openaire.research-infrastructures.eu/issues/1973)
713
  - Enabled monitoring of /mnt/objectstore_pdfs on services.openaire.eu & beta.services.openaire.eu (see above)
714
March 29, 2016:
715
  - Removed Java 6 and installed Java 8 on IIS CDH5 Test (OCEAN) Hadoop cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
716
  - Create a new website in Piwik for French Archimer Repository (see Redmine #"1972":https://issue.openaire.research-infrastructures.eu/issues/1972)
717
March 24, 2016:
718
  - Purged python-apsw 3.7.6.3-r1 package on ci-test.hadoop.iis.openaire.eu & ci-test.hadoop5.iis.openaire.eu and installed there Python APSW 2.11.1-r1 built on the gateway of IIS Hadoop cluster (see Mantis #[9622>>"https://mantis.icm.edu.pl/view.php?id=9622":https://mantis.icm.edu.pl/view.php?id=9622]])
719
  - Restarted HBase Master & all RegionServers of DM Hadoop cluster
720
March 22, 2016:
721
  - Removed some .hprof files of 8380 on services.openaire.eu, because of lack of free disk space on / partition (see Redmine #"1967":https://issue.openaire.research-infrastructures.eu/issues/1967)
722
  - Deployed IIS CDH5 Test (OCEAN) Hadoop cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
723
March 21, 2016:
724
  - Purged python-apsw 3.7.6.3-r1 package on the slaves of IIS Hadoop cluster and installed there Python APSW 2.11.1-r1 built on the gateway (see Redmine #"1212":https://issue.openaire.research-infrastructures.eu/issues/1212)
725
March 18, 2016:
726
  - Purged the old logs of Oozie on master3.hadoop.iis.openaire.eu because of a near full-filled / partition
727
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
728
March 16, 2016:
729
  - ioannis.foufoulas added to group driver on gateway.hadoop.iis.openaire.eu (see Mantis #"9620":https://mantis.icm.edu.pl/view.php?id=9620)
730
  - Deleted unused arxiv_pdf-old/ directory from /mnt/downloaded_dumps volume (see Redmine #"1950":https://issue.openaire.research-infrastructures.eu/issues/1950)
731
March 11, 2016:
732
  - Enabled monitoring of usage of /home and /mnt/tmp on gateway.hadoop.iis.openaire.eu
733
  - Enabled monitoring of usage of /mnt/downloaded_dumps on services.openaire.eu
734
March 10, 2016:
735
  - Disabled forgotten commands `chown -R dnet:monkeys /srv/dnet/` & `chown -R root:monkeys /usr/share/dnet/bundles/` in the root's crontab both on services.openaire.eu and beta.services.openaire.eu
736
  - Now Monit on services.openaire.eu and beta.services.openaire.eu will be restarting Tomcat containers (if neccessary) instead only sending e-mail alerts, asked by Claudio
737
March 09, 2016:
738
  - michal.politowski added to driver group at gateway.hadoop.iis.openaire.eu (see Redmine #"1936":https://issue.openaire.research-infrastructures.eu/issues/1936)
739
  - Moved MongoDB mdstore & oaistore* on services.openaire.eu from /srv & /srv3 to /srv2 (see Redmine #"1940":https://issue.openaire.research-infrastructures.eu/issues/1940)
740
  - Fixed HDFS balancer on master1.hadoop.iis.openaire.eu which was causing the load peaks there
741
March 08, 2016:
742
  - Replaced a failed disk in RAID-0 (available as /dev/sdc on openaire-iis-hadoop2-dom0.vls) for HDFS in slave3.hadoop.iis.openaire.eu (available as /dev/xvde and mounted as /srv/data/3)
743
  - Replaced a failed disk in RAID-1 (available as /dev/sdg) for LVM on openaire-iis-hadoop2-dom0.vls
744
  - Started again slave3.hadoop.iis.openaire.eu
745
  - Created a testing account for Jochen in the FTP service on ftp.openaire.eu (alias for www.openaire.eu), see Redmine #"1929":https://issue.openaire.research-infrastructures.eu/issues/1929
746
March 07, 2016:
747
  - Shutdowned slave3.hadoop.iis.openaire.eu because of HDFS disk failure
748
  - Restarted DataNodes of IIS Hadoop cluster, because of HBase Master issue ("org.apache.hadoop.hbase.util.FSUtils: Waiting for dfs to exit safe mode...", reported by Claudio, see Redmine #"1931":https://issue.openaire.research-infrastructures.eu/issues/1931)
749
  - Launched manually /usr/local/sbin/get-piwik-users-actions.sh script of gateway.hadoop.iis.openaire.eu, because it failed because of IIS Hadoop HDFS issue ("Name node is in safe mode", see above)
750
  - Increased size (from 100GB to 150GB) of /srv partition on beta.stats.openaire.eu
751
  - Eri Katsari & Andrea Mannocci added to a recipient list of Monit alerts for /srv on stats.openaire.eu & beta.stats.openaire.eu
752
March 04, 2016:
753
  - Installed MongoDB on pilot.services.openaire.eu and restored there objectStore db for a testing purpose (see Redmine #"1747":https://issue.openaire.research-infrastructures.eu/issues/1747)
754
  - Dropped objectStore db of MongoDB on services.openaire.eu and restored it from a backup (see above)
755
  - Purged the old logs of Zookeeper of {namenode1,jobtracker1,hbase-master1}.hadoop.dm.openaire.eu because of a near full-filled / partition
756
March 03, 2016:
757
  - Unsuccessful attempt to repair MongoDB on services.openaire.eu (see Redmine #"1747":https://issue.openaire.research-infrastructures.eu/issues/1747)
758
March 02, 2016:
759
  - Installed python-pip and python-libxml2 Debian packages and also beautifulsoup4 Python package on services.openaire.eu and beta.services.openaire.eu (asked by Sandro La Bruzzo, see Redmine #"1930":https://issue.openaire.research-infrastructures.eu/issues/1930)
760
February 29, 2016:
761
  - Restarted MySQL on openaire-www.vls, because Joomla had an issue with connecting its database
762
February 27, 2016:
763
  - Restarted openaire-virtuoso-beta.vls, asked by Giorgos Alexiou
764
February 26, 2016:
765
  - Deleted the local user logs of MapReduce on all slaves of the DM Hadoop cluster (asked by Giorgos, see Redmine #"1917":https://issue.openaire.research-infrastructures.eu/issues/1917)
766
  - Increased a number of CPU cores (from 12 to 16) and memory (from 32GB to 48GB) on openaire-virtuoso-beta.vls (see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
767
  - Launched 8580 on pilot.services.openaire.eu, because it was dead
768
February 24, 2016:
769
  - Deployed the new Xen DomUs called slave9.hadoop.dm.openaire.eu and slave10.hadoop.dm.openaire.eu for the DM Hadoop cluster
770
  - Deployed Ganglia on the master servers of DM Hadoop cluster
771
February 23, 2016:
772
  - Created a new Xen DomUs called slave9.hadoop.dm.openaire.eu and slave10.hadoop.dm.openaire.eu for the DM Hadoop cluster, because HDFS is near full-filled (see Redmine #"1904":https://issue.openaire.research-infrastructures.eu/issues/1904)
773
  - Deleted the old local user logs of MapReduce on all slaves of the DM Hadoop cluster (see Redmine #"1904":https://issue.openaire.research-infrastructures.eu/issues/1904)
774
February 22, 2016:
775
  - Created a new Xen Dom0 called openaire-dm-hadoop3-dom0.vls for the DM Hadoop cluster slaves, because HDFS is near full-filled (see Redmine #"1904":https://issue.openaire.research-infrastructures.eu/issues/1904)
776
February 19, 2016:
777
  - Removed doe.osti.gov (IP 192.107.175.11) from a list of DROPed IP addresses on the openaire-www.vls firewall, after Natalia request
778
  - Bumped LIMIT (from 30 to 50) of /usr/local/sbin/antiloris.sh on openaire-www.vls
779
  - Increased a number of CPU cores (from 8 to 12) on openaire-virtuoso-beta.vls (see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
780
  - Installed Ganglia on the master servers of DM Hadoop cluster
781
  - HDFS balancer threshold set to 3 in cron.d/hadoop-hdfs-balancer at DM Hadoop cluster
782
February 17, 2016:
783
  - Updated Java (from version 6 to 7) on DM Hadoop cluster (see Redmine #"1892":https://issue.openaire.research-infrastructures.eu/issues/1892)
784
  - Restarted openaire-virtuoso-beta.vls, asked by Giorgos Alexiou
785
February 16, 2016:
786
  - Fixed an ownership of the files under /etc (in particular /etc/default/tomcat-instance-8*80) on openaire-services-beta.vls which belong now to "driver" group instead of an old and inactive "monkeys" group, reported by Nikon Gasparis who couldn't change the memory settings for 8380 container
787
  - The same action on openaire-services.vls (see Redmine #"1891":https://issue.openaire.research-infrastructures.eu/issues/1891)
788
February 15, 2016:
789
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
790
  - Increased a number of CPU cores (from 4 to 8) and amount of memory (from 16GB to 32GB) on openaire-virtuoso-beta.vls (see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
791
  - Created backup of Joomla on test.openaire.eu, asked by Argiro
792
  - Synchronised test.openaire.eu with www.openaire.eu, asked by Argiro
793
  - Fixed Apache2 config for blogs.openaire.eu site on openaire-www.vls (enabled and used proxy_html module for fixing "http://blogs.openaire.eu/":http://blogs.openaire.eu/ links)
794
February 12, 2016:
795
  - Activated and configured LoginLDAP plugin of Piwik (see Redmine #"1828":https://issue.openaire.research-infrastructures.eu/issues/1828)
796
  - Opened access to port 1111 on openaire-virtuoso-beta.vls from openaire-dm-hadoop-gw (asked by Giorgos Alexiou, see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
797
February 11, 2016:
798
  - Imported to Piwik the latest Nginx logs of api.openaire.eu starting from January 16 until to February 11 (see Redmine #"1828":https://issue.openaire.research-infrastructures.eu/issues/1828)
799
  - Created a script import-api-logs.sh on piwik.vls for importing API logs to Piwik via Cron nightly (see above)
800
  - Installed LoginLDAP plugin of Piwik (see above)
801
February 10, 2016:
802
  - Upgraded ownCloud of box.openaire.eu from version 8.2.1 to 8.2.2
803
February 3, 2016:
804
  - Purged the old logs of Hadoop HDFS/MapReduce and Oozie of ci-test.hadoop.iis.openaire.eu because of a near full-filled / partition
805
  - Athena RC networks are allowed now to log in at gateway.hadoop.dm.openaire.eu (see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
806
  - Added more CPU cores (4) and memory (16GB) for beta.virtuoso.openaire.eu (see above)
807
February 2, 2016:
808
  - Increased -Xmx size (from 2GB to 4GB) for JobTracker HA on master[12].hadoop.iis.openaire.eu (see Redmine #"1859":https://issue.openaire.research-infrastructures.eu/issues/1859)
809
January 29, 2016:
810
  - Created a new instance of ownCloud ("http://box-test.openaire.eu/)":http://box-test.openaire.eu/) on farm-www.vls for the update testing
811
January 28, 2016:
812
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
813
January 27, 2016:
814
  - Assisting Claudio with resolving his issue with accessing the DM Hadoop slaves in order to check the job logs (changed his SSH public key, fixed the job directory permissions from 700 to 755)
815
January 25, 2016:
816
  - Disabled a shell script for cross-backup with CERN on orli, because our account at CERN wasn't working starting from May 2015
817
January 21, 2016:
818
  - Removed the old .hprof files of 8380 container on services.openaire.eu, because of a near full-filled / partition
819
January 20, 2016:
820
  - Reported to Pisa team that their 8290 container is dead on services.openaire.eu and beta.services.openaire.eu (see Redmine #"1836":https://issue.openaire.research-infrastructures.eu/issues/1836)
821
January 19, 2016:
822
  - Purged the old logs of Zookeeper of hbase-master1.hadoop.dm.openaire.eu because of a near full-filled / partition
823
  - Create a new website in Piwik for Portugal Cocum Repository (see Redmine #"1671":https://issue.openaire.research-infrastructures.eu/issues/1671)
824
  - Open access to port 6379 (Redis) on test.openaire.eu from beta.services.openaire.eu (see Redmine #"1833":https://issue.openaire.research-infrastructures.eu/issues/1833)
825
January 18, 2016:
826
  - Set rotate 730 for rotating the Nginx logs on furkot2.vls, because Natalia wanted the numbers of api.openaire.eu for a report for EC
827
  - Created a new website for api.openaire.eu in Piwik (see Redmine #"1828":https://issue.openaire.research-infrastructures.eu/issues/1828)
828
  - Imported Nginx logs of api.openaire.eu to Piwik (see above)
829
January 11, 2016:
830
  - Purged the old logs of Hadoop HDFS/MapReduce and Oozie of ci-test.hadoop.iis.openaire.eu because of a near full-filled / partition
831
  - Increased size of /mnt/mongodb_backup partition of services.openaire.eu from 5TB to 6TB, changed a backup policy (dump.old/ directory for a previous dump and dump/ for a current dump), enabled the snapshots feature of NetApp for the appropriate volume (see Redmine #"1806":https://issue.openaire.research-infrastructures.eu/issues/1806)
832
  - Launched JobTracker on master1.hadoop.iis.openaire.eu, because it was dead
833
January 9, 2016:
834
  - Purged the old dumps of MongoDB of services.openaire.eu because of a near full-filled /mnt/mongodb_backup partition (see Redmine #"1806":https://issue.openaire.research-infrastructures.eu/issues/1806)
835
January 8, 2016:
836
  - Launched 8380 on services.openaire.eu, because it was dead (see Redmine #"1801":https://issue.openaire.research-infrastructures.eu/issues/1801)
837
  - Investigating a timeout issue reported by Dimitris Pierrakos which was trying to download UMINHO data from Piwik
838
January 7, 2016:
839
  - Launched 8580 on pilot.services.openaire.eu, because it was dead
840
  - Re-processed all data in Piwik for OpenAIRE Post-grant Pilot site, because a report for a year period was broken (reported by Natalia)
841
  - Enabled processing the unique visitors for a year period in Piwik and re-processed all data for every OpenAIRE related site (enabled by Natalia)
842
January 4, 2016:
843
  - Installed Java 7 on virtuoso.openaire.eu and virtuoso-beta.openaire.eu and deployed Tarql 1.0a there (see Redmine #"1390":https://issue.openaire.research-infrastructures.eu/issues/1390)
844
December 26, 2015:
845
  - Purged the old logs of Hadoop HDFS/MapReduce and Oozie of ci-test.hadoop.iis.openaire.eu because of a near full-filled / partition
846
December 24, 2015:
847
  - Increased size of /srv partition on ci-test.hadoop.iis.openaire.eu from 20GB to 40GB
848
December 21, 2015:
849
  - Renamed /mnt/harvested_pdfs to /mnt/downloaded_dumps on services.openaire.eu, beta.services.openaire.eu and gateway.hadoop.iis.openaire.eu (see Redmine #"1776":https://issue.openaire.research-infrastructures.eu/issues/1776)
850
December 18, 2015:
851
  - Making beta.lod.openaire.eu and virtuoso-beta.openaire.eu ready for testing (see Redmine #"1748":https://issue.openaire.research-infrastructures.eu/issues/1748)
852
  - Configured a redirection from lod.openaire.eu to beta.lod.openaire.eu
853
December 15, 2015:
854
  - Installed python-apsw package on pyszny.vls & nosal.vls, because it's necessary for running IIS jobs on Jenkins (asked by Lukasz Dumiszewski)
855
  - Increased size of NetApp volume mounted via NFS on gw.hadoop.iis.openaire.eu as /mnt/harversed_pdfs from 1TB to 1.5TB (Mantis #"9595":https://mantis.icm.edu.pl/view.php?id=9595)
856
  - Resolved Claudio's problem with launching `sudo su - dnet` on gw.hadoop.dm.openaire.eu (see Redmine #"1765":https://issue.openaire.research-infrastructures.eu/issues/1765)
857
December 11, 2015:
858
  - Fixed a content of /var/run/mongodb/mongodb.pid file on services.openaire.eu which causes an issue with Monit, because it contaided an invalid PID number of MongoDB process (see Redmine #"1746":https://issue.openaire.research-infrastructures.eu/issues/1746)
859
December 9, 2015:
860
  - Fixed an issue with an invalid SSH key on solr.openaire.eu which caused that making of a system backup was impossible
861
  - Removed an old and unused logrotate config for MongoDB on services.openaire.eu which caused "duplicate log entry for /var/log/mongodb/mongodb.log" error
862
  - Purged an old and unused postgresql-common package on furkot2.vls which caused "error accessing /var/log/postgresql: No such file or directory" error
863
December 7, 2015:
864
  - Upgraded ownCloud of box.openaire.eu from version 7.0.4 to 8.2.1
865
  - Created a new VM beta.virtuoso.openaire.eu for Virtuoso server (see Redmine #"1748":https://issue.openaire.research-infrastructures.eu/issues/1748)
866
December 5, 2015:
867
  - Increased /srv from 400GB to 500GB on services.openaire.eu (see Redmine #"1746":https://issue.openaire.research-infrastructures.eu/issues/1746)
868
December 2, 2015:
869
  - Created an account for Dimitris Pierrakos in OpenAIRE Piwik (see Redmine #"1695":https://issue.openaire.research-infrastructures.eu/issues/1695)
870
  - Fixed the write rights for some HDFS directories on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
871
  - Opened ports on the firewall for the web interfaces of HDFS, MapReduce, YARN and Spark (see above)
872
December 1, 2015:
873
  - Installed and configured Spark on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
874
  - Created a website and an user for Zenodo in Piwik on analytics.openaire.eu (see Redmine #"1695":https://issue.openaire.research-infrastructures.eu/issues/1695)
875
November 30, 2015:
876
  - Enabled monitoring of YARN {Node,Resource}Manager and Mapreduce HistoryServer on ci-test.hadoop5.iis.openaire.eu
877
November 26, 2015:
878
  - Installed Java 8 on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
879
  - Fixed file "https://www.openaire.eu/cerif_schema/cerif-1.6-2_openaire-1.0.xsd":https://www.openaire.eu/cerif_schema/cerif-1.6-2_openaire-1.0.xsd (copied from furkot2.vls to openaire-www.vls), reported by Jan Dvorak
880
  - Made box8.openaire.eu accessible for testing for Natalia and Pedro
881
November 25, 2015:
882
  - Removed old and unused Zookeeper files on jobtracker1.hadoop.dm.openaire.eu because of near full-filled / partition
883
  - Enabled /usr/local/sbin/make-hdfs-user-home script in PAM on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
884
November 24, 2015:
885
  - Increased quota for Natalia (from 1GB to 5GB) in box.openaire.eu
886
  - Installed YARN on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
887
November 19, 2015:
888
  - Investigating an issue with near full-filled / partition on services.openaire.eu where 8380 container created a few huge .hprof files (removed my Nikon after my request)
889
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
890
  - Assisting during Joomla Security update on www.openaire.eu, done by Argiro
891
November 18, 2015:
892
  - Killed a hunged process for 8586 port on pilot.services.openaire.eu and started 8580 again (reported by Nikon)
893
November 17, 2015:
894
  - Investigating an issue with a bad encoding of the validator messages (reported by Nikon, see Redmine #"921":https://issue.openaire.research-infrastructures.eu/issues/921)
895
  - Investigating an issue with uploading files to box.openaire.eu: "Your storage is full, files can not be updated or synchronized anymore!" (reported by Sahar)
896
  - Set scheduled execution of VACUUM ANALYZE on the dnet_openaireplus database on services.openaire.eu and beta.services.openaire.eu (see Redmine #"1694":https://issue.openaire.research-infrastructures.eu/issues/1694)
897
November 13, 2015:
898
  - Configured authorized SSH keys of jenkins at ci-test.hadoop(5).iis.openaire.eu for SSH connections from ci.ceon.pl (see Mantis #"9573":https://mantis.icm.edu.pl/view.php?id=9573) for running IIS integration tests
899
November 5:
900
  - increased client_max_body_size (to 10M) for postgrantoapilot.openaire.eu (asked by Antonis) 
901
November 4:
902
  - Created Piwik accounts for Portugal pilot repositories (asked by Pedro)
903
  - Fixed broken LDAP configuration of box.openaire.eu
904
November 1, 2015:
905
  - Security upgrade of PHP and MySQL on {beta,test,www}.openaire.eu
906
October 27, 2015:
907
  - Installed php5-gmp package on www.openaire.eu (asked by Eri)
908
  - Copied Joomla directory and database from www.openaire.eu to {beta,test}.openaire.eu (asked by Argiro)
909
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.14.3 to 2.15.0.
910
October 26, 2015:
911
  - Installed composer.phar ("https://getcomposer.org/)":https://getcomposer.org/) on www.openaire.eu (asked by Eri)
912
October 23, 2015:
913
  - Security upgrade of PostgreSQL 9.3 on beta.services.openaire.eu (see Redmine #"1646":https://issue.openaire.research-infrastructures.eu/issues/1646) 
914
October 22, 2015:
915
  - Deployed ci-test.hadoop5.iis.openaire.eu machine for a new pseudo Hadoop CDH5 cluster for running IIS integration tests (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
916
  - Security upgrade of PostgreSQL 9.3 on services.openaire.eu (see Redmine #"1646":https://issue.openaire.research-infrastructures.eu/issues/1646) 
917
  - Security upgrade of PostgreSQL 9.3 on stats.openaire.eu & beta.stats.openaire.eu (see Redmine #"1645":https://issue.openaire.research-infrastructures.eu/issues/1645) 
918
October 21, 2015:
919
  - Security upgrade of PostgreSQL 9.3 on pilot.services.openaire.eu (see Redmine #"1646":https://issue.openaire.research-infrastructures.eu/issues/1646) 
920
October 16, 2015:
921
  - Helping Dimitris Pierrakos with his trouble with accessing the portal Joomla logs stored on HDFS of IIS Hadoop cluster
922
  - Helping Natalia & Antonis with their trouble with accessing Piwik stats for blogs.openaire.eu and Post-Grant Pilot
923
  - Answering Antonis who asked about the backups of Post-Grant Pilot DB
924
  - Removed old and unused logs of HDFS, MapReduce and Oozie on ci-test.hadoop.iis.openaire.eu, because they near full-filled / partition
925
October 15, 2015:
926
  - Reported the portal Apache errors to Argiro Kokogiannaki
927
  - Copied Redis server content from stats.openaire.eu to beta.stats.openaire.eu (asked by Eri Katsari)
928
  - Investigating the issues with wrong URLs ("http://localhost:8890/)":http://localhost:8890/) for lod.openaire.eu (see Redmine #"1632":https://issue.openaire.research-infrastructures.eu/issues/1632) 
929
October 14, 2015:
930
  - andrea.mannocci added to driver group at stats.openaire.eu (see Redmine #"1441":https://issue.openaire.research-infrastructures.eu/issues/1441)
931
  - Reported the portal Apache errors to Argiro Kokogiannaki
932
October 13, 2015:
933
  - Created Piwik account for Pedro Principe and given him an access to the stats for all Portugal pilot services (see Redmine #"1483":https://issue.openaire.research-infrastructures.eu/issues/1483)
934
October 12, 2015:
935
  - Fixed LDAP authentication for "https://analytics.openaire.eu/":https://analytics.openaire.eu/ (see Redmine #"1622":https://issue.openaire.research-infrastructures.eu/issues/1622)
936
  - Investigating the issue with unreachable MySQL server of the portal ("/usr/sbin/mysqld: Got an error writing communication packets")
937
October 09, 2015:
938
  - Copied 1.0/ and 0.3/ schema from furkot2.vls to openaire-www.vls (see Redmine #"1617":https://issue.openaire.research-infrastructures.eu/issues/1617)
939
  - alessia.bardi added to driver & joomla groups at www.openaire.eu (see Redmine #"1617":https://issue.openaire.research-infrastructures.eu/issues/1617)
940
October 07, 2015:
941
  - Removed the old and unused ZooKeeper/Hadoop logs on hbase-master[12].hadoop.dm.openaire.eu
942
  - Investigating the issue with LDAP/DAV authentication for "http://virtuoso.openaire.eu/":http://virtuoso.openaire.eu/ (see Redmine #"1391":https://issue.openaire.research-infrastructures.eu/issues/1391)
943
  - Enabled access to HFTP (50070 port) on gateway.hadoop.dm.openaire.eu from spark-gw.vls.icm.edu.pl (see Mantis #"9561":https://mantis.icm.edu.pl/view.php?id=9561)
944
October 06, 2015:
945
  - Continued polishing the rewrite/proxy rules for lod.openaire.eu (see Redmine #"1408":https://issue.openaire.research-infrastructures.eu/issues/1408)
946
October 02, 2015:
947
  - Fixed an issue of Anja Oberländer (<Anja.Oberlaender@uni-konstanz.de>) who couldn't see some documents under "http://box.openaire.eu":http://box.openaire.eu, because she didn't belong to "Reviewers" group (forwarded by Claudio Atzori)
948
  - Polished the rewrite/proxy rules for lod.openaire.eu (see Redmine #"1408":https://issue.openaire.research-infrastructures.eu/issues/1408)
949
October 01, 2015:
950
  - Ported the missing reverse proxy rules for /validator-{admin,services} from furkot2.vls (old.openaire.eu, Nginx) to openaire-www.vls (www.openaire.eu, Apache2) (reported by Nikon Gasparis, see Redmine #"1577":https://issue.openaire.research-infrastructures.eu/issues/1577)
951
  - Created /mnt/virtuoso/upload directory writable by driver group on virtuoso.openaire.eu (asked by Giorgos Alexiou, see Redmine #"1408":https://issue.openaire.research-infrastructures.eu/issues/1408)
952
  - A new proxy rules for ^/data/ requests on lod.openaire.eu (see above)
953
September 30, 2015:
954
  - Enabled a redirection from "https://guidelines.openaire.eu/wiki/OpenAIRE_Guidelines:_For_Literature_repositories":https://guidelines.openaire.eu/wiki/OpenAIRE_Guidelines:_For_Literature_repositories to "https://guidelines.openaire.eu/en/latest/literature/index.html":https://guidelines.openaire.eu/en/latest/literature/index.html (asked by Nikon Gasparis, see Redmine #"1571":https://issue.openaire.research-infrastructures.eu/issues/1571)
955
  - Updated avroknife from 0.9.3 to 1.0.5 on gateway.hadoop.iis.openaire.eu (asked by Mateusz Kobos, see Mantis #"9559":https://mantis.icm.edu.pl/view.php?id=9559)
956
September 29, 2015:
957
  - Open access to virtuoso.openaire.eu via SSH from Athena RC network (asked by Giorgos Alexiou)
958
  - Open access to lod.openaire.eu via HTTP from the whole world (asked by Christoph Lange)
959
  - /var/www/lod directory made writable for driver group at virtuoso.openaire.eu (see Redmine #"1569":https://issue.openaire.research-infrastructures.eu/issues/1569)
960
  - christoph.lange & george.papastefanatos added to driver group at virtuoso.openaire.eu (see Redmine #"1568":https://issue.openaire.research-infrastructures.eu/issues/1568)
961
September 28, 2015:
962
  - Installed missing packages for Virtuoso, e.g. iSPARQL, Conductor, BPEL, etc
963
  - Configured a reverse proxy for "http://lod.openaire.eu/sparql":http://lod.openaire.eu/sparql
964
  - Added permissions for managing Virtuoso server and editing virtuoso.ini file for "driver" group
965
September 25, 2015:
966
  - Restored a backup dump of dnet_openaireplus database of PostgreSQL on services.openaire.eu (asked by Alessia Bardi & Michele Artini)
967
September 24, 2015:
968
  - Increased /srv from 400GB to 500GB on solr.openaire.eu
969
  - Configured lod.openaire.eu (see Redmine #"1408":https://issue.openaire.research-infrastructures.eu/issues/1408)
970
September 23, 2015:
971
  - Granted the privileges for Dimitris Pierrakos to an access Piwik statistics of pilot Portugal repositories (see Redmine #"1483":https://issue.openaire.research-infrastructures.eu/issues/1483)
972
September 22, 2015:
973
  - Now Virtuoso server on virtuoso.openaire.eu runs as an unprivileged "virtuoso" user
974
  - Configured a reverse proxy for virtuoso.openaire.eu
975
September 21, 2015:
976
  - Created a new VM virtuoso.openaire.eu for Virtuoso server (see Redmine #"1391":https://issue.openaire.research-infrastructures.eu/issues/1391)
977
  - Deployed Virtuoso Opensource 7 server there
978
September 17, 2015:
979
  - Removed .hprof file of 8380 (it had 4.8GB) on services.openaire.eu, because its / partition was near full-filled
980
  - Asked Alessia & Claudio for removing old versions of is.war on services.openaire.eu, because of the same issue (see above)
981
  - Removed old logs of HDFS, MapReduce and Oozie on ci-test.hadoop.ci.openaire.eu, because its / partition was near full-filled
982
  - Fixed DNS settings for openaire.eu (see Redmine #"1532":https://issue.openaire.research-infrastructures.eu/issues/1532)
983
September 16, 2015:
984
  - Increased /srv on stats.openaire.eu from 150GB to 200GB
985
  - Configured Joomla for Piwik tracking on www.openaire.eu (we forgot about it yesterday)
986
  - Debugging an issue with a big load and poor I/O performance on stats.openaire.eu, because of a lot of long running SELECTs of PostgreSQL
987
September 15, 2015:
988
  - Migrated Joomla portal from furkot2.vls to openaire-www.vls
989
  - Stopped and uninstalled Redis on openaire-www.vls
990
September 14, 2015:
991
  - Created backup of Joomla on new.openaire.eu, asked by Argiro
992
September 10, 2015:
993
  - Created backup of Joomla on new.openaire.eu, asked by Argiro
994
  - Created backup of Joomla on www.openaire.eu, asked by Katerina
995
September 8, 2015:
996
  - Installed and configured Fail2Ban on test.openaire.eu (after Eri's email)
997
  - Patched apache-{auth,common}.conf rules of Fail2Ban, because the maintainer rules don't work with Apache2 error logs
998
  - Deployed Fail2Ban also on new.openaire.eu and beta.openaire.eu
999
September 7, 2015:
1000
  - Installed Redis server on stats.openaire.eu and moved there Redis database content from furkot2 (see Redmine #"1515":https://issue.openaire.research-infrastructures.eu/issues/1515)
1001
  - Stopped furkot2 Redis (see the Redmine ticket above)
1002
  - Open access to port 6379 (Redis) on test.openaire.eu from services.openaire.eu (asked by Alessia, see the Redmine ticket above)
1003
  - Copied Redis database content from test.openaire.eu to new.openaire.eu (see the Redmine ticket above)
1004
September 3, 2015:
1005
  - Reporting that a production portal search is not working, because Thrift on services.openaire.eu (7911 port) is dead
1006
  - Added a new recipients of DNet monitoring on services.openaire.eu and beta.services.openaire.eu
1007
  - Enabled monitoring of a beta portal search by Monit at beta.services.openaire.eu
1008
September 2, 2015:
1009
  - Reconfigured Hive on hue.hadoop.dm.openaire.eu and created MySQL database for it on hbase-master2.hadoop.dm.openaire.eu, deployed Java connector for MySQL
1010
  - Enabled web console of DM Oozie
1011
  - Installed hue-plugins on DM Hadoop JobTrackers
1012
September 1, 2015:
1013
  - Debugging an issue with validating repositories available only via HTTPS (see Redmine #"1479":https://issue.openaire.research-infrastructures.eu/issues/1479)
1014
  - Debugging an issue with Hue of DM Hadoop (reported by Eri)
1015
August 31, 2015:
1016
  - Restarted Hue server on hue.hadoop.dm.openaire.eu, because it was unresponsible (reported by Eri)
1017
  - Synchronised beta.openaire.eu with new.openaire.eu (asked by Katerina)
1018
  - Increased the actions limits for OpenAIRE Piwik (asked by Dimitris Pierrakos)
1019
  - Updated Ubuntu from Precise to Trusty on beta.openaire.eu (asked by Katerina)
1020
August 28, 2015:
1021
  - Debugging I/O issues on beta.services.openaire.eu (see Redmine #"1502":https://issue.openaire.research-infrastructures.eu/issues/1502)
1022
  - lukasz.dumiszewski and krzysztof.madry added to "driver" group on gateway.hadoop.iis.openaire.eu (see Mantis #[9545>>"https://mantis.icm.edu.pl/view.php?id=9545":https://mantis.icm.edu.pl/view.php?id=9545]])
1023
  - Restarted solr.openaire.eu in order to bump memory there
1024
August 27, 2015:
1025
  - Increased memory from 24GB to 32GB on openaire-solr
1026
  - Changed permissions for /etc/apache2/ssl/STAR_openaire_eu.key on new.openaire.eu, because SimpleSAMLphp (asked by Eri) couldn't read it
1027
August 26, 2015:
1028
  - Started nslcd daemon on test.openaire.eu, because it was dead and Eri & Argiro couldn't access there via SSH
1029
  - Synchronised test.openaire.eu with new.openaire.eu (asked by Katerina & Argiro)
1030
  - Moved some NKUA stuff from /srv to /srv2 on services.openaire.eu and gzipped some .csv files under /srv/dnet, because /srv partition was a near full-filled
1031
  - Added self-signed CNR certificate to Java keystore on services.openaire.eu and beta.services.openaire.eu (asked by Andrea Mannocci, see Redmine #"1442":https://issue.openaire.research-infrastructures.eu/issues/1442)
1032
August 25, 2015:
1033
  - Configured Nginx proxy rules for /dfm on services.openaire.eu (see Redmine #"1387":https://issue.openaire.research-infrastructures.eu/issues/1387)
1034
August 24, 2015:
1035
  - Created data_flow_monitoring database owned by dfm user in PostgreSQL and /var/lib/dfm directory on openaire-services.vls (asked by Alessia Bardi)
1036
  - Added a new IP address of Glykeria Katsari in Puppet and on a local PostgreSQL instances for OpenAIRE stats & services
1037
  - Enabled Piwik tracking in Wordpress for "http://blogs.openaire.eu":http://blogs.openaire.eu (asked by Pedro Miguel Oliveira Bento Príncipe)
1038
August 19, 2015:
1039
  - Updated Ubuntu from Precise to Trusty on test.openaire.eu (asked by Katerina)
1040
August 17, 2015:
1041
  - Created backup of Joomla on beta.openaire.eu, asked by Katerina
1042
  - Synchronised beta.openaire.eu with new.openaire.eu (asked by Katerina)
1043
August 12, 2015:
1044
  - Added an user's authentication against a local .htpasswd file on "https://analytics.openaire.eu/":https://analytics.openaire.eu/ (Dimitris Pierrakos asked for a remote access to Piwik data for UMINHO Pilot website)
1045
August 6, 2015:
1046
  - Created a new Piwik websites for 3 Portugal repositories (see Redmine #"1483":https://issue.openaire.research-infrastructures.eu/issues/1483)
1047
  - Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.14.1 to 2.14.3.
1048
August 5, 2015:
1049
  - Updated Ubuntu from Precise to Trusty on services.openaire.eu (see Redmine #"1481":https://issue.openaire.research-infrastructures.eu/issues/1481)
1050
  - Also migrated there PostgreSQL 9.1 to 9.3
1051
  - Also upgraded there MongoDB to 2.4.9
1052
August 3, 2015:
1053
  - Created a reverse proxy rules for "http://api.openaire.eu/provision/mvc/resources":http://api.openaire.eu/provision/mvc/resources (see Redmine #[844>>"https://issue.openaire.research-infrastructures.eu/issues/844":https://issue.openaire.research-infrastructures.eu/issues/844]])
1054
  - Created a reverse proxy rules for "http://api.openaire.eu/search/openSearchDescriptor":http://api.openaire.eu/search/openSearchDescriptor (see Redmine #[348>>"https://issue.openaire.research-infrastructures.eu/issues/348":https://issue.openaire.research-infrastructures.eu/issues/348]])
1055
  - Created an account openaire-blogs in OpenAIRE's Piwik ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) for accessing by Wordpress on blogs.openaire.eu (asked by Pedro Miguel Oliveira Bento Príncipe)
1056
  - Synced with Zenodo "https://www.openaire.eu/cerif_schema/cerif-1.6-2_openaire-1.0.xsd":https://www.openaire.eu/cerif_schema/cerif-1.6-2_openaire-1.0.xsd file (asked by Jan.Dvorak@ff.cuni.cz)
1057
July 17, 2015:
1058
  - Removed the old logs of Zookeeper on the masters of DM Hadoop cluster in order to take some free disk space on / partition
1059
  - Removed the old logs of Zookeeper, Hadoop HDFS and Mapreduce on the masters of test-ci.hadoop.iis.openaire.eu because of the same reason like above
1060
  - Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.13.1 to 2.14.1.
1061
July 16, 2015:
1062
  - Increased memory from 24GB to 32GB on openaire-solr-beta
1063
  - Enabled basic authentication in Nginx for "https://beta.services.openaire.eu/dfm/":https://beta.services.openaire.eu/dfm/ (see Redmine #"1442":https://issue.openaire.research-infrastructures.eu/issues/1442)
1064
July 15, 2015:
1065
  - Enabled the users authentication against CNR LDAP on solr.openaire.eu and beta.solr.openaire.eu (see Redmine #"1438":https://issue.openaire.research-infrastructures.eu/issues/1438)
1066
  - Disabled "monkeys" account on solr.openaire.eu and beta.solr.openaire.eu (see above)
1067
  - alessia.bardi and claudio.atzori added to "driver" group on solr.openaire.eu and beta.solr.openaire.eu (see above)
1068
  - Enabled the users authentication against CNR LDAP on solr.openaire.eu and beta.solr.openaire.eu (see Redmine #"1439":https://issue.openaire.research-infrastructures.eu/issues/1439)
1069
  - Disabled "monkeys" and "joomla" accounts on solr.openaire.eu and beta.solr.openaire.eu (see above)
1070
  - eri.katsari, katerina.iatropoulou and antonis.lempesis added to "driver" group on solr.openaire.eu and beta.solr.openaire.eu (see above)
1071
  - Synchronised beta.openaire.eu with new.openaire.eu (asked by Argiro)
1072
  - andrea.mannocci and alessia.bardi added to "driver" group on beta.stats.openaire.eu (see Redmine #"1441":https://issue.openaire.research-infrastructures.eu/issues/1441)
1073
July 14, 2015:
1074
  - Disabled "monkeys" account on services.openaire.eu (see Redmine #"1434":https://issue.openaire.research-infrastructures.eu/issues/1434)
1075
  - christoph.broschinski added to "driver" group on services.openaire.eu (see Redmine #"1434":https://issue.openaire.research-infrastructures.eu/issues/1434)
1076
July 13, 2015:
1077
  - Added a public SSH key of Argiro Kokogiannaki to keyring of "monkeys" user, because she needs an access to the claims database on services.openaire.eu
1078
  - Open access to port 7911 (Thrift) on services.openaire.eu from scoobydoo.di.uoa.gr (asked by Argiro)
1079
  - Enabled the users authentication against CNR LDAP on services.openaire.eu (see Redmine #"1434":https://issue.openaire.research-infrastructures.eu/issues/1434)
1080
July 10, 2015:
1081
  - Debugging an issue (504 Gateway Timeout) for guidelines.openaire.eu (see Redmine #"1425":https://issue.openaire.research-infrastructures.eu/issues/1425)
1082
  - Fixed UID/GID for "dnet" user on gateway.hadoop.iis.openaire.eu (see Redmine #"903":https://issue.openaire.research-infrastructures.eu/issues/903)
1083
  - Untared the newest bunch of arXiv PDFs: arXiv_pdf_150[456]_*.tar (see Redmine #"903":https://issue.openaire.research-infrastructures.eu/issues/903)
1084
July 09, 2015:
1085
  - Intervention on beta.services.openaire.eu because of a full-filed / partition because of a huge 8380 catelina.out log file (Katerina fixed it quickly and punished a guilty person)
1086
  - Deployed vsftpd on openaire-www.vls (asked by Jochen), because it can be helpful for uploading metadata by enternal publishers (e.g. F-1000)
1087
July 08, 2015:
1088
  - Configured a reverse proxy for /search/api on beta.services.openaire.eu (asked by Katerina for an external parties)
1089
July 07, 2015:
1090
  - Modified a reverse proxy for guidelines.openaire.eu (asked by Jochen Schirrwagen). Now we use guidelines.readthedocs.org site instead of MediaWiki instance on posredni.vls
1091
  - Made a backup of MediaWiki for guidelines.openaire.eu
1092
  - Create a redirect rule for old URLs for MediaWiki for guidelines.openaire.eu
1093
July 06, 2015:
1094
  - jochen.schirrwagen added to "driver" group on beta.services.openaire.eu (see Redmine #"1378":https://issue.openaire.research-infrastructures.eu/issues/1378)
1095
July 02, 2015:
1096
  - Restarted HBase on DM Hadoop cluster after nightly issues
1097
  - Enabled CNR LDAP authentication for the users of {beta,test}.openaire.eu (see Redmine #"1405":https://issue.openaire.research-infrastructures.eu/issues/1405)
1098
July 01, 2015: Rescued OpenAIRE2020 machines from a leap second armaggeddon
1099
June 30, 2015: Replaced a failed disk in slave4.hadoop.dm.openaire.eu
1100
June 29, 2015:
1101
  - Created a database for DFM on beta.services.openaire.eu (see Redmine #"1355":https://issue.openaire.research-infrastructures.eu/issues/1355)
1102
  - Configured Nginx on pilot.services.openaire.eu for supporting domain postgrantoapilot.openaire.eu instead of goldoapilot.openaire.eu (asked byStefania Martziou)
1103
June 26, 2015:
1104
  - Changed permissions for /var/lib/dfm on beta.services.openaire.eu on dnet:dnet (see Redmine #"1355":https://issue.openaire.research-infrastructures.eu/issues/1355)
1105
  - Disabled "monkeys" user on beta.services.openaire.eu (see Redmine #"1387":https://issue.openaire.research-infrastructures.eu/issues/1387)
1106
June 25, 2015:
1107
  - Open access to Redis & PostgreSQL port on beta.stats.openaire.eu from new.openaire.eu (asked by Eri)
1108
  - stefania.martziou added to "driver" group on pilot.services.openaire.eu and granted the same permissions like for Antonis to her (asked by Antonis)
1109
  - Created backup of Joomla on beta.openaire.eu, asked by Eri
1110
  - Synchronised beta.openaire.eu with new.openaire.eu (asked by Eri)
1111
  - Configured Nginx for a reverse proxy for DFM on beta.services.openaire.eu (see Redmine #"1387":https://issue.openaire.research-infrastructures.eu/issues/1387)
1112
June 19, 2015:
1113
  - eri.katsari, nikon.gasparis also added to "driver" group on beta.services.openaire.eu (see Redmine #"1378":https://issue.openaire.research-infrastructures.eu/issues/1378)
1114
June 18, 2015:
1115
  - andrea.manocci, sandro.labruzzo also added to "driver" group on beta.services.openaire.eu (see Redmine #"1378":https://issue.openaire.research-infrastructures.eu/issues/1378)
1116
  - Set the same rights in /etc/sudoers for "driver" group like for "monkeys" user
1117
  - Removed the rights from /etc/sudoers for the commands delivered by dnet-* packages, because they have been uninstalled during the distribution upgrade 
1118
June 17, 2015:
1119
  - Enabled CNR LDAP authentication for the users of beta.services.openaire.eu (see Redmine #"1378":https://issue.openaire.research-infrastructures.eu/issues/1378)
1120
  - alessia.bardi, claudio.atzori, michele.artini, antonis.lempesis, katerina.iatropoulou added to "driver" group there
1121
  - Mounted /home via NFS there
1122
June 16, 2015:
1123
  - Upgraded beta.services.openaire.eu from Ubuntu Precise to Trusty (see Redmine #"1355":https://issue.openaire.research-infrastructures.eu/issues/1355)
1124
June 15, 2015:
1125
  - michele.artini (CNR) added to "driver" group on gateway.hadoop.dm.openaire.eu (see Redmine #"1023":https://issue.openaire.research-infrastructures.eu/issues/1023)
1126
  - Open access to port 6379 (Redis) on new.openaire.eu from test.openaire.eu (asked by Eri)
1127
  - Open access to port 389 (Slapd) on new.openaire.eu from services.openaire.eu
1128
June 10, 2015:
1129
  - Restarted DataNodes & RegionServers of DM Hadoop cluster (see Redmine #"1367":https://issue.openaire.research-infrastructures.eu/issues/1367)
1130
  - Created backup of Joomla 3 on openaire-www.vls (aka new.openaire.eu), asked by Argiro
1131
June 9, 2015: Removed old logs of Oozie on master3.hadoop.iis.openaire.eu because of a lack of a free disk space on / partition
1132
June 8, 2015:
1133
  - Uploaded a fixed versions of Java SSL related .jar files (local_policy.jar & US_export_policy.jar) on services.openaire.eu and beta.services.openaire.eu (see Redmine #"1351":https://issue.openaire.research-infrastructures.eu/issues/1351)
1134
June 3, 2015:
1135
  - Fixed logrotate's config for rotating catalina.log and localhost_access.log on services.openaire.eu and beta.services.openaire.eu
1136
  - Killed hunged mongodump process on services.openaire.eu and restarted MongoDB there (see Redmine #"1342":https://issue.openaire.research-infrastructures.eu/issues/1342)
1137
  - giorgos.alexiou (ATHENA) added to "driver" group on gateway.hadoop.{dm,iis}.openaire.eu (asked by Eri)
1138
June 2, 2015: Open access to port 7911 (Thrift) on beta.services.openaire.eu from scoobydoo.di.uoa.gr (asked by Argiro)
1139
June 1, 2015:
1140
  - Set client_max_body_size 200M for Nginx on furkot2.vls (see Redmine #"1343":https://issue.openaire.research-infrastructures.eu/issues/1343)
1141
  - Set ssl = false for PostgreSQL on openaire-services-{beta,pilot}.vls, because we don't need SSL there
1142
May 31, 2015:
1143
  - Started PostgreSQL server on openaire-services.vls, because it was dead because of issues with permissions to a private SSL certificate
1144
  - Set ssl = false, because we don't need SSL there
1145
May 29, 2015:
1146
  - Untared and next bzipped the newest bunch of arXiv PDFs: arXiv_pdf_1412_*.tar & arXiv_pdf_150[1-3]_*.tar (see Redmine #"904":https://issue.openaire.research-infrastructures.eu/issues/904)
1147
May 28, 2015:
1148
  - Started container 8580 on openaire-services-pilot.vls, because it was dead (asked by Nikon)
1149
  - Disabled an user's authentication for goldoapilot.openaire.eu, because it's a public available now (asked by Antonis)
1150
May 28, 2015: Debuged an issue with sending messages from openaire-services-pilot.vls (asked by Nikon)
1151
May 26, 2015: Created a directory (/srv/www/static/openaire2020/wp10/deadlines/) on oscypek.vls for OpenAIRE2020 WP10 deadlines pages (asked by Mateusz Kobos)
1152
May 25, 2015: Installed php5-mcrypt package on openaire-www.vls (asked by Eri)
1153
May 22, 2015:
1154
  - Removed some old logs of IS (8280) and 8380's .hprof files on services.openaire.eu, because / partition was full-filled.
1155
  - Created backup of Joomla 3 on openaire-www.vls (aka new.openaire.eu), asked by Argiro
1156
  - Restored Joomla from furkot2 on test.openaire.eu, asked by Argiro
1157
May 21, 2015:
1158
  - Migrated a proxy rules for {blogs,box,guidelines,mining,validator}.openaire.eu from furkot2 (Nginx) to openaire-www.vls (Apache2)
1159
May 20, 2015:
1160
  - jyunyao.huang (UBONN) added to "driver" group on gateway.hadoop.dm.openaire.eu
1161
  - Migrated a proxy rules for api.openaire.eu from furkot2 (Nginx) to openaire-www.vls (Apache2)
1162
May 19, 2015:
1163
  - Created a new Piwik website for tracking UMINHO repository (asked by Dimitris)
1164
  - Restarted slave8.hadoop.dm.openaire.eu because of issue with Java zombie processes (see Redmine #"1326":https://issue.openaire.research-infrastructures.eu/issues/1326)
1165
May 14, 2015: Disabled authentication for /simplesaml requests on new.openaire.eu (asked by Eri, see Redmine #"1251":https://issue.openaire.research-infrastructures.eu/issues/1251)
1166
May 12, 2015:
1167
  - Installed python-pip and pymongo on beta.services.openaire.eu (asked by Sandro La Bruzzo, see Redmine #"1271":https://issue.openaire.research-infrastructures.eu/issues/1271)
1168
  - Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.12.0 to 2.13.1.
1169
May 11, 2015:
1170
  - Created NetApp volumes (4TB) for objectStore's PDFs files (see Redmine #"1271":https://issue.openaire.research-infrastructures.eu/issues/1271) adnd mounted via NFS on services.openaire.eu and beta.services.openaire.eu
1171
  - Deployed a new .war files of 8380 container on services.openaire.eu which includes a new settings of webapps log4j.properties
1172
May 8, 2015:
1173
  - Prepared Nginx rules (/validator-admin/ & /validator-service/) for a new production validator (see Redmine #"1303":https://issue.openaire.research-infrastructures.eu/issues/1303)
1174
  - Disabled the last changes for an access policy for goldoapilot.openaire.eu, now it's protected by a basic authentication again
1175
  - Installed python-pip and pymongo on services.openaire.eu (asked by Sandro La Bruzzo, see Redmine #"1271":https://issue.openaire.research-infrastructures.eu/issues/1271)
1176
May 7, 2015: Enabled an open access to goldoapilot.openaire.eu for NKUA's networks, the rest can see a static page
1177
May 6, 2015: Enabled a basic authentication for goldoapilot.openaire.eu, because it's still not ready for a public access (asked by Natalia)
1178
May 4, 2015: Applied a new logging.properties for 8280 and 8980 on beta.services.openaire.eu (see Redmine #"1289":https://issue.openaire.research-infrastructures.eu/issues/1289)
1179
April 30, 2015: Configured goldoa-pilot.openaire.eu as an alias for goldoapilot.openaire.eu 
1180
April 29, 2015:
1181
  - Antonis Lampesis added to the user aliases POSTGRES_ADMINS and DNET_ADMINS in /etc/sudoers on pilot.services.openaire.eu
1182
  - Configured goldoapilot.openaire.eu domain in DNS and Nginx for it on pilot.services.openaire.eu 
1183
  - Removed unused data folder jenshaarld.aasheim/ on box.openaire.eu (Jens Harald Aasheim changed his username to j.aasheim)
1184
April 28, 2015:
1185
  - Created backup of Joomla 3 on openaire-www.vls (aka new.openaire.eu), asked by Argiro
1186
  - Changed symlinks for the logs of 8280 (/var/log/dnet/is instead of /var/log/tomcat_dnet/8280) and 8980 (/var/log/dnet/provision instead of /var/log/tomcat_dnet/8980) containers on beta.services.openaire.eu and services.openaire.eu (see Redmine #"1289":https://issue.openaire.research-infrastructures.eu/issues/1289)
1187
  - Applied a new logging.properties for 8380 on beta.services.openaire.eu (see Redmine #"1289":https://issue.openaire.research-infrastructures.eu/issues/1289)
1188
April 24, 2015:
1189
  - Created backup of Joomla 3 on openaire-www.vls (aka new.openaire.eu), asked by Argiro
1190
  - Allowed access of new.openaire.eu to 7911 port on beta.services.openaire.eu, asked by Argiro
1191
April 19, 2015: Set log_min_duration_statement = 10000 in /etc/postgresql/9.1/main/postgresql.conf on stats.openaire.eu and beta.stats.openaire.eu
1192
April 17, 2015: Set log_min_duration_statement = 100 in /etc/postgresql/9.1/main/postgresql.conf on stats.openaire.eu and beta.stats.openaire.eu, because postgresql.log was too big because of many logged INSERT statements
1193
April 16, 2015: Created group "joomla" on openaire-www.vls (new.openaire.eu) in order to give NKUA people an access to Apache server logs
1194
April 14, 2015: Increased size of /srv2 partition (MongoDB's objectStore) on beta.services.openaire.eu from 1.5TB to 1.7TB (see Redmine #"1271":https://issue.openaire.research-infrastructures.eu/issues/1271)
1195
April 15, 2015: Deployed ci-test.hadoop.iis.openaire.eu, a new pseudo Hadoop cluster for running IIS integration tests (see Redmine #"781":https://issue.openaire.research-infrastructures.eu/issues/781)
1196
April 3, 2015: Deployed SimpleSAMLphp on new.openaire.eu (see Redmine #"1251":https://issue.openaire.research-infrastructures.eu/issues/1251)
1197
March 30, 2015: Removed unused Nginx proxy rules for /usagestats on furkot2 (asked by Eri)
1198
March 30, 2015: Restored /var/www/templates/yoo_solar/styles/openaire/css/*.css files from a weekly snapshot of the backup (asked by Argiro)
1199
March 30, 2015: Created /var/log/dnet/validator/ directory for the validator logs on openaire-services, openaire-services-beta and openaire-services-pilot (asked by Nikon)
1200
March 26, 2015: Created a new Piwik website for tracking the beta validator (asked by Nikon)
1201
March 25, 2015: Restored Joomla from furkot2 on new.openaire.eu, because it has been damaged by Natalia
1202
March 24, 2015: Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.11.0 to 2.12.0.
1203
March 24, 2015: Moved analytics.openaire.eu to piwik.vls.icm.edu.pl which is running under control of Debian Jessie (Apache 2.4.10 & PHP 5.6.6)
1204
March 24, 2015: Configured a reverse proxy (by Nginx) for La Referencia ("http://lareferencia.openaire.eu/)":http://lareferencia.openaire.eu/)
1205
March 24, 2015: Assisting during the upgrade of the openaire Joomla component on the production and 8380 container on services.openaire.eu (asked by Katerina Iatropoulou).
1206
March 23, 2015: Deployed Tomcat instances for Gold Open Access (see Redmine #"1168":https://issue.openaire.research-infrastructures.eu/issues/1168 and La Referencia (see Redmine #"1138":https://issue.openaire.research-infrastructures.eu/issues/1138), added permissions to Nikon Gasparis for managing PostgreSQL server and Tomcat services on openaire-services-pilot machine
1207
March 20, 2015: Fixed proxy rules for "http://api.openaire.eu/projects/":http://api.openaire.eu/projects/{dspace,eprints,tsv}/ requests, now handled by provision.war container at services.openaire.eu:8980 (see Redmine #"1136":https://issue.openaire.research-infrastructures.eu/issues/1136)
1208
March 17, 2015:
1209
  - Unpacked NKUA's .tar files with ArXiv PDF files (arXiv_pdf_1409_*.tar & arXiv_pdf_141[01]_*.tar)
1210
  - Created README file in /mnt/harvested_pdfs/ on openaire-services
1211
  - Compressed NKUA's .tar files (arXiv_pdf_130[89]_*.tar, arXiv_pdf_1409_*.tar & arXiv_pdf_141[01]_*.tar)
1212
March 9-11, 2015: Investigation on why home page of production portal ("http://www.openaire.eu/)":http://www.openaire.eu/) is so slowly (noticed by Natalia). The reason was a huge k0wx9_sh404sef_urls table of Joomla and long running SELECT queries which needed a few seconds to finish and get hundreds of thousands of records and many mega bytes of data.
1213
March 10, 2015: Configured on beta.openaire.eu a reverse proxy to new separated validator services (/validator, /validator-admin, /validator-service) (asked Nikon Gasparis)
1214
March 10, 2015: Directory /var/www/images/ writable for joomla user on furkot2, openaire-www, openaire-www-{beta,test} (asked Katerina)
1215
March 9, 2015: Created dnet.beta and dnet.production users on IIS Hadoop cluster (asked by Claudio and Marek Horst)
1216
March 9, 2015: Installed advancecomp package (which delivers advpng utility) for PNG optimization on furkot2, openaire-www, openaire-www-{beta,test} (asked Katerina)
1217
March 7, 2015: Increased (to 5GB) quota for najla.rettberg on "http://box.openaire.eu/":http://box.openaire.eu/, removed doubled account Najla.Rettberg
1218
March 6, 2015: Installed optipng & pngcrush packages for PNG optimization on furkot2, openaire-www, openaire-www-{beta,test} (asked Katerina)
1219
March 5, 2015: Deployed a new VM openaire-services-pilot for handling OpenAIRE pilot services, for example LaReferencia (#"1138":https://issue.openaire.research-infrastructures.eu/issues/1138) or Gold Open Access (see Redmine #"1168":https://issue.openaire.research-infrastructures.eu/issues/1168)
1220
March 4, 2015: Stopped PostgreSQL on furkot2, openaire-www, openaire-www-{beta,test}, because it's unused there
1221
March 3, 2015: Deployed a new VM openaire-www for upgrading the portal Joomla to version 3.x (asked by Natalia). It will replaces furkot2 in a few months.
1222
March 3, 2015: Integrated Piwik (analytics.openaire.eu) with guidelines.openaire.eu
1223
March 3, 2015: Configured Piwik (analytics.openaire.eu) for validator.openaire.eu, guidelines.openaire.eu, blogs.openaire.eu and goldpilot.openaire.eu (asked by Natalia)
1224
March 3, 2015: Created /user/dnet.beta and /user/dnet.production directories in DM HDFS (asked by Claudio and Marek Horst)
1225
March 3, 2015: Created backup of /var/www/components/com_openaire/ and /var/www/templates/yoo_solar/ directories on openaire-www-beta and assisting during the upgrade of the openaire Joomla component
1226
March 2, 2015: Created /user/dnet.beta and /user/dnet.production directories in IIS HDFS (asked by Claudio and Marek Horst)
1227
March 2, 2015: Fixed LDAP settings on "http://box.openaire.eu/":http://box.openaire.eu/ broken by Natalia
1228
February 27, 2015: Removed doubled account Natalia.manola on "http://box.openaire.eu/":http://box.openaire.eu/
1229
February 20, 2015: Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.10.0 to 2.11.0.
1230
February 17, 2015: Increased memory from 16GB to 24GB on openaire-solr and openaire-solr-beta machines (see Redmine #"1136":https://issue.openaire.research-infrastructures.eu/issues/1136)
1231
February 16, 2015: Fixing a broken search feature of the portal ("https://www.openaire.eu/search/find)":https://www.openaire.eu/search/find) because of java.lang.OutOfMemoryError on openaire-solr machine with the index (please Redmine issue #"1136":https://issue.openaire.research-infrastructures.eu/issues/1136)
1232
February 11, 2015: Added SSH public key of Andrea Mannocci to authorized_keys of "monkeys" user
1233
February 10, 2015: Deployed OwnCloud instance at "https://box.openaire.eu/":https://box.openaire.eu/ (asked by Natalia)
1234
February 6, 2015: Made /srv/www/joomla/api-docs/ on furkot2 writable for "www-data" group (and "joomla" user) (asked by Natalia who wanted to change CSS)
1235
February 4, 2015: Created accounts on the gateway of DM Hadoop cluster for Sahar Vahdati and Christoph Lange from UBONN (please see Redmine issue #"1089":https://issue.openaire.research-infrastructures.eu/issues/1089).
1236
February 4, 2015: Configured a proxy rule for a new API exporting TSV of projects (please see Redmine issue #"1106":https://issue.openaire.research-infrastructures.eu/issues/1106).
1237
February 2, 2015: Renamed the mailing list openaireplus-wp7@bwnmail.icm.edu.pl to openaire-mining@bwnmail.icm.edu.pl (asked by Mateusz Kobos).
1238
January 30, 2015: Increased size of /srv2 partition (from 2 TB to 2.4 TB) on services.openaire.eu.
1239
January 27, 2015: Increased size of /srv3 partition (from 400 GB to 600 GB) on services.openaire.eu.
1240
January 26, 2015: Increased value of Nginx timeouts on www.openaire.eu (please see Redmine issue #"1079":https://issue.openaire.research-infrastructures.eu/issues/1079).
1241
January 26, 2015: Increased size of /srv partition (from 450 GB to 500 GB) on services.openaire.eu.
1242
January 23, 2015: Increased size of /srv partition (from 400 GB to 450 GB) on services.openaire.eu.
1243
January 23, 2015: Installed xmlstarlet package on services.openaire.eu and beta.services.openaire.eu (asked by Alessia Bardi, please see Redmine issue #"1076":https://issue.openaire.research-infrastructures.eu/issues/1076).
1244
January 22, 2015: Assisting during the upgrade of the openaire Joomla component on the production and 8380 container on services.openaire.eu (asked by Katerina Iatropoulou). Fixed the write permissions to /var/www/joomla/components/com_openaire/ directory for joomla user on beta.openaire.eu.
1245
January 16, 2015: Synchronised test.openaire.eu with the production (asked by Katerina Iatropoulou).
1246
January 14, 2015: Assisting during the upgrade of 8380 container on services.openaire.eu (asked by Katerina Iatropoulou).
1247
January 7, 2015: Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.9.1 to 2.10.0.