Project

General

Profile

D64 Servers Administration Operations Changelog » History » Version 6

Marek Horst, 29/06/2018 03:03 PM
Updating Servers Administration Operations Changelog with tasks undertaken in June 2018

1 1 Marek Horst
h1. Change Log for servers administration operations
2
3 2 Marek Horst
h2. 2nd Period (14/12/2016 - 30/06/2018)
4
5 4 Marek Horst
2nd period list of tasks was based on tickets defined in OpenAIRE's redmine issue tracker and mantis - ICM's internal task tracker.
6
7 2 Marek Horst
June 2018:
8 6 Marek Horst
* #3756	Add new user on beta.services.openaire.eu
9
* #3746	Update beta.openaire.eu joomla
10
* #3688	monitor.openaire.eu - launch publicly available
11
* #3651	Problem with LDAP login in beta
12
* #3479	LDAP service migration at CNR
13
* #3409	[PROD] New Solr server cluster deployment
14
* #3704	Access issues LDAP - administrator portal
15
* #2097	Update arXiv pdfs on the ICM ftp server (repeated every month)
16
* #3712	Older instance of postgres backup
17
* #3391	Rename beta.repomanager.openaire.eu
18
* #3703	Open ssh access of Beta from new  CNR machine
19
* #3710	Configuration for profiles API
20 2 Marek Horst
21
May 2018:
22 5 Marek Horst
* #3667	Cannot update beta index
23
* #2913	Occasional 502 Proxy Error while communicating with Oozie server deployed on IIS cluster
24
* #3646	Lost ssh access to openaire-beta vm
25
* #3657	Let Alessia enter on mongodb.services.openaire.eu
26
* #3648	Delete piwik site 
27
* #3575	Location of front end portal files
28
* #2834	Access to piwik site generation script from beta.openaire
29
* #3469	Monitoring mongodb on mongodb.services.openaire.eu
30
* #3630	access to box.openaire.eu
31
* "mantis#9574":https://mantis.icm.edu.pl/view.php?id=9574 Uploading two updated configuration files required by integration tests suite on ci.ceon.pl (performed several times throughout the project)
32 1 Marek Horst
33
April 2018:
34 5 Marek Horst
* #3622	Add  Robert Paciorek to CNR's LDAP and ICM Sysadmins group
35
* #3619	Internal oozie server error when accessing web console via HTTP
36
* #3442	Request for VM (Application Server)
37
* #3610	Cloudera Manager (CDH) 5.9 issue with HUE and LDAP authentication
38
* #3209	Machine for Shibboleth IDP
39
* #3425	Network FS between virtuoso VM and DM cluster
40
* #3579	Configuration of uoa-admin-tools
41
* #3592	Handshake failure ("unrecognized_name")
42
* #3204	Machine to host the OpenAIRE SSO service
43 1 Marek Horst
* "mantis#9736":https://mantis.icm.edu.pl/view.php?id=9736 Making ResourceManager being responsive again on IIS CI Test cluster
44
45
March 2018:
46 6 Marek Horst
* #2785	DLI services and ElasticSearch cluster deployment
47 5 Marek Horst
* #3502	Data source harvesting - IP problem(?)
48
* #3557	Transactional mail service
49
* #3414	MongoDB in beta.services.openaire.eu
50
* #3189	OpenAIRE API rate limits
51
* #2449	Portal SEO
52
* #3114	sms: visualizing tool LOD 
53
* #3449	Make statistics databases deployed in beta and production accessible from PTM machine
54
* #3486	Error in Matomo (piwik)
55
* #3208	Update BETA user management service with reset password and remind username fuctionalities
56
* #3215	BETA 8380 in some cases fails to  restart 
57
* #3003	repository hostname not resolved
58 1 Marek Horst
59
February 2018:
60 5 Marek Horst
* #3393	howto access to new Hadoop cluster cdh5
61
* #3387	Support contact email for OpenAIRE AAI
62
* #3112	Give sudo access to panagiotis.kanakakis to pilot.services.openaire.eu
63
* #3184	Export project details for Zenodo
64
* #3389	Statistics on LOD visits
65 1 Marek Horst
66
January 2018:
67 5 Marek Horst
* #3193	openaire.eu mail senders/SPF settings for openaire.eu
68
* #3330	LD-R is not available
69
* #3438	Files are missing from box.openaire.eu
70
* #2872	Access to Arthur Lackner
71
* #3164	url encoding problem
72
* #2869	LOD Link not working
73
* #3379	Access on ICM to Arthur Lackner
74
* #3195	Machine for the OpenAIRE anonymization tool 
75
* #3364	Increase disk space for /vol/openaire_objectstore_pdfs on services.openaire.eu
76
* #3290	Add eduPerson schema to beta ldap
77
* #3352	Openaire DM Hadoop: gateway:/mnt/tmp - out of inodes
78 2 Marek Horst
79 4 Marek Horst
December 2017:
80
* #2284	 www.openaire.eu returns sometimes ERR_CONNECTION_REFUSED
81
* #3362	Clean up tmp diretory of services.openaire.eu
82
* #3334	user account
83
* #2855	Prepare dedicated machine for PTM
84
* #3348	Unable to connect with sites via HTTPS requiring AES 256 ciphers
85
* #3354	Remove authentication from demo.openaire.eu
86
* #3301	monitor.openaire.eu/administrator returns internal server error
87
* #3212	OpenAIRE newsletter statistics
88
* #3333	guidelines.openaire.eu does not rebuild from github repo sources
89 2 Marek Horst
* #3312	Connection problem to hadoop
90
91 4 Marek Horst
November 2017:
92
* #3329	In demo.openaire.eu: add alias  beta.explore.openaire.eu
93
* #3325	api.openaire.eu: add hostname develop.openaire.eu
94
* #2809	Bots and deep paging 
95
* #3306	is there a postgres available for beta.repomanager.openaire.eu
96
* #3261	New node js app for demo portal
97
* #3294	Freestyle support plugin, need of a table
98
* #3241	provide access to the hadoop cluster
99
* #3017	A new vm machine for monitoring - Joomla
100
* #3287	check monitor.openaire.eu after rrecovery due to crash
101
* #3284	www.openaire.eu returns 403 forbidden
102
* #3159	503 Service Unavailable when opening 10 tabs with publication details
103
* #3277	install curl on gateway.hadoop.dm.openaire.eu
104
* #2984	A new vm machine for Joomla
105
* #3279	please help with ssh login
106 2 Marek Horst
* #2597	Bad response from api.openaire.eu/oai_pmh
107
108 4 Marek Horst
October 2017:
109
* #3223	Need to run dist-upgrade on beta.services.openaire.eu and services.openaire.eu
110
* #2566	Stats tab of big aggregators like La Referencia does not load in reasonable time
111
* #3217	Domain for datathon
112
* #3179	New api documentation pages
113
* #3160	URL encoding: different settings on beta and production?
114 2 Marek Horst
* #3143	Production upgrade to Java8
115
116 4 Marek Horst
September 2017:
117
* #3161	Update proxy mappings for api.openaire.eu
118
* #2950	Upgrade beta aggregator to java8
119
* #3121	Disable connections from beta.services.openaire.eu to postgresql.services.openaire.eu
120 3 Marek Horst
* #3083	Federeted Queries over SPARQL endpoint give different results
121
122 4 Marek Horst
August 2017:
123 3 Marek Horst
* #3071	CNR LDAP - request for account
124 1 Marek Horst
125 4 Marek Horst
July  2017:
126
* #3016	Problem accessing project API: 503 Service Unavailable 
127
* #2840	setup ldap authentication for OCEAN hadoop services
128
* #2999	New spring boot web application to deploy
129
* #2549	Machine for a new portal
130
* #2246	investigate usage of api.openaire.research-infrastructures.eu
131
* #2876	LOD Ontology (vocabs)
132
* #3006	enable CORS at analytics.openaire.eu/piwik.php
133
* #2541	Enable CORS for Vocabularies API
134
* #2313	dismiss dnet-hadoop-parent
135
* #2763	struts2 vulnerability in the validator
136
* #2754	Hardening the services machines
137
* #2998	analytics.openaire.eu is not responding
138
* #2979	Spark History Server on IIS cluster is down
139 2 Marek Horst
* #2974	enable access from claims service to user-management service
140
* "mantis#9693":https://mantis.icm.edu.pl/view.php?id=9693 Making spark history server available again on CDH5 cluster
141
* "mantis#9675":https://mantis.icm.edu.pl/view.php?id=9675 Fixing spark history server webapp returning 503 error
142 3 Marek Horst
* "mantis#9654":https://mantis.icm.edu.pl/view.php?id=9654 Configuring apache httpd on hadoop clusters
143 2 Marek Horst
* "mantis#9525":https://mantis.icm.edu.pl/view.php?id=9525 Adjusting puppeta and monit configuration on hadoop-ci-test
144
* "mantis#9738":https://mantis.icm.edu.pl/view.php?id=9738 Dropping openaire libs out of local maven repo on jenkins machine
145 1 Marek Horst
* "mantis#9737":https://mantis.icm.edu.pl/view.php?id=9737 Providing jenkins worker SSH access to iis-ci-test.ocean.icm.edu.pl
146
147 4 Marek Horst
June 2017:
148
* #2968	information system backup frequency
149
* #2957	openaire-dm-hadoop-s4 problems
150
* #2945	Pilot proxy changes
151
* #2463	trigger the generation of $idsite in Piwik for dataproviders
152
* #2705	new datasource: glasstree
153
* #2947	IIS CDH5 Ocean cluster is down
154
* #1828	Monitor the access to the OpenAIRE API
155
* #2865	Access to Google webmaster tools
156
* #2914	jobtracker(s) temporarily unavailable 
157
* #2323	Limit access to the direct index API
158 2 Marek Horst
* #2798	catalina.out of 8280: record is not compliant, transformation is interrupted.
159 1 Marek Horst
* "mantis#9735":https://mantis.icm.edu.pl/view.php?id=9735 Fixing IIS build failures
160
161 4 Marek Horst
May 2017:
162
* #2813	Preparing demo.openaire.eu
163
* #2837	User Management log files
164
* #2804	Enable https in demo.openaire.eu
165
* #2639	More RAM for openaire-solr-beta.vls
166
* #2580	Environment Preparation
167
* #2761	Different containers logs design for a production & beta services
168
* #2800	Cannot login on the validator
169
* #2831	Metrics API
170
* #2825	disk space on beta solr server
171
* #2812	"dnet8480" in 8480 has no "w" rights on /var/log/dnet/search/
172 1 Marek Horst
* #2817	UBONN access to ocean cluster
173
174 4 Marek Horst
April 2017:
175
* #2477	Use cached values for information coming from IS
176
* #2799	More RAM for openaire-services.vls
177
* #2790	Different size of PostgreSQL "stats" databases on openaire-stats-beta.vls and openaire-stats.vls
178
* #2771	create dnet8280 user on DM cluster
179 1 Marek Horst
* #2769	Shutdown of furkot2 (aka old.openaire.eu)
180
* "mantis#9725":https://mantis.icm.edu.pl/view.php?id=9725 Hooking up OpenAIRE IIS with sonar.ceon.pl
181
* "mantis#9678":https://mantis.icm.edu.pl/view.php?id=9678 Optimizing memory configuration IIS CDH5 cluster
182
183 4 Marek Horst
March 2017: 
184
* #2760	Copy directories from netapp1-nfs:/vol/openaire_objectstore_pdfs to netapp2-nfs:/vol/openaire_beta_objectstore_pdfs
185
* #2758	Switching api.openaire.eu from furkot2.vls to openaire-www.vls
186
* #2753	Need access to the IIS HDFS
187
* #2249	jobtracker returns error 500
188
* #2581	Virtuoso for LOD production
189
* #2175	MongoDB backend for the production services
190
* #2584	ftp account for exeley
191
* #2431	Piwik Authentication Token
192
* #2280	google fails to fetch robots.txt
193
* #2520	Java and SSL: Could not generate DH keypair
194 3 Marek Horst
* #2051	Jobtracker@DM error 500
195 1 Marek Horst
* "mantis#9723":https://mantis.icm.edu.pl/view.php?id=9723 Fixing lost node on hadoop-ci-test.vls.icm.edu.pl
196
* "mantis#9724":https://mantis.icm.edu.pl/view.php?id=9724 Providing access to yarn web interfaces on hadoop-ci-test
197
* "mantis#9719":https://mantis.icm.edu.pl/view.php?id=9719 Fixing Resource Manager failures ON IIS CI Test cluster
198
* "mantis#9709":https://mantis.icm.edu.pl/view.php?id=9709 Renaming OCEAN cluster hosts
199
200 4 Marek Horst
February 2017:
201
* #2513	Gathering portal piwik logs for website usage analysis
202
* #2637	DIGITAL.CSIC Piwik Tracking
203
* #2426	Comparison of usage logs
204
* #2603	[solr.openaire.eu] memory size
205
* #2594	Piwik Robots List Update
206 3 Marek Horst
* #2393	Migration to new Cluster and SPARK for LOD
207 1 Marek Horst
* "mantis#9691":https://mantis.icm.edu.pl/view.php?id=9691 Updating iis-ci-test.ocean.icm.edu.pl requirements
208
* "mantis#9699":https://mantis.icm.edu.pl/view.php?id=9699 Fixing random documents classification failures 
209
* "mantis#9710":https://mantis.icm.edu.pl/view.php?id=9710 Considering upgrade to 5.10.0, assessing potential risks
210 3 Marek Horst
* "mantis#9711":https://mantis.icm.edu.pl/view.php?id=9711 Fixing virtual name node name resolution on CDH5 IIS cluster
211
* "mantis#9716":https://mantis.icm.edu.pl/view.php?id=9716 Dealing with Internal Server Error on IIS OCEAN CDH5 cluster master nodes
212 1 Marek Horst
213 4 Marek Horst
January 2017:
214
* #2524	SSLHandshakeException when updating BETA stats caches 
215
* #2565	Security problem: SOAP methods are not protected
216 2 Marek Horst
* #2558	ldap permissions to access test.openaire.eu
217
* "mantis#9695":https://mantis.icm.edu.pl/view.php?id=9695 Fixing DataNode unavailable to NameNode on iis-ci-test.ocean.icm.edu.pl
218
219 4 Marek Horst
December 2016:
220
* #2494	Stats update job failed on BETA
221
* #2511	IIS CDH4 cluster resource re-allocation
222
* #2521	Secured access to mining.openaire.eu
223 3 Marek Horst
* #2523	wild tomcat running on services.openaire.eu
224
* "mantis#9688":https://mantis.icm.edu.pl/view.php?id=9688 Updating CDH5 cluster versions to 5.9.0 
225
* "mantis#9687":https://mantis.icm.edu.pl/view.php?id=9687 Purging and reallocating old CDH4 cluster resources
226
* "mantis#9636":https://mantis.icm.edu.pl/view.php?id=9636 Fixing CDH5 integration test cluster jobs deadlock
227 2 Marek Horst
* "mantis#9631":https://mantis.icm.edu.pl/view.php?id=9631 Upgrading CDH5 integration test cluster
228 1 Marek Horst
229
h2. 1st Period (01/01/2015 - 13/12/2016)
230
231
December 13, 2016:
232
  - Updated Oozie sharelibs on ci-test.hadoop5.iis.openaire.eu, see Mantis #"9691":https://mantis.icm.edu.pl/view.php?id=9691
233
  - Generated SSL cert signed by Let's Encrypt for mining.openaire.eu and enabled HTTPS for that site, see Redmine #"2521":https://issue.openaire.research-infrastructures.eu/issues/2521
234
  - Removed old and unused LVM volumes on Xen openaire-dm-hadoop[45]-dom0 machines (they replaced openaire-iis-hadoop[12]-dom0)
235
  - Created LVM volumes for openaire-dm-hadoop-s[11-16] on openaire-dm-hadoop[45]-dom0, see Redmine #"2511":https://issue.openaire.research-infrastructures.eu/issues/2511
236
December 12, 2016:
237
  - Deployed iis-ci-test.ocean.icm.edu.pl, a new pseudo Hadoop cluster for running IIS integration tests on CDH5, see Mantis #"9688":https://mantis.icm.edu.pl/view.php?id=9688
238
  - Created a new pseudo Hadoop cluster (IIS CI Test) for running IIS integration tests on CDH5 maintained by Cloudera Manager on eos-cr-mgmt1.ocean.icm.edu.pl, see above
239
December 09, 2016:
240
  - Upgraded CDH (from 5.7.5 to 5.9.0) also on ci-test.hadoop5.iis.openaire.eu, see Mantis #"9681":https://mantis.icm.edu.pl/view.php?id=9681
241
  - Removed HBase from ci-test.hadoop5.iis.openaire.eu, see above
242
  - Shutdowned all machines of the old IIS CDH4 Hadoop cluster, see Redmine #"2512":https://issue.openaire.research-infrastructures.eu/issues/2512
243
  - Shutdowned openaire-iis-hadoop4-dom0 machine
244
  - Renamed openaire-iis-hadoop1-dom0 machine to openaire-dm-hadoop4-dom0 and openaire-iis-hadoop2-dom0 machine to openaire-dm-hadoop5-dom0
245
December 08, 2016:
246
  - Upgraded CDH (from 5.7.5 to 5.9.0) on OCEAN IIS CDH5 Test cluster, see Mantis #"9681":https://mantis.icm.edu.pl/view.php?id=9681
247
December 07, 2016:
248
  - Created a ticket for announcing shutdown of IIS CDH4 Hadoop cluster (see Redmine #"2511":https://issue.openaire.research-infrastructures.eu/issues/2512)
249
  - Upgraded Cloudera Manager agents for OCEAN IIS CDH5 Test cluser from 5.7.0 to 5.9.0 because of Cloudera Manager server upgrade
250
December 06, 2016:
251
  - Closed the Redmine tickets #2344, #2431, #2463
252
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.16.5 to 2.17.1.
253
December 02, 2016:
254
  - Added missing index.html files in components/, modules/ and plugins/ subdirectories of the portal Joomla, see Redmine #"2484":https://issue.openaire.research-infrastructures.eu/issues/2484
255
  - Removed Disallow: lines from robots.txt of the portal Joomla for those subdirectories, see above
256
December 01, 2016:
257
  - Removed HBase from OCEAN IIS CDH5 Test cluster, see Mantis #"9678":https://mantis.icm.edu.pl/view.php?id=9678
258
  - Tuned some OCEAN IIS CDH5 Test settings for YARN (yarn.nodemanager.resource.cpu-vcores=40, yarn.nodemanager.resource.memory-mb=92GB), see above
259
  - Started ntpd on openaire-www-(proxy|front|back)2, because it seems it was inactive (dead), hint: "Could not send report: SSL_connect returned=1 errno=0 state=error: certificate verify failed.  This is often because the time is out of sync on the server or client"
260
November 30, 2016:
261
  - Fixed a broken backup of MongoDB on openaire-services.vls, because it failed a few days ago (November 26)
262
  - Enabled a backup of MongoDB on openaire-services-mongodb.vls
263
  - Removed an old & stale backup of MongoDB on openaire-services-beta.vls
264
  - Enabled a backup of MongoDB & PostgreSQL on openaire-services-beta.vls
265
  - Recreated a broken SSL cert for Puppet on openaire-www-(proxy|front|back)2.vls (Could not request certificate: stack level too deep)
266
  - Upgraded CDH (from 5.5.2 to 5.7.5) on OCEAN IIS CDH5 Test cluster because of CVE-2016-5393 Apache Hadoop Privilege escalation vulnerability, see Mantis #"9681":https://mantis.icm.edu.pl/view.php?id=9681
267
  - Fixed timezone on OCEAN IIS CDH5 Test cluster machines (now we use GMT everywhere), see above
268
  - Fixed /proc/sys/vm/swappiness on iis-cdh5-test-gw & iis-cdh5-test-m[1-3] machines, see above
269
  - Fixed /sys/kernel/mm/transparent_hugepage/defrag on eos-m2-sn40 machine, see above
270
  - Upgraded CDH (from 5.5.2 to 5.7.5) also on ci-test.hadoop5.iis.openaire.eu, see above
271
November 29, 2016:
272
  - Fixed Apache configuration of "http://guidelines.openaire.eu/":http://guidelines.openaire.eu/ for DocumenRoot
273
November 28, 2016:
274
  - Purged the old logs of HDFS NameNode, balancer and Zookeeper on namenode1.hadoop.dm.openaire.eu because of a near full-filled / partition
275
  - Fixed Exim4 aliases on namenode1.hadoop.dm.openaire.eu & master1.hadoop.iis.openaire.eu in order to send to me the messages from HDFS balancer script launched by Cron (Mail delivery failed: returning message to sender: hdfs@namenode1.hadoop.dm.openaire.eu retry timeout exceeded)
276
  - Tuned yarn.scheduler.maximum-allocation-mb (16GB) YARN setting of OCEAN IIS CDH5 Test cluster, see Mantis #"9678":https://mantis.icm.edu.pl/view.php?id=9678
277
  - Stopped HBase of OCEAN IIS CDH5 Test cluster, see above
278
  - Updated and restarted openaire-www-(proxy|front|back)1.vls & openaire-www-front3 machines
279
  - Started, updated and restarted again openaire-www-(proxy|front|back)2.vls machines
280
November 25, 2016:
281
  - Tuned yarn.scheduler.maximum-allocation-vcores (6) YARN setting of OCEAN IIS CDH5 Test cluster, see Mantis #"9678":https://mantis.icm.edu.pl/view.php?id=9678
282
November 24, 2016:
283
  - Recreated a broken SSL cert for Puppet on openaire-iis-hadoop3-dom0.vls (Could not send report: SSL_CTX_use_PrivateKey:: key values mismatch)
284
November 23, 2016:
285
  - Fixed Apache configuration for a reverse proxy for CM on eos-cr-mgmt1.ocean.icm.edu.pl, because the clusters settings were changable only in a classic layout of CM, see Cloudera Case #"117145":https://cloudera-portal.force.com/5003400000spXmZ
286
  - Fixed robots.txt of OpenAIRE portal, because Googlebot couldn't grab images/CSS/JavaScript/etc, see Redmine #"2484":https://issue.openaire.research-infrastructures.eu/issues/2484
287
November 22, 2016:
288
  - Recreated a broken SSL cert for Puppet on openaire-www-test.vls (Could not send report: SSL_CTX_use_PrivateKey:: key values mismatch)
289
  - Tuned some OCEAN IIS CDH5 Test settings for YARN (mapreduce.map.memory.mb=0, mapreduce.map.java.opts.max.heap=1638MB, mapreduce.reduce.memory.mb=0, mapreduce.reduce.java.opts.max.heap=3276MB), see Mantis #"9678":https://mantis.icm.edu.pl/view.php?id=9678
290
November 21, 2016:
291
  - Started container 8480 on openaire-services.vls, because it crashed by night, see Redmine #"2477":https://issue.openaire.research-infrastructures.eu/issues/2477
292
  - Fixed owner of /var/log/nginx/ directory (from www-data: to root:) on furkot2, because of CVE-2016-1247 vulnerability against Nginx, for more details see "https://legalhackers.com/advisories/Nginx-Exploit-Deb-Root-PrivEsc-CVE-2016-1247.html":https://legalhackers.com/advisories/Nginx-Exploit-Deb-Root-PrivEsc-CVE-2016-1247.html
293
  - Fixed Apache configuration of "http://guidelines.openaire.eu/":http://guidelines.openaire.eu/ for /robots.txt & /favicon.ico requests
294
  - Allowed connections to OpenAIRE Piwik from Dimitris Pierrakos machine without authentication against CNR LDAP server, because he needs it for sending requests to Piwik API
295
November 18, 2016:
296
  - michal.politowski added to groups "driver" & "joomla" on openaire.vls, because he wants to see the Apache logs
297
  - Moved /etc/apache2/sites-enabled/joomla.conf to /etc/apache2/sites-enabled/000-joomla.conf after Michal Politowski email about OpenAIRE portal SEO (hint SNI)
298
  - Fixed Google Analytics JavaScript code URL (from HTTP to HTTPS) on the portal using Apache's mod_substitute directive, see Redmine #"2449":https://issue.openaire.research-infrastructures.eu/issues/2449
299
November 17, 2016:
300
  - Started HBase-Master on openaire-dm-hadoop-hb-m1.vls because it was dead
301
  - Created "usage_openaire" account in Piwik and granted him the view access for all current and future websites we truck by Piwik, see Redmine #"2431":https://issue.openaire.research-infrastructures.eu/issues/2431
302
  - Created HDFS home directory for giorgos.alexiou on OCEAN IIS CDH5 Test cluster, see Redmine #"2393":https://issue.openaire.research-infrastructures.eu/issues/2393
303
November 16, 2016:
304
  - Tested the PHP script addsite.php for creating a new Piwik websites, see Redmine #"2463":https://issue.openaire.research-infrastructures.eu/issues/2463
305
  - Added the trusted NKUA/NTUA/Athena RC networks on the firewall of OCEAN IIS CDH5 Test cluster gateway, see Redmine #"2393":https://issue.openaire.research-infrastructures.eu/issues/2393
306
  - Added giorgos.alexiou to "driver" group there, see above
307
November 15, 2016:
308
  - Installed Java 8 on openaire-virtuoso-beta, asked by Shirin Ameri, see Redmine #"2344":https://issue.openaire.research-infrastructures.eu/issues/2344
309
  - Discussion about generating automatically $idsite of Piwik for a new aggregated repos, see Redmine #"2463":https://issue.openaire.research-infrastructures.eu/issues/2643
310
  - Started working on a PHP script for creating a new Piwik websites, see above
311
November 14, 2016:
312
  - Upgraded and restarted the production machines (furkot2, openaire-www, openaire-stats, openaire-solr, openaire-services, openaire-services-mongodb, openaire-services-postgresql, openaire-virtuoso) with a new kernel fixed against Dirty COW bug, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
313
November 10, 2016:
314
  - Added shirin.ameri to "driver" group on openaire-virtuoso-beta.vls, see Redmine #"2344":https://issue.openaire.research-infrastructures.eu/issues/2344
315
November 08, 2016:
316
  - Closed the Redmine tickets #2100, #2342
317
November 07, 2016:
318
  - Further cleaning of infected Wordpress on "https://blogs.openaire.eu/:":https://blogs.openaire.eu/: removed infected themes (guardian, twentythirteen & twentytwelve), restored infected wp-content/themes/wp-pinup/header.php file
319
  - Fixed sudo config on gateway.hadoop.iis.openaire.eu (now `sudo su - dnet ...` & `sudo su dnet ...` commands are defined separately), reported by K.Zamlynska
320
  - Fixed also sudo on gateway.hadoop.dm.openaire.eu, see above
321
  - Increased a NFS volume openaire_beta_objectstore_pdfs mounted on beta.services.openaire.eu as /mnt/objectstore_pdfs from 6TB to 8TB, because it was filled in 100%
322
  - Restarted Spark History Server of OCEAN CDH5 Test cluster, because it seemed to be dead, reported by M.Horst, see Mantis #"9675":https://mantis.icm.edu.pl/view.php?id=9675
323
November 04, 2016:
324
  - Cleaned infected Wordpress on "https://blogs.openaire.eu/":https://blogs.openaire.eu/
325
  - Sent to Claudio the current numbers of the hardware resources at ICM
326
  - Downgraded Java 8u91 to 8u66 on ci-test.hadoop5.iis.openaire.eu, because of a problem with Oozie, reported by M.Horst, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
327
November 03, 2016:
328
  - Renewed SSL cert of Puppet for all OpenAIRE machines at ICM because of expired Puppet master SSL cert
329
  - Fixed a network issue on eos-m2-gw machine where iis-cdh5-test-gw is hosted after its reboot, reported by M.Horst, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
330
  - Enabled IP forwarding on the OCEAN IIS CDH5 Test cluster gateway, but it won't be used because the cluster slaves get IP address and a default gateway from DHCP server...
331
  - Fixed broken routing on a default gateway for the OCEAN IIS CDH5 Test cluster after its reboot (hint: net.ipv4.ip_forward=1 & net.ipv4.conf.all.rp_filter=0), reported by M.Horst, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
332
  - Purged the old logs of HDFS, YARN and Oozie on ci-test.hadoop5.iis.openaire.eu because of a near full-filled / partition
333
November 02, 2016:
334
  - Closed the Redmine tickets #2249, #2284, #2311, #2323, #2330, #2344, #2375
335
  - Configured clustershell for OCEAN IIS CDH5 Test cluster on the cluster gateway
336
  - Upgraded and restarted OCEAN IIS CDH5 Test cluster related machines (iis-cdh5-test-gw, iis-cdh5-test-m[1-3], eos-m2-gw, eos-m2-mn[1-3], eos-m2-sn0[1-8], eos-m2-sn[35-42]) with a new kernel fixed against Dirty COW bug, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
337
  - Erased "chrony" package from some OCEAN IIS CDH5 Test cluster related machines, because there was in a conflict with "ntpd" service
338
  - Upgraded and restarted openaire-beta-(www|stats|solr|services).vls and openaire-services-pilot with a new kernel fixed against Dirty COW bug, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
339
October 28, 2016:
340
  - Upgraded and restarted openaire-www-test.vls with a new kernel fixed against Dirty COW bug, see Redmine #"2423":https://issue.openaire.research-infrastructures.eu/issues/2423
341
  - Upgraded and restarted openaire-dm-hadoop[1-3]-dom0 with a new kernel fixed against Dirty COW bug, see above
342
  - Upgraded and restarted openaire-iis-hadoop[1-4]-dom0 with a new kernel fixed against Dirty COW bug, see above
343
October 27, 2016:
344
  - Started 8380 on openaire-services-pilot.vls, because it was dead, reported by Natalia
345
  - Added forgotten monitoring of 8380 on openaire-services-pilot.vls, see above
346
October 24, 2016:
347
  - Fixed sudo for becoming "dnet" user on DM/IIS Hadoop cluster gateway, see Redmine #"2413":https://issue.openaire.research-infrastructures.eu/issues/2413
348
  - Increased size (from 400GB to 500GB) of /srv partition on beta.solr.openaire.eu
349
October 21, 2016:
350
  - Allowed connections from DM Hadoop cluster to MongoDB on mongodb.services.openaire.eu, see Redmine #"2175":https://issue.openaire.research-infrastructures.eu/issues/2175
351
October 19, 2016:
352
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.16.2 to 2.16.5.
353
  - Upgraded ownCloud on box.openaire.eu from 8.2.2 to 8.2.7
354
October 18, 2016:
355
  - Fixed a content of /var/run/tomcat7.pid file on openaire-virtuoso-beta.vls, because Monit unmonitored Tomcat there, but it was running well
356
  - Generated Let's Encrypt SSL certificates for (beta.)virtuoso.openaire.eu
357
  - Closed Redmine #"2390":https://issue.openaire.research-infrastructures.eu/issues/2390 ticket
358
  - Upgraded ownCloud on box-test.openaire.eu from 8.2.2 to 8.2.7
359
October 17, 2016:
360
  - Generated Let's Encrypt SSL certificates for (analytics|api|beta|beta.services|box|box-test|goldoapilot|lareferencia|old|services|validator).openaire.eu
361
October 7, 2016:
362
  - Generated and installed a test SSL cert from Let's Encrypt CA on test.openaire.eu
363
  - Generated only a new SSL cert from Let's Encrypt CA on www.openaire.eu, because Natalia don't want to buy a new one (see Redmine #"2291":https://issue.openaire.research-infrastructures.eu/issues/2291)
364
October 6, 2016:
365
  - Started Spark Worker on ci-test.hadoop5.iis.openaire.eu
366
  - Firewall rules for Hadoop daemons web UIs cleanup, see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567
367
October 5, 2016:
368
  - Enabled an access to port 8980 on openaire-services.vls and openaire-services-beta.vls from OCEAN IIS Hadoop, see Redmine #"2352":https://issue.openaire.research-infrastructures.eu/issues/2352
369
October 4, 2016:
370
  - Enabled an access to openaire-services-(mongodb|postgresql).vls via SSH from CNR IPv6 network, see Redmine #"2175":https://issue.openaire.research-infrastructures.eu/issues/2175
371
  - Enabled IPv6 support for MongoDB on openaire-services-mongodb.vls, see above
372
October 3, 2016:
373
  - Enabled an access from openaire-services.vls to 27017 port (MongoDB) on openaire-services-mongodb.vls, see Redmine #"2175":https://issue.openaire.research-infrastructures.eu/issues/2175
374
September 30, 2016:
375
  - Investigated an issue with Oozie and MySQL timeouts, see Redmine #"2324":https://issue.openaire.research-infrastructures.eu/issues/2324
376
SEPTEMBER 29, 2016:
377
  - Restarted 8580 container on openaire-services-pilot.vls, because it seems that it hanged (the process was running, but it wasn't listening at 8580 port)
378
September 28, 2016:
379
  - Upgraded CDH (from 4.3.1 to 4.7.0) on DM Hadoop cluster, see Redmine #"2324":https://issue.openaire.research-infrastructures.eu/issues/2324
380
  - Upgraded Java (from 7u80 to 8u101) there, see above
381
September 27, 2016:
382
  - Removed the old logs (from 2012 to 2014) of koprowy on the logserver on mnich because of a lack of free disk space on / there
383
September 26, 2016:
384
  - Reported an error with sh404sef plugin of a production Joomla (Sh404sefHelperLanguage::getUrlCodeFromTag::182:  Language tag en-GB not in installed language list), see Redmine #"2342":https://issue.openaire.research-infrastructures.eu/issues/2342
385
  - Purged the old logs of HDFS, YARN and Oozie on ci-test.hadoop5.iis.openaire.eu because of a near full-filled / partition
386
  - Investigated Alessia's issue with accessing 8980 on openaire-services.vls and openaire-services-beta.vls, see Redmine #"2323":https://issue.openaire.research-infrastructures.eu/issues/2323
387
  - Added Alessia's IP address to a list of IPs allowed to access 8980 on both services machines, see above
388
  - Created a Cron job for "postgres" user on openaire-services-postgresql.vls and openaire-services-beta.vls for refreshing some materialized views of dnet_openaireplus database, asked by Alessia, see Redmine #"2343":https://issue.openaire.research-infrastructures.eu/issues/2343
389
  - Set Nginx rules for authentication of "https://services.openaire.eu/is/mvc/api/publications/":https://services.openaire.eu/is/mvc/api/publications/, see Redmine #"2323":https://issue.openaire.research-infrastructures.eu/issues/2323
390
September 24, 2016:
391
  - Removed the old Joomla backups and gzipped sh404sef logs because of lack of free disk space on /srv on openaire-www.vls
392
September 23, 2016:
393
  - Investigating an issue with offline regions of HBase on DM Hadoop cluster, reported by Claudio, Alessia and Tsampikos
394
  - Restarted HBase masters of DM Hadoop cluster
395
September 21, 2016:
396
  - Helping with an issue with Jenkins for IIS, see Mantis #"9656":https://mantis.icm.edu.pl/view.php?id=9656
397
  - Restarted openaire-www.vls in order to increase its resources (8GB -> 18GB RAM, 4 CPU cores -> 8 CPU cores), see Redmine #"2330":https://issue.openaire.research-infrastructures.eu/issues/2330
398
  - Decreased CPU of openaire-www.vls (8 CPU cores -> 6 CPU cores) and restarted it again because of issue with a big load, the stolen CPUs etc
399
  - Shutdowned openaire-www-(proxy|front|back)2 on prod2-dom0, see above
400
September 20, 2016:
401
  - Announced restart of openaire-www.vls in order to increase the resources, see Redmine #"2330":https://issue.openaire.research-infrastructures.eu/issues/2330
402
September 19, 2016:
403
  - Set Nginx rules for authentication of "https://beta.services.openaire.eu/is/mvc/api/publications/":https://beta.services.openaire.eu/is/mvc/api/publications/, see Redmine #"2323":https://issue.openaire.research-infrastructures.eu/issues/2323
404
  - Investigating Sahar's troubles with access to beta.lod.openaire.eu, see Redmine #"1748":https://issue.openaire.research-infrastructures.eu/issues/1748
405
  - Bumped a limit of the requests per minute in Fail2Ban (apache-badhosts jail) on www.openaire.eu, because it was making the troubles with the portal access (ERR_CONNECTION_REFUSED reported by Katerina, Paolo & Natalia)
406
September 16, 2016:
407
  - Set .deb packages source for CDH 4.7.0 on DM Hadoop cluster machines, see Redmine #"2324":https://issue.openaire.research-infrastructures.eu/issues/2324
408
September 15, 2016:
409
  - Prepared .tar file with the Apache logs of the production Joomla for Dimitris Pierrakos, he needs them for any NKUA student
410
September 14, 2016:
411
  - Fixed .htaccess for (www|beta|test).openaire.eu, because it didn't support index.html for DirectoryIndex, see Redmine #"2231":https://issue.openaire.research-infrastructures.eu/issues/2231
412
  - Fixed Apache auth configuration for /administration requests
413
September 13, 2016:
414
  - Fixed monitoring of 8380 on openaire-services-beta.vls, added monitoring of 8480 and switched monitoring of the search to 8480, see Redmine #"2274":https://issue.openaire.research-infrastructures.eu/issues/2274
415
  - Blocked permanently communication between beta.services.openaire.eu and services.openaire.eu, asked by Alessia, see above
416
  - Investigating an issue with distcp from OCEAN IIS CDH5 Test cluster to OpenAIRE DM cluster, seecluster to OpenAIRE DM cluster, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
417
  - Fixed the firewall rules on the gateway of OpenAIRE DM cluster (added 213.135.60.145 for 50071 port), see above
418
  - Decreased Apache2 limits on openaire-www.vls (ServerLimit=MaxRequestWorkers=120)
419
September 12, 2016:
420
  - Investigating an issue with Monit alerts about the failed beta search, asked by Katerina, see Redmine #"2274":https://issue.openaire.research-infrastructures.eu/issues/2274
421
  - Fixed checking the search on beta.services.openaire.eu, see above
422
  - Copied 8480 from the production services to the beta one, asked by Katerina, see above
423
  - Investigating ERR_CONNECTION_REFUSED errors for some portal pages, see Redmine #"2284":https://issue.openaire.research-infrastructures.eu/issues/2284
424
September 8, 2016:
425
  - Enabled access to OCEAN CDH5 Hadoop Test cluster from OpenAIRE services machines (both production & beta), asked by Claudio, see Redmine #"2297":https://issue.openaire.research-infrastructures.eu/issues/2297
426
  - Granted access to OCEAN CDH5 Hadoop Test cluster web UIs for Claudio, see above
427
September 7, 2016:
428
  - Installed "siege" package on openaire-services-beta.vls, asked by Katerina, see Redmine #"2274":https://issue.openaire.research-infrastructures.eu/issues/2274
429
  - Checking what Piwik sites can be accessed by Dimitris Pierrakos, asked by Dimitris
430
  - Granted the admin privileges for OpenAIRE portal beta site in Piwik to Dimitris, see above
431
  - Filled a ticket about renewal of SSL cert for .openaire.eu, see Redmine #"2291":https://issue.openaire.research-infrastructures.eu/issues/2291
432
September 5, 2016:
433
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
434
September 1, 2016:
435
  - Fixed home & siteurl parameters for blogs.openaire.eu Wordpress (was HTTPS instead of HTTP there and caused a redirection loop for /wp-login.php), reported by Ross & Pedro
436
August 31, 2016:
437
  - Reported issue with stats.openaire.eu murdered by the stats SELECTs from test.openaire.eu, see Redmine #"2282":https://issue.openaire.research-infrastructures.eu/issues/2282
438
  - Restarted Apache on test.openaire.eu and killed SELECT processes coming from test.openaire.eu on stats.openaire.eu, see above
439
August 30, 2016:
440
  - Investigated issues with test.openaire.eu (failed workflows, internal errors etc), reported by Claudio, Tsmapikos & Katerina
441
  - Production Joomla redirect from HTTP to HTTPS returns now status code 301 (Moved Permanently) instead of 302 (Moved Temporarily)
442
August 29, 2016:
443
  - Created a ticket for investigating last issues with the search (see Redmine #"2274":https://issue.openaire.research-infrastructures.eu/issues/2274)
444
  - Investigated 500 errors for jobtracker1.hadoop.dm.openaire.eu (reported by Claudio again, see Redmine #"2249":https://issue.openaire.research-infrastructures.eu/issues/2249)
445
  - Restarted preemptively both JobTrackers of DM Hadoop cluster (see above)
446
  - Replaced Eri Katsari by Tsampikos Livisianos in the Monit alert lists, asked by Eri
447
  - Purged the old logs of HBase and Zookeeper on hbase-master1.hadoop.dm.openaire.eu because of a near full-filled / partition
448
  - Purged the old logs of HDFS and YARN on ci-test.hadoop5.iis.openaire.eu because of a near full-filled / partition
449
  - Restarted Virtuoso on virtuoso-beta.openaire.eu, because SPARQL endpoint was down (reported by Sahar, see Redmine #"2277":https://issue.openaire.research-infrastructures.eu/issues/2277)
450
  - Investigated issues with Googlebot requests for /robots.txt, see Redmine #"2280":https://issue.openaire.research-infrastructures.eu/issues/2280
451
  - Configured Apache on openaire-www.vls for serving also "http://www.openaire.eu/sitemap.xml":http://www.openaire.eu/sitemap.xml without redirecting to HTTPS (see Redmine #"2065":https://issue.openaire.research-infrastructures.eu/issues/2065)
452
August 12, 2016:
453
  - Restarted a few machines of OCEAN IIS CDH5 Hadoop cluster in order to fix YARN NodeManager issue, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
454
  - Fixed OpenAIRE blogs Wordpress settings broken by Pedro
455
  - Polished some Apache rules for fixing URLs on blogs.openaire.eu
456
August 11, 2016:
457
  - Removed a default gateway for IB network interface (mlx4_ib0.8002) from a routing table of OCEAN IIS CDH5 Test Hadoop cluster slave nodes
458
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.16.1 to 2.16.2.
459
August 10, 2016:
460
  - Fixed also HTTPS links for blogs.openaire.eu, see Redmine #"1888":https://issue.openaire.research-infrastructures.eu/issues/1888
461
  - Investigated an issue with HDFS distcp invoked by Ooozie for OCEAN IIS CDH5 Hadoop cluster, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
462
August 9, 2016:
463
  - Investigated MongoDB backup issue on services.openaire.eu which failed a few days ago because of "Failed: error reading collection: EOF" error
464
  - Deployed monitoring of memory used by JobTracker of IIS Hadoop cluster (helpful together with the script for a preventive restart, see below)
465
  - Fixed JavaScript HTTP links for blogs.openaire.eu, reported by Pedro Principe, see Redmine #"1888":https://issue.openaire.research-infrastructures.eu/issues/1888
466
August 4, 2016:
467
  - "driver" group can manage Redis on stats.openaire.eu & beta.stats.openaire.eu now (asked by Antonis)
468
  - "driver" group can manage Tomcat7 on beta.stats.openaire.eu now (the same like for stats.openaire.eu)
469
  - "driver" group can become "www-data" user on stats.openaire.eu now (the same like for beta.stats.openaire.eu)
470
  - Enabled a preventive restart of JobTracker by Cron on master[12].hadoop.iis.openaire.eu (asked by Marek Horst)
471
  - Synced Redis database the beta and the production stats machines (asked by Antonis)
472
  - Enabled monitoring of Redis server on the beta stats machine
473
August 3, 2016:
474
  - Fixed a replica placement policy issue (block should be additionally replicated on 1 more rack(s)) for HDFS of DM Hadoop cluster
475
  - Moved a reverse proxy for blogs.openaire.eu from furkot2.vls to openaire-www.vls (see Redmine #"1888":https://issue.openaire.research-infrastructures.eu/issues/1888)
476
  - Moved a reverse proxy for mining.openaire.eu from furkot2.vls to openaire-www.vls
477
August 2, 2016:
478
  - Removed Nikon Gasparis from Monit alert list on openaire-services-pilot.vls
479
  - Investigated an unsucessfully finished MongoDB backup on services.openaire.eu
480
  - Investigated an unbalanced HDFS of DM Hadoop cluster (from 44.19% for slave9 to 54.09% for slave5)
481
  - tsampikos.livisianos added to "driver" group on beta.stats.openaire.eu (see Redmine #"2152":https://issue.openaire.research-infrastructures.eu/issues/2152)
482
  - Enabled monitoring of nscd & nslcd daemons on the machines which authenticate users against CNR LDAP server (see Redmine #"2258":https://issue.openaire.research-infrastructures.eu/issues/2258)
483
August 1, 2016:
484
  - Deployed Webalizer for beta.virtuoso.openaire.eu
485
July 29, 2016:
486
  - Continued getting the search stats from Apache logs of the portal (see Redmine #"2144":https://issue.openaire.research-infrastructures.eu/issues/2144)
487
  - tsampikos.livisianos added to "driver" & "joomla" groups on www.openaire.eu, beta.openaire.eu & test.openaire.eu (see Redmine #"2152":https://issue.openaire.research-infrastructures.eu/issues/2152)
488
  - Fixed Nginx monitoring on furkot2.vls (now it checks old.openaire.eu, not www.openaire.eu)
489
July 28, 2016:
490
  - Investigated 500 errors for jobtracker1.hadoop.dm.openaire.eu (reported by Claudio, see Redmine #"2249":https://issue.openaire.research-infrastructures.eu/issues/2249)
491
  - Switched "http://api.openaire.eu/search":http://api.openaire.eu/search request from 8380 to 8480 on services.openaire.eu
492
  - Getting the search stats from Apache logs of the portal (see Redmine #"2144":https://issue.openaire.research-infrastructures.eu/issues/2144)
493
July 27, 2016:
494
  - Continued investigating usage of api.openaire.research-infrastructures.eu (see Redmine #"2246":https://issue.openaire.research-infrastructures.eu/issues/2246)
495
  - Deployed Webalizer for beta.lod.openaire.eu (see Redmine #"2197":https://issue.openaire.research-infrastructures.eu/issues/2197)
496
July 26, 2016:
497
  - Started YARN ResourceManager on ci-test.hadoop5.iis.openaire.eu, because it was dead and was reason of restaring YARN NodeManager there
498
  - Fixed hostname for CNR LDAP server (asked by Claudio, see Redmine #"2245":https://issue.openaire.research-infrastructures.eu/issues/2245)
499
  - Investigated usage of api.openaire.research-infrastructures.eu (reported by Alessia, see Redmine #"2246":https://issue.openaire.research-infrastructures.eu/issues/2246)
500
July 25, 2016:
501
  - ioannis.foufoulas added to "driver" group on beta.services.openaire.eu (see Redmine #"2232":https://issue.openaire.research-infrastructures.eu/issues/2232)
502
  - Started Nginx at furkot2.vls, because it was down because of invalid domain name (kiczora.vls.icm.edu.pl) for Highcharts proxy (see Redmine #"2239":https://issue.openaire.research-infrastructures.eu/issues/2239 & #"2240":https://issue.openaire.research-infrastructures.eu/issues/2240)
503
  - Fixed Monit monitoring of Apache2 at openaire-www.vls (now restarts MySQL using Monit commands stop & start)
504
July 14, 2016:
505
  - Created a new LUN on the Dell MD3620F disk array and mounted it as /srv on openaire-services-mongodb
506
  - andrea.dellamico added to "driver" group on services-postgresql.openaire.eu (asked by Alessia, see Redmine #"2174":https://issue.openaire.research-infrastructures.eu/issues/2174)
507
  - Dumped PostgreSQL of openaire-services.vls and restored it on openaire-services-postgresql.vls, see above
508
  - Increased /srv on ci-test.hadoop5.iis.openaire.eu to 60GB (from 40GB) because it was near full-filled by HDFS data
509
July 12, 2016:
510
  - Bumped memory usage limit for Monit on services.openaire.eu (from 85% to 90%), because of a lot of the Monit alerts
511
July 11, 2016:
512
  - Purged the old logs of HDFS and Zookeeper on namenode2.hadoop.dm.openaire.eu because of a near full-filled / partition
513
  - Granted a view access for ALL websites tracked by OpenAIRE Piwik to Jochen Schirrwagen
514
  - Mirrored "http://search.driver.research-infrastructures.eu":http://search.driver.research-infrastructures.eu on the portal machine, asked by Claudio, see Redmine #"2208":https://issue.openaire.research-infrastructures.eu/issues/2208
515
  - Purged the old logs of HBase on hbase-master2.hadoop.dm.openaire.eu because of a near full-filled / partition
516
June 29, 2016:
517
  - Created dnet.production and dnet.beta accounts on OCEAN IIS CDH5 Test gateway and HDFS, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
518
  - Configured an user's authentication against CNR LDAP on OCEAN IIS CDH5 Test gateway
519
June 28, 2016:
520
  - Configured in DNS the aliases (mongodb|postgresql).services.openaire.eu and services-(mongodb|postgresql).openaire.eu pointing to openaire-services-(mongodb|postgresql).vls
521
  - Mounted via NFS netapp2-nfs:/vol/skalny_mongodb_tmp/ (as /mnt/mongodb_tmp) and netapp2-nfs:/vol/openaire_mongodb_backup/ (as /mnt/mongodb_backup) on openaire-services-mongodb.vls
522
  - Enabled monitoring of MongoDB on openaire-services-mongodb.vls
523
  - Configuration of MongoDB on openaire-services-mongodb.vls synced with openaire-services.vls
524
  - Configuration of PostgreSQL on openaire-services-postgresql.vls synced with openaire-services.vls
525
June 27, 2016:
526
  - Deployed openaire-services-postgresql.vls machine as a PostgreSQL backend of services.openaire.eu, asked by CNR, see Redmine #"2174":https://issue.openaire.research-infrastructures.eu/issues/2174
527
  - Deployed openaire-services-mongodb.vls machine as a MongoDB backend of services.openaire.eu, asked by CNR, see Redmine #"2175":https://issue.openaire.research-infrastructures.eu/issues/2174
528
  - Upgraded Java 8 (from 8u66 to 8u91) on ci-test.hadoop5.iis.openaire.eu
529
June 24, 2016:
530
  - Purged the old logs of Mapreduce and Zookeeper on jobtracker1.hadoop.dm.openaire.eu because of a near full-filled / partition
531
  - Fixed 8480 monitoring on services.openaire.eu and the search monitoring on www.openaire.eu
532
June 23, 2016:
533
  - Restarted HBase Masters of DM Hadoop cluster because of hanged tasks, see Redmine #"2167":https://issue.openaire.research-infrastructures.eu/issues/2167
534
June 22, 2016:
535
  - Created a FTP account "dovepress" on openaire-www.vls (asked by Jochen and Tracy Cleary from Dove Medical Press)
536
  - Increased a NFS volume openaire_objectstore_pdfs mounted on services.openaire.eu as /mnt/objectstore_pdfs from 6TB to 8TB, because it was filled in 91%
537
June 21, 2016:
538
  - Fixed PostgreSQL monitoring by Monit on services.openaire.eu, see Redmine #"2155":https://issue.openaire.research-infrastructures.eu/issues/2155
539
June 20, 2016:
540
  - tsampikos.livisianos added to "driver" group on services.openaire.eu, beta.services.openaire.eu, stats.openaire.eu & gateway.hadoop.dm.openaire.eu (see Redmine #"2152":https://issue.openaire.research-infrastructures.eu/issues/2152)
541
  - Fixed one column in TABLE_PARAMS table of hive_metastore database of Hive for OCEAN IIS CDH5 Test cluster (see Mantis #"7911":https://mantis.icm.edu.pl/view.php?id=7911)
542
  - Created on openaire-www-back2.vls the shell scripts for checking slapd master-slave replication status and showing a difference if the slapd servers are not synchronized
543
June 18, 2016:
544
  - Fixed monitoring tomcat-instance-8480 & openaire-search (can't be restarted in the same time, now Monit alerts if 8480 fails and restarts 8480 if openaire-search fails)
545
June 17, 2016:
546
  - Configured Monit for restarting 8380 on services.openaire.eu if openaire-search issue occurs
547
  - Replaced a failed disk in openaire-iis-hadoop2-dom0, see Mantis #"9637":https://mantis.icm.edu.pl/view.php?id=9637
548
  - Enabled monitoring of 8480 on services.openaire.eu, see Redmine #"2144":https://issue.openaire.research-infrastructures.eu/issues/2144
549
  - Configured Monit for restarting 8480 on services.openaire.eu if openaire-search issue occurs (see above)
550
June 15, 2016:
551
  - Synced LDAP on openaire-www-back[12].vls with configuration and content of LDAP on openaire-www.vls
552
  - Configured LDAP master-slave replication between openaire-www-back1.vls (provider) and openaire-www-back2.vls (consumer)
553
  - Configured Apache redirection from indexed by Bing "http://openaire.eu/index.php?lang=en-GB":http://openaire.eu/index.php?lang=en-GB to "https://www.openaire.eu/":https://www.openaire.eu/, asked by Argiro
554
June 14, 2016:
555
  - Purged the old logs of HDFS and Oozie on ci-test.hadoop5.iis.openaire.eu because of a near full-filled / partition
556
  - Deployed openaire-www-back2.vls, a second (backup) back-end machine for OpenAIRE portal cluster
557
  - Configured MySQL replication between openaire-www-back1.vls (master) and openaire-www-back2.vls (slave)
558
  - Deployed 8480 container on services.openaire.eu, see Redmine #"2144":https://issue.openaire.research-infrastructures.eu/issues/2144
559
June 13, 2016:
560
  - Restarted 8380 on services.openaire.eu because the portal was down
561
  - Decreased Apache2 limits on openaire-www.vls (ServerLimit=MaxRequestWorkers=200), see above
562
  - Deployed openaire-www-proxy2.vls, a second (backup) proxy machine for OpenAIRE portal cluster
563
June 09, 2016:
564
  - Increased resources for dm_import pool of OCEAN IIS CDH5 Test cluster (max 30 vcores & max 180GB of memory), see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
565
June 07, 2016:
566
  - Patched s3cmd 1.0.0 on gateway.hadoop.iis.openaire.eu, asked by Kasia Zamlynska
567
  - Changed a mount point for the PDFs uploaded via FTP from /mnt/ftp to /mnt/uploaded_dumps, see Redmine #"1929":https://issue.openaire.research-infrastructures.eu/issues/1929
568
June 04, 2016:
569
  - Restarted 8380 on services.openaire.eu because of OOM error
570
  - Increased / on services.openaire.eu to 40GB because it was near full-filled by .hprof files of 8380
571
  - Set -Xmx10G for 8380 on services.openaire.eu because of too many OOM errors last time
572
  - Removed option -XX:HeapDumpOnOutOfMemoryError (because we don't want unused .hprof file anymore) and set -XX:OnOutOfMemoryError="/bin/kill -9 %p" instead of -XX:OnOutOfMemoryError="/etc/init.d/tomcat-instance-8380 restart" (because "driver" is not allowed for restarting container) for all D-Net containers on services.openaire.eu
573
June 03, 2016:
574
  - Tuned YARN resources settings on OCEAN IIS CDH5 Test cluster
575
  - Unbanned IP 161.53.254.14 on a firewall of the OpenAIRE portal (see Redmine #"2130":https://issue.openaire.research-infrastructures.eu/issues/2130)
576
  - Unbanned all blocked IPs on a firewall of the OpenAIRE portal
577
  - Installed awscli & s3cmd tools on gateway.hadoop.iis.openaire.eu, asked by Kasia Zamlynska
578
  - Restarted 8380 on services.openaire.eu because of OOM error
579
June 02, 2016:
580
  - Installed pydoop 1.0.0 on iis-cdh5-test-gw.ocean.icm.edu.pl (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
581
  - Increased size of / partition of OCEAN IIS CDH5 Test gateway from 20GB to 100GB (see above)
582
  - Increased memory for YARN applications on OCEAN IIS CDH5 Test cluster: 6GB for mappers & 8GB for reducers (see above)
583
  - Downgraded Java on ci-test.hadoop5.iis.openaire.eu from version 8u91 to 8u66 in order to fix Oozie issue with JSP (see Mantis #"9631":https://mantis.icm.edu.pl/view.php?id=9631)
584
  - Updated Oozie sharelibs on ci-test.hadoop5.iis.openaire.eu (see above)
585
  - Tuned YARN resources settings on OCEAN IIS CDH5 Test cluster
586
June 01, 2016:
587
  - Increased size of / partition of OCEAN IIS CDH5 Test master machines from 20GB to 100GB
588
  - Installed python-pip & avroknife on iis-cdh5-test-gw.ocean.icm.edu.pl (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
589
  - Installed Hive on OCEAN IIS CDH5 Test cluster (see above)
590
  - Changed a password for FTP account "jochen" on openaire-www.vls (asked by Jochen Schirrwagen)
591
  - Mounted via NFS openaire_ftp NetApp volume on both services machines (prod & beta)
592
May 31, 2016:
593
  - Group "driver" can check status of Solr on solr.openaire.eu and beta.solr.openaire.eu now, see Redmine #"2120":https://issue.openaire.research-infrastructures.eu/issues/2120
594
  - Updated packages on eos-cr-mgmt*, eos-m2-gw, iis-cdh5-test-* and eos-m2-sn* machines
595
  - Updated Cloudera Manager (CM) server on eos-cr-mgmt1 and Cloudera Manager agents on eos-cr-mgmt1 and all OCEAN IIS CDH5 Test cluster from version 5.5.0 to 5.7.0, see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
596
  - Updated CDH on ci-test.hadoop5.iis.openaire.eu from version 5.4.7 to 5.2.2 (see Mantis #"9631":https://mantis.icm.edu.pl/view.php?id=9631)
597
May 30, 2016:
598
  - Granted permissions to "driver" group for launching `tcpflow` with any arguments on services.openaire.eu and beta.services.openaire.eu (see Redmine #"2114":https://issue.openaire.research-infrastructures.eu/issues/2114)
599
  - Removed the logs for job_201605162019_0683 and job_201605162019_0687, because they consumed most of the disk space of DM Hadoop cluster data disks (see Redmine #"2115":https://issue.openaire.research-infrastructures.eu/issues/2115)
600
  - Added the new INFN CA SSL certificate to Java keyring on services.openaire.eu and beta.services.openaire.eu (see Redmine #"2117":https://issue.openaire.research-infrastructures.eu/issues/2117)
601
  - Restarted openaire-virtuoso-beta.vls, asked by Giorgos Alexiou, see Redmine #"2118":https://issue.openaire.research-infrastructures.eu/issues/2118)
602
  - Now a dynamic pool "dm_import" on OCEAN IIS CDH5 Test cluster can use only 20 VCPUs and 40GB RAM (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
603
  - Created a new dynamic pools "marek_dot_horst" and "michal_dot_politkowski" on OCEAN IIS CDH5 Test cluster, see above
604
  - Changed a password for FTP account "copernicus" on openaire-www.vls (asked by Vitalij Mik from Copernicus)
605
May 25, 2016:
606
  - Fixed typo in HAProxy config for hdfs-namenode on gateway.hadoop.(dm|iis).openaire.eu
607
  - Installed apsw on OCEAN IIS CDH5 Test slaves (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
608
  - Set -Xmx512m fot Tomcat 7 on stats.openaire.eu (see Redmine #"2100":https://issue.openaire.research-infrastructures.eu/issues/2100)
609
  - Configured cache for WiredTiger engine of MongoDB on beta.services.openaire.eu, see Redmine #"2062":https://issue.openaire.research-infrastructures.eu/issues/2062
610
May 24, 2016:
611
  - Configured a smart proxy for 50070 of the NameNodes using HAProxy cool health check feature on the IIS Hadoop cluster gateway
612
  - "driver" group can manage Tomcat7 on stats.openaire.eu now (see Redmine #"2100":https://issue.openaire.research-infrastructures.eu/issues/2100)
613
  - Created a dynamic pool "dm_import" for managing resources on OCEAN IIS CDH5 Test cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
614
May 23, 2016:
615
  - Fixed an issue with the permissions of /tmp/logs direcory owned by YARN on OCEAN IIS CDH5 Test cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
616
  - Fixed an issue with a file browsing in DM Hadoop Hue by changing an active HDFS NameNode (see Redmine #"2094":https://issue.openaire.research-infrastructures.eu/issues/2094)
617
  - Configured a smart proxy for 50070 of the NameNodes using HAProxy cool health check feature on the DM Hadoop cluster gateway (see above)
618
May 20, 2016:
619
  - Installed Ext JS for Ooozie on iis-cdh5-test-m3.ocean.icm.edu.pl (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
620
  - Installed "mc" package on iis-cdh5-test-gw.ocean.icm.edu.pl, asked by Marek Horst (see above)
621
  - Installed Oozie ShareLib on OCEAN IIS CDH5 Test Hadoop cluster (see above)
622
  - Stopped and disabled in systemd wpa_supplicant on all machines in module #2 of OCEAN Hadoop infrastructure
623
  - Alessia Bardi will be receiving Monit alerts from DM Hadoop slaves as well (see Redmine #"2090":https://issue.openaire.research-infrastructures.eu/issues/2090)
624
  - aenne.loehden added to "driver" group on services.openaire.eu & beta.services.openaire.eu (asked by Jochen)
625
  - Open Solr port (8983) for UNIBI networks (asked by Jochen too)
626
  - Granted a "view" access to 26 Portugal repos to Jochen, see Redmine #"2059":https://issue.openaire.research-infrastructures.eu/issues/2059
627
  - Purged the old logs of HDFS and Zookeeper on namenode1.hadoop.dm.openaire.eu because of a near full-filled / partition
628
  - Installed LaTeX packages on openaire-www.vls for generating PDF of the OpenAIRE Guidelines (see Redmine #"2067":https://issue.openaire.research-infrastructures.eu/issues/2067)
629
May 19, 2016:
630
  - Configured Apache on iis-cdh5-test-gw.ocean.icm.edu.pl as a reverse proxy for OCEAN IIS CDH5 Test master slaves (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
631
  - Restarted HDFS DataNodes on slave[9-10].hadoop.dm.openaire.eu to fix an issue with the missing blocks (see Redmine #"2086":https://issue.openaire.research-infrastructures.eu/issues/2086)
632
  - Configured an user's authentication against CNR LDAP for all web services of OCEAN IIS CDH5 Test cluster behind a reverse proxy on iis-cdh5-test-gw.ocean.icm.edu.pl
633
  - Increased (from 60s to 180s) a proxy timeout of Nginx for api.openaire.eu (see Redmine #"2085":https://issue.openaire.research-infrastructures.eu/issues/2085)
634
  - iis-cdh5-test-gw.ocean.icm.edu.pl (instead eos-m2-sn01.ocean.icm.edu.pl) is now allowed to access gateway.hadoop.(dm|iis).openaire.eu without LDAP authentication (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
635
  - Installed "screen" package on iis-cdh5-test-gw.ocean.icm.edu.pl, asked by Marek Horst (see above)
636
May 18, 2016:
637
  - katarzyna.zamlynska added to group driver on gateway.hadoop.iis.openaire.eu (see Mantis #"9630":https://mantis.icm.edu.pl/view.php?id=9630)
638
  - Configured Apache on iis-cdh5-test-gw.ocean.icm.edu.pl as a reverse proxy for OCEAN IIS CDH5 Test master machines (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
639
May 17, 2016:
640
  - katerina.iatropoulou added to group "driver" on gateway.hadoop.dm.openaire.eu (see Redmine #"2078":https://issue.openaire.research-infrastructures.eu/issues/2078)
641
  - Created an account for Katerina Iatropoulou & Eri Katsari on all slaves of DM Hadoop cluster (see above)
642
  - Granted permissions to Katerina & Eri for becoming "mapred" user on all slaves of DM Hadoop cluster (see above)
643
  - Moved YARN, Zookeeper & HBase master daemons of OCEAN IIS CDH5 Test cluster to iis-cdh5-test-m[1-3] machines (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
644
  - Deployed HDFS, YARN & HBase services on eos-m2-sn01 & eos-m2-sn35 machines (see above)
645
May 16, 2016:
646
  - Deployed KVM virtual machines iis-cdh5-test-m[1-3] for OCEAN IIS CDH5 Test cluster
647
  - Moved HDFS master daemons of OCEAN IIS CDH5 Test cluster to iis-cdh5-test-m[1-3] machines (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
648
May 13, 2016:
649
  - MongoDB on openaire-services.vls and openaire-services-beta.vls now listens at all network interfaces, because it needs to be reachable from DM Hadoop cluster (see Redmine #"2076":https://issue.openaire.research-infrastructures.eu/issues/2076)
650
  - Purged the old logs of HBase and Zookeeper on hbase-master1.hadoop.dm.openaire.eu because of a near full-filled / partition
651
  - Created a new website in Piwik for Spanish E-Archivo repo, asked by Dimitris (see Redmine #"2069":https://issue.openaire.research-infrastructures.eu/issues/2069)
652
  - Created the new website in Piwik for 2 Croatian repos (FULIR & HRCAK), asked by Dimitris (see Redmine #"2073":https://issue.openaire.research-infrastructures.eu/issues/2073)
653
  - Created a new website in Piwik for Bulgarian OpenAIRE repo, asked by Dimitris (see Redmine #"2074":https://issue.openaire.research-infrastructures.eu/issues/2074)
654
  - Granted a "view" access to 26 Portugal repos to the users who has an account in Piwik, see Redmine #"2059":https://issue.openaire.research-infrastructures.eu/issues/2059
655
  - Created a shell script /usr/local/bin/build-guidelines-html.sh for building HTML code of "http://guidelines.openaire.eu/":http://guidelines.openaire.eu/ site on openaire-www.vls (see Redmine #"2067":https://issue.openaire.research-infrastructures.eu/issues/2067)
656
  - "http://guidelines.openaire.eu/":http://guidelines.openaire.eu/ now handled by Apache on openaire-www.vls, see above and Redmine #"1889":https://issue.openaire.research-infrastructures.eu/issues/1889
657
  - Increased size (from 200GB to 250GB) of /srv partition on beta.stats.openaire.eu
658
May 12, 2016:
659
  - Retarted Apache and MySQL on openaire-www.vls because of memory lack (Error displaying the error page: Application Instantiation Error: Could not connect to MySQL.), thanks to doe.isti.gov
660
  - Enabled fail2ban apache-badhosts jail on openaire-www.vls for protection against too many requests from clients, for example doe.isti.gov
661
  - Installed Sphinx on openaire-www.vls in order to build HTML code for "http://guidelines.openaire.eu":http://guidelines.openaire.eu (cloned from "https://github.com/openaire/guidelines)":https://github.com/openaire/guidelines) and configured Apache for serving it (see Redmine #"2067":https://issue.openaire.research-infrastructures.eu/issues/2067)
662
May 11, 2016:
663
  - Retarted Apache and MySQL on openaire-www.vls because of memory lack (Error displaying the error page: Application Instantiation Error: Could not connect to MySQL.), thanks to doe.isti.gov
664
  - Configured Apache on openaire-www.vls for serving "http://www.openaire.eu/sitemap":http://www.openaire.eu/sitemap without redirecting to HTTPS (see Redmine #"2065":https://issue.openaire.research-infrastructures.eu/issues/2065)
665
  - Built HTML code for "http://guidelines.openaire.eu":http://guidelines.openaire.eu (cloned from "https://github.com/openaire/guidelines)":https://github.com/openaire/guidelines) using Sphinx installed on my laptop and uploaded it on futkot2.vls, because we had an issue with ReadTheDocs service (see Redmine #"2067":https://issue.openaire.research-infrastructures.eu/issues/2067)
666
May 10, 2016:
667
  - Investigating the memory issues on services.openaire.eu (see Redmine #"2062":https://issue.openaire.research-infrastructures.eu/issues/2062)
668
  - "driver" group can monitor/unmonitor Java containers on services.openaire.eu now
669
  - Helping Sahar to find DocumentRoot of "http://beta.lod.openaire.eu":http://beta.lod.openaire.eu (see Redmine #"2063":https://issue.openaire.research-infrastructures.eu/issues/2063)
670
  - Created the Piwik websites for 26 Portugal repositories, asked by Pedro, see Redmine #"2059":https://issue.openaire.research-infrastructures.eu/issues/2059
671
May 09, 2016:
672
  - Restarted ci-test.hadoop.iis.openaire.eu and removed the old MapReduce & Oozie logs, because the machine was unreacheable (see Mantis #[9141>>"https://mantis.icm.edu.pl/view.php?id=9141":https://mantis.icm.edu.pl/view.php?id=9141]])
673
  - Restared slave2.hadoop.dm.openaire.eu and replaced a failed disk in openaire-dm-hadoop1-dom0.vls (see Redmine #"2057":https://issue.openaire.research-infrastructures.eu/issues/2057)
674
  - Restarted openaire-iis-hadoop4-dom0.vls Xen Dom0 machine because of hanged Dell DRAC, see Mantis #[9628>>"https://mantis.icm.edu.pl/view.php?id=9628":https://mantis.icm.edu.pl/view.php?id=9628]]
675
May 06, 2016:
676
  - Upgraded MongoDB on openaire-services.vls & openaire-services-beta.vls from version 3.2.5 to 3.2.6 (see Redmine #"2043":https://issue.openaire.research-infrastructures.eu/issues/2043)
677
May 05, 2016:
678
  - Restored all MongoDB databases of openaire-services.vls on ciemniak2.vls (see Redmine #"2043":https://issue.openaire.research-infrastructures.eu/issues/2043)
679
  - Updated CA root cert of CNR LDAP server on piwik.vls (see Redmine #"2049":https://issue.openaire.research-infrastructures.eu/issues/2049)
680
  - Created dump of MongoDB mdstore, objectStore & dnet_logs databases on openaire-services.vls and restored them on ciemniak2.vls
681
  - Increased size (from 150GB to 200GB) of /srv partition on beta.stats.openaire.eu (see Redmine #"1999":https://issue.openaire.research-infrastructures.eu/issues/1999)
682
  - Transfered MongoDB 3.5.2 databases from ciemniak2.vls on openaire-services.vls (see Redmine #"2043":https://issue.openaire.research-infrastructures.eu/issues/2043)
683
May 04, 2016:
684
  - Fixed `facter` on openaire-virtuoso.vls (/usr/lib/ruby/1.8/facter/vls/exim4.rb for checking Exim4's keep_environment was missing)
685
  - Enabled Puppet agent there, because it was disabled
686
  - Fixed a huge CPU load on openaire-services-beta.vls because of MongoDB 3.2 (`sudo date -s now` did the magic), see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019
687
  - Restored MongoDB oaistore* databases of openaire-services.vls on openaire-services-pilot.vls (see Redmine #"2043":https://issue.openaire.research-infrastructures.eu/issues/2043
688
  - Disabled temporarily verification of SSL cert of CNR LDAP in Apache2 on the OpenAIRE portal machines (production, beta & test) and Hadoop gateways, because it has expired today (see Redmine #"2049":https://issue.openaire.research-infrastructures.eu/issues/2049)
689
  - Updated CA root cert of CNR LDAP server and enabled its verification again (see above)
690
April 28, 2016:
691
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.16.0 to 2.16.1.
692
  - Copied logrotate config file for MongoDB from openaire-services.vls to openaire-services-beta.vls, because it seems that mongodb-org-server package from 10gen doesn't include it
693
April 27, 2016:
694
  - Deployed MongoDB 3.5.2 on ciemniak2.vls and restored there mdstore database of MongoDB 2.6 from openaire-services-beta.vls (see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019)
695
  - Created an account for Claudio and Alessia on ciemniak2.vls (see above)
696
  - Transfered MongoDB 3.5.2 databases from ciemniak2.vls on openaire-services-beta.vls (see above)
697
April 26, 2016:
698
  - Restored mdstore database of MongoDB 2.6 on openaire-services-beta.vls (see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019)
699
  - Fixed Puppet template of MongoDB for Monit, because MongoDB 3.x (from 10gen) listens at a different port (21017) now and it's managed only by Upstart init script
700
April 25, 2016:
701
  - Upgraded MongoDB on openaire-services-beta.vls from version 2.4 to 2.6 (see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019)
702
  - Upgraded MongoDB on openaire-services-beta.vls from version 2.6 to 3.0 (see above)
703
April 22, 2016:
704
  - Configured MySQL for Joomla on openaire-www-back1.vls machine
705
  - Tuned YARN on OCEAN IIS CDH5 Test cluster (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
706
April 21, 2016:
707
  - Restarted Zookeeper service & HBase Masters of DM Hadoop cluster (see Redmine #"1998":https://issue.openaire.research-infrastructures.eu/issues/1998)
708
  - Configured Nginx for Joomla on openaire-www-proxy1.vls machine
709
  - Configured Apache2 for Joomla on openaire-www-front[1-3].vls machines
710
April 20, 2016:
711
  - Disabled and removed snapshots of openaire_mongodb_backup volume on netapp1 because of lack of free disk space for MongoDB backup on openaire-services-beta.vls (see below)
712
  - Created a backup of MongoDB on openaire-services-beta.vls (see Redmine #"2019":https://issue.openaire.research-infrastructures.eu/issues/2019)
713
  - Deployed openaire-www-proxy1.vls machine
714
  - Deployed openaire-www-front[1-3].vls machines
715
  - Deployed openaire-www-back1.vls machine
716
April 19, 2016:
717
  - Increased CPU (from 4 to 8) and RAM (from 8GB to 16GB) for openaire-www.vls
718
  - Decreased CPU (from 18 to 4) and RAM (from 32GB to 8GB) for furkot2.vls
719
  - Restarted furkot2.vls (it had 830 days uptime!!!)
720
April 18, 2016:
721
  - Tuned YARN on OCEAN IIS CDH5 Test cluster (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
722
April 15, 2016:
723
  - Shutdowned slave6.hadoop.dm.openaire.eu because it has hanged up because of OOMs, see Redmine #"2008":https://issue.openaire.research-infrastructures.eu/issues/2008
724
April 14, 2016:
725
  - Enabled /etc/cron.d/cleanup-mnt-tmp Cron job which removes the files older then 3 weeks from /mnt/tmp on gateway.hadoop.(dm|iis).openaire.eu (the files located under preserved/ subdirectory are still preserved), see Redmine #"1768":https://issue.openaire.research-infrastructures.eu/issues/1768
726
April 13, 2016:
727
  - Installed unzipped version of Python APSW 2.11.1-r1 on ci-test.hadoop5.iis.openaire.eu (see Mantis #[9622>>"https://mantis.icm.edu.pl/view.php?id=9622":https://mantis.icm.edu.pl/view.php?id=9622]])
728
  - Restarted HBase RegionServer on slave4.hadoop.iis.openaire.eu, because HBase Master couldn't see it
729
  - Tuned YARN on OCEAN IIS CDH5 Test cluster (see Mantis #[9621>>"https://mantis.icm.edu.pl/view.php?id=9621":https://mantis.icm.edu.pl/view.php?id=9621]])
730
  - Created an account for Marek Horst for all slaves of OCEAN IIS CDH5 Test cluster (see above)
731
  - Installed Tomcat7 on openaire-virtuoso-beta.vls & configured sudo for "driver" group (see Redmine #"2005":https://issue.openaire.research-infrastructures.eu/issues/2005)
732
  - Configured Apache2 on openaire-virtuoso-beta.vls for handling "http://beta.lod.openaire.eu/api":http://beta.lod.openaire.eu/api requests (see above)
733
  - Added 4 new slaves to OCEAN IIS CDH5 Test cluster (eos-m2-sn0[78] & eos-m2-sn4[12])
734
April 7, 2016:
735
  - Installed php5-psql package on beta.stats.openaire.eu, asked by Ioannis Diplas (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
736
  - Granted admin rights to Dimitris Pierrakos for OpenAIRE portal (idSite=5) and API website (idSite=18) in Piwik
737
April 6, 2016:
738
  - 10.0.6.0/26 network (VLAN 406) is now allowed to access gateway.hadoop.(dm|iis).openaire.eu without LDAP authentication (see Mantis #"7593":https://mantis.icm.edu.pl/view.php?id=7593)
739
  - Granted admin rights to Natalia for OpenAIRE portal web site (idSite=5) in Piwik
740
March 31, 2016:
741
  - ioannis.diplas added to group driver on beta.stats.openaire.eu & beta.services.openaire.eu (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
742
April 5, 2016:
743
  - Grabbed 504 return code lines of Nginx logs for api.openaire.eu, asked by Alessia
744
  - Installed the latest version of Mikoomi's MongoDB plugin/template for Zabbix on services.openaire.eu and beta.services.openaire.eu
745
  - Configured Nginx on beta.services.openaire.eu for handling beta.repomanager.openaire.eu (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
746
  - Configured Apache2 on beta.stats.openaire.eu for handling /stats locally and passing the rest requests to "http://beta.services.openaire.eu:8380/statsConfig/":http://beta.services.openaire.eu:8380/statsConfig/ (see above)
747
  - Tuned YARN on ci-test.hadoop5.iis.openaire.eu (see Mantis #[9567>>"https://mantis.icm.edu.pl/view.php?id=9567":https://mantis.icm.edu.pl/view.php?id=9567]])
748
April 4, 2016:
749
  - Memory tuning of IIS CDH5 Test (OCEAN) Hadoop cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
750
  - Created an account for Frederic Merceur in OpenAIRE Piwik (see Redmine #"1972":https://issue.openaire.research-infrastructures.eu/issues/1972)
751
April 1, 2016:
752
  - CIS IP 213.135.59.178 (default gateway for the slave machines of OCEAN IIS CDH5 Test cluster) is now allowed to access gateway.hadoop.(dm|iis).openaire.eu without LDAP authentication (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
753
March 31, 2016:
754
  - Enabled monitoring of /mnt/mongodb_tmp on services.openaire.eu
755
  - Increased size of /mnt/objectstore_pdfs from 4TB to 6TB on services.openaire.eu
756
  - Configured Apache2 on openaire-stats-beta.vls for handling beta.stats.openaire.eu & beta.topics.openaire.eu domains (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
757
  - nikolaos.begetis added to group driver on beta.stats.openaire.eu & beta.services.openaire.eu (see above)
758
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.15.0 to 2.16.0.
759
  - eos-m2-sn01.ocean.icm.edu.pl is now allowed to access gateway.hadoop.(dm|iis).openaire.eu without LDAP authentication (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
760
March 30, 2016:
761
  - Set JAVA_HOME=/usr/java/jdk1.8.0_77 on IIS CDH5 Test (OCEAN) Hadoop cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
762
  - Created an account krzysztof.madry on eos-m2-sn(01|35).ocean.icm.edu.pl (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
763
  - Installed PHP5 and Sqlite 3.8.2 on beta.stats.openaire.eu (see Redmine #"1970":https://issue.openaire.research-infrastructures.eu/issues/1970)
764
  - Configured beta.topics.openaire.eu & beta.repomanager.openaire.eu domain names in DNS (see above)
765
  - spark-gw.vls.icm.edu.pl is now allowed to access gateway.hadoop.iis.openaire.eu without LDAP authentication (see Mantis #"9487":https://mantis.icm.edu.pl/view.php?id=9487)
766
  - Granted access to Claudio for reading logs in /srv/data/*/mapred/local/userlogs/job_201602171053_1254/ of DM cluster worker nodes
767
  - Tuned IIS CDH5 Test (OCEAN) Hadoop cluster (oozie.action.max.output.data=8192, oozie.subworkflow.classpath.inheritance=true), see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621
768
  - Increased size of /mnt/objectstore_pdfs from 4TB to 6TB on beta.services.openaire.eu (see Redmine #"1973":https://issue.openaire.research-infrastructures.eu/issues/1973)
769
  - Enabled monitoring of /mnt/objectstore_pdfs on services.openaire.eu & beta.services.openaire.eu (see above)
770
March 29, 2016:
771
  - Removed Java 6 and installed Java 8 on IIS CDH5 Test (OCEAN) Hadoop cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
772
  - Create a new website in Piwik for French Archimer Repository (see Redmine #"1972":https://issue.openaire.research-infrastructures.eu/issues/1972)
773
March 24, 2016:
774
  - Purged python-apsw 3.7.6.3-r1 package on ci-test.hadoop.iis.openaire.eu & ci-test.hadoop5.iis.openaire.eu and installed there Python APSW 2.11.1-r1 built on the gateway of IIS Hadoop cluster (see Mantis #[9622>>"https://mantis.icm.edu.pl/view.php?id=9622":https://mantis.icm.edu.pl/view.php?id=9622]])
775
  - Restarted HBase Master & all RegionServers of DM Hadoop cluster
776
March 22, 2016:
777
  - Removed some .hprof files of 8380 on services.openaire.eu, because of lack of free disk space on / partition (see Redmine #"1967":https://issue.openaire.research-infrastructures.eu/issues/1967)
778
  - Deployed IIS CDH5 Test (OCEAN) Hadoop cluster (see Mantis #"9621":https://mantis.icm.edu.pl/view.php?id=9621)
779
March 21, 2016:
780
  - Purged python-apsw 3.7.6.3-r1 package on the slaves of IIS Hadoop cluster and installed there Python APSW 2.11.1-r1 built on the gateway (see Redmine #"1212":https://issue.openaire.research-infrastructures.eu/issues/1212)
781
March 18, 2016:
782
  - Purged the old logs of Oozie on master3.hadoop.iis.openaire.eu because of a near full-filled / partition
783
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
784
March 16, 2016:
785
  - ioannis.foufoulas added to group driver on gateway.hadoop.iis.openaire.eu (see Mantis #"9620":https://mantis.icm.edu.pl/view.php?id=9620)
786
  - Deleted unused arxiv_pdf-old/ directory from /mnt/downloaded_dumps volume (see Redmine #"1950":https://issue.openaire.research-infrastructures.eu/issues/1950)
787
March 11, 2016:
788
  - Enabled monitoring of usage of /home and /mnt/tmp on gateway.hadoop.iis.openaire.eu
789
  - Enabled monitoring of usage of /mnt/downloaded_dumps on services.openaire.eu
790
March 10, 2016:
791
  - Disabled forgotten commands `chown -R dnet:monkeys /srv/dnet/` & `chown -R root:monkeys /usr/share/dnet/bundles/` in the root's crontab both on services.openaire.eu and beta.services.openaire.eu
792
  - Now Monit on services.openaire.eu and beta.services.openaire.eu will be restarting Tomcat containers (if neccessary) instead only sending e-mail alerts, asked by Claudio
793
March 09, 2016:
794
  - michal.politowski added to driver group at gateway.hadoop.iis.openaire.eu (see Redmine #"1936":https://issue.openaire.research-infrastructures.eu/issues/1936)
795
  - Moved MongoDB mdstore & oaistore* on services.openaire.eu from /srv & /srv3 to /srv2 (see Redmine #"1940":https://issue.openaire.research-infrastructures.eu/issues/1940)
796
  - Fixed HDFS balancer on master1.hadoop.iis.openaire.eu which was causing the load peaks there
797
March 08, 2016:
798
  - Replaced a failed disk in RAID-0 (available as /dev/sdc on openaire-iis-hadoop2-dom0.vls) for HDFS in slave3.hadoop.iis.openaire.eu (available as /dev/xvde and mounted as /srv/data/3)
799
  - Replaced a failed disk in RAID-1 (available as /dev/sdg) for LVM on openaire-iis-hadoop2-dom0.vls
800
  - Started again slave3.hadoop.iis.openaire.eu
801
  - Created a testing account for Jochen in the FTP service on ftp.openaire.eu (alias for www.openaire.eu), see Redmine #"1929":https://issue.openaire.research-infrastructures.eu/issues/1929
802
March 07, 2016:
803
  - Shutdowned slave3.hadoop.iis.openaire.eu because of HDFS disk failure
804
  - Restarted DataNodes of IIS Hadoop cluster, because of HBase Master issue ("org.apache.hadoop.hbase.util.FSUtils: Waiting for dfs to exit safe mode...", reported by Claudio, see Redmine #"1931":https://issue.openaire.research-infrastructures.eu/issues/1931)
805
  - Launched manually /usr/local/sbin/get-piwik-users-actions.sh script of gateway.hadoop.iis.openaire.eu, because it failed because of IIS Hadoop HDFS issue ("Name node is in safe mode", see above)
806
  - Increased size (from 100GB to 150GB) of /srv partition on beta.stats.openaire.eu
807
  - Eri Katsari & Andrea Mannocci added to a recipient list of Monit alerts for /srv on stats.openaire.eu & beta.stats.openaire.eu
808
March 04, 2016:
809
  - Installed MongoDB on pilot.services.openaire.eu and restored there objectStore db for a testing purpose (see Redmine #"1747":https://issue.openaire.research-infrastructures.eu/issues/1747)
810
  - Dropped objectStore db of MongoDB on services.openaire.eu and restored it from a backup (see above)
811
  - Purged the old logs of Zookeeper of {namenode1,jobtracker1,hbase-master1}.hadoop.dm.openaire.eu because of a near full-filled / partition
812
March 03, 2016:
813
  - Unsuccessful attempt to repair MongoDB on services.openaire.eu (see Redmine #"1747":https://issue.openaire.research-infrastructures.eu/issues/1747)
814
March 02, 2016:
815
  - Installed python-pip and python-libxml2 Debian packages and also beautifulsoup4 Python package on services.openaire.eu and beta.services.openaire.eu (asked by Sandro La Bruzzo, see Redmine #"1930":https://issue.openaire.research-infrastructures.eu/issues/1930)
816
February 29, 2016:
817
  - Restarted MySQL on openaire-www.vls, because Joomla had an issue with connecting its database
818
February 27, 2016:
819
  - Restarted openaire-virtuoso-beta.vls, asked by Giorgos Alexiou
820
February 26, 2016:
821
  - Deleted the local user logs of MapReduce on all slaves of the DM Hadoop cluster (asked by Giorgos, see Redmine #"1917":https://issue.openaire.research-infrastructures.eu/issues/1917)
822
  - Increased a number of CPU cores (from 12 to 16) and memory (from 32GB to 48GB) on openaire-virtuoso-beta.vls (see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
823
  - Launched 8580 on pilot.services.openaire.eu, because it was dead
824
February 24, 2016:
825
  - Deployed the new Xen DomUs called slave9.hadoop.dm.openaire.eu and slave10.hadoop.dm.openaire.eu for the DM Hadoop cluster
826
  - Deployed Ganglia on the master servers of DM Hadoop cluster
827
February 23, 2016:
828
  - Created a new Xen DomUs called slave9.hadoop.dm.openaire.eu and slave10.hadoop.dm.openaire.eu for the DM Hadoop cluster, because HDFS is near full-filled (see Redmine #"1904":https://issue.openaire.research-infrastructures.eu/issues/1904)
829
  - Deleted the old local user logs of MapReduce on all slaves of the DM Hadoop cluster (see Redmine #"1904":https://issue.openaire.research-infrastructures.eu/issues/1904)
830
February 22, 2016:
831
  - Created a new Xen Dom0 called openaire-dm-hadoop3-dom0.vls for the DM Hadoop cluster slaves, because HDFS is near full-filled (see Redmine #"1904":https://issue.openaire.research-infrastructures.eu/issues/1904)
832
February 19, 2016:
833
  - Removed doe.osti.gov (IP 192.107.175.11) from a list of DROPed IP addresses on the openaire-www.vls firewall, after Natalia request
834
  - Bumped LIMIT (from 30 to 50) of /usr/local/sbin/antiloris.sh on openaire-www.vls
835
  - Increased a number of CPU cores (from 8 to 12) on openaire-virtuoso-beta.vls (see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
836
  - Installed Ganglia on the master servers of DM Hadoop cluster
837
  - HDFS balancer threshold set to 3 in cron.d/hadoop-hdfs-balancer at DM Hadoop cluster
838
February 17, 2016:
839
  - Updated Java (from version 6 to 7) on DM Hadoop cluster (see Redmine #"1892":https://issue.openaire.research-infrastructures.eu/issues/1892)
840
  - Restarted openaire-virtuoso-beta.vls, asked by Giorgos Alexiou
841
February 16, 2016:
842
  - Fixed an ownership of the files under /etc (in particular /etc/default/tomcat-instance-8*80) on openaire-services-beta.vls which belong now to "driver" group instead of an old and inactive "monkeys" group, reported by Nikon Gasparis who couldn't change the memory settings for 8380 container
843
  - The same action on openaire-services.vls (see Redmine #"1891":https://issue.openaire.research-infrastructures.eu/issues/1891)
844
February 15, 2016:
845
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
846
  - Increased a number of CPU cores (from 4 to 8) and amount of memory (from 16GB to 32GB) on openaire-virtuoso-beta.vls (see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
847
  - Created backup of Joomla on test.openaire.eu, asked by Argiro
848
  - Synchronised test.openaire.eu with www.openaire.eu, asked by Argiro
849
  - Fixed Apache2 config for blogs.openaire.eu site on openaire-www.vls (enabled and used proxy_html module for fixing "http://blogs.openaire.eu/":http://blogs.openaire.eu/ links)
850
February 12, 2016:
851
  - Activated and configured LoginLDAP plugin of Piwik (see Redmine #"1828":https://issue.openaire.research-infrastructures.eu/issues/1828)
852
  - Opened access to port 1111 on openaire-virtuoso-beta.vls from openaire-dm-hadoop-gw (asked by Giorgos Alexiou, see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
853
February 11, 2016:
854
  - Imported to Piwik the latest Nginx logs of api.openaire.eu starting from January 16 until to February 11 (see Redmine #"1828":https://issue.openaire.research-infrastructures.eu/issues/1828)
855
  - Created a script import-api-logs.sh on piwik.vls for importing API logs to Piwik via Cron nightly (see above)
856
  - Installed LoginLDAP plugin of Piwik (see above)
857
February 10, 2016:
858
  - Upgraded ownCloud of box.openaire.eu from version 8.2.1 to 8.2.2
859
February 3, 2016:
860
  - Purged the old logs of Hadoop HDFS/MapReduce and Oozie of ci-test.hadoop.iis.openaire.eu because of a near full-filled / partition
861
  - Athena RC networks are allowed now to log in at gateway.hadoop.dm.openaire.eu (see Redmine #"1866":https://issue.openaire.research-infrastructures.eu/issues/1866)
862
  - Added more CPU cores (4) and memory (16GB) for beta.virtuoso.openaire.eu (see above)
863
February 2, 2016:
864
  - Increased -Xmx size (from 2GB to 4GB) for JobTracker HA on master[12].hadoop.iis.openaire.eu (see Redmine #"1859":https://issue.openaire.research-infrastructures.eu/issues/1859)
865
January 29, 2016:
866
  - Created a new instance of ownCloud ("http://box-test.openaire.eu/)":http://box-test.openaire.eu/) on farm-www.vls for the update testing
867
January 28, 2016:
868
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
869
January 27, 2016:
870
  - Assisting Claudio with resolving his issue with accessing the DM Hadoop slaves in order to check the job logs (changed his SSH public key, fixed the job directory permissions from 700 to 755)
871
January 25, 2016:
872
  - Disabled a shell script for cross-backup with CERN on orli, because our account at CERN wasn't working starting from May 2015
873
January 21, 2016:
874
  - Removed the old .hprof files of 8380 container on services.openaire.eu, because of a near full-filled / partition
875
January 20, 2016:
876
  - Reported to Pisa team that their 8290 container is dead on services.openaire.eu and beta.services.openaire.eu (see Redmine #"1836":https://issue.openaire.research-infrastructures.eu/issues/1836)
877
January 19, 2016:
878
  - Purged the old logs of Zookeeper of hbase-master1.hadoop.dm.openaire.eu because of a near full-filled / partition
879
  - Create a new website in Piwik for Portugal Cocum Repository (see Redmine #"1671":https://issue.openaire.research-infrastructures.eu/issues/1671)
880
  - Open access to port 6379 (Redis) on test.openaire.eu from beta.services.openaire.eu (see Redmine #"1833":https://issue.openaire.research-infrastructures.eu/issues/1833)
881
January 18, 2016:
882
  - Set rotate 730 for rotating the Nginx logs on furkot2.vls, because Natalia wanted the numbers of api.openaire.eu for a report for EC
883
  - Created a new website for api.openaire.eu in Piwik (see Redmine #"1828":https://issue.openaire.research-infrastructures.eu/issues/1828)
884
  - Imported Nginx logs of api.openaire.eu to Piwik (see above)
885
January 11, 2016:
886
  - Purged the old logs of Hadoop HDFS/MapReduce and Oozie of ci-test.hadoop.iis.openaire.eu because of a near full-filled / partition
887
  - Increased size of /mnt/mongodb_backup partition of services.openaire.eu from 5TB to 6TB, changed a backup policy (dump.old/ directory for a previous dump and dump/ for a current dump), enabled the snapshots feature of NetApp for the appropriate volume (see Redmine #"1806":https://issue.openaire.research-infrastructures.eu/issues/1806)
888
  - Launched JobTracker on master1.hadoop.iis.openaire.eu, because it was dead
889
January 9, 2016:
890
  - Purged the old dumps of MongoDB of services.openaire.eu because of a near full-filled /mnt/mongodb_backup partition (see Redmine #"1806":https://issue.openaire.research-infrastructures.eu/issues/1806)
891
January 8, 2016:
892
  - Launched 8380 on services.openaire.eu, because it was dead (see Redmine #"1801":https://issue.openaire.research-infrastructures.eu/issues/1801)
893
  - Investigating a timeout issue reported by Dimitris Pierrakos which was trying to download UMINHO data from Piwik
894
January 7, 2016:
895
  - Launched 8580 on pilot.services.openaire.eu, because it was dead
896
  - Re-processed all data in Piwik for OpenAIRE Post-grant Pilot site, because a report for a year period was broken (reported by Natalia)
897
  - Enabled processing the unique visitors for a year period in Piwik and re-processed all data for every OpenAIRE related site (enabled by Natalia)
898
January 4, 2016:
899
  - Installed Java 7 on virtuoso.openaire.eu and virtuoso-beta.openaire.eu and deployed Tarql 1.0a there (see Redmine #"1390":https://issue.openaire.research-infrastructures.eu/issues/1390)
900
December 26, 2015:
901
  - Purged the old logs of Hadoop HDFS/MapReduce and Oozie of ci-test.hadoop.iis.openaire.eu because of a near full-filled / partition
902
December 24, 2015:
903
  - Increased size of /srv partition on ci-test.hadoop.iis.openaire.eu from 20GB to 40GB
904
December 21, 2015:
905
  - Renamed /mnt/harvested_pdfs to /mnt/downloaded_dumps on services.openaire.eu, beta.services.openaire.eu and gateway.hadoop.iis.openaire.eu (see Redmine #"1776":https://issue.openaire.research-infrastructures.eu/issues/1776)
906
December 18, 2015:
907
  - Making beta.lod.openaire.eu and virtuoso-beta.openaire.eu ready for testing (see Redmine #"1748":https://issue.openaire.research-infrastructures.eu/issues/1748)
908
  - Configured a redirection from lod.openaire.eu to beta.lod.openaire.eu
909
December 15, 2015:
910
  - Installed python-apsw package on pyszny.vls & nosal.vls, because it's necessary for running IIS jobs on Jenkins (asked by Lukasz Dumiszewski)
911
  - Increased size of NetApp volume mounted via NFS on gw.hadoop.iis.openaire.eu as /mnt/harversed_pdfs from 1TB to 1.5TB (Mantis #"9595":https://mantis.icm.edu.pl/view.php?id=9595)
912
  - Resolved Claudio's problem with launching `sudo su - dnet` on gw.hadoop.dm.openaire.eu (see Redmine #"1765":https://issue.openaire.research-infrastructures.eu/issues/1765)
913
December 11, 2015:
914
  - Fixed a content of /var/run/mongodb/mongodb.pid file on services.openaire.eu which causes an issue with Monit, because it contaided an invalid PID number of MongoDB process (see Redmine #"1746":https://issue.openaire.research-infrastructures.eu/issues/1746)
915
December 9, 2015:
916
  - Fixed an issue with an invalid SSH key on solr.openaire.eu which caused that making of a system backup was impossible
917
  - Removed an old and unused logrotate config for MongoDB on services.openaire.eu which caused "duplicate log entry for /var/log/mongodb/mongodb.log" error
918
  - Purged an old and unused postgresql-common package on furkot2.vls which caused "error accessing /var/log/postgresql: No such file or directory" error
919
December 7, 2015:
920
  - Upgraded ownCloud of box.openaire.eu from version 7.0.4 to 8.2.1
921
  - Created a new VM beta.virtuoso.openaire.eu for Virtuoso server (see Redmine #"1748":https://issue.openaire.research-infrastructures.eu/issues/1748)
922
December 5, 2015:
923
  - Increased /srv from 400GB to 500GB on services.openaire.eu (see Redmine #"1746":https://issue.openaire.research-infrastructures.eu/issues/1746)
924
December 2, 2015:
925
  - Created an account for Dimitris Pierrakos in OpenAIRE Piwik (see Redmine #"1695":https://issue.openaire.research-infrastructures.eu/issues/1695)
926
  - Fixed the write rights for some HDFS directories on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
927
  - Opened ports on the firewall for the web interfaces of HDFS, MapReduce, YARN and Spark (see above)
928
December 1, 2015:
929
  - Installed and configured Spark on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
930
  - Created a website and an user for Zenodo in Piwik on analytics.openaire.eu (see Redmine #"1695":https://issue.openaire.research-infrastructures.eu/issues/1695)
931
November 30, 2015:
932
  - Enabled monitoring of YARN {Node,Resource}Manager and Mapreduce HistoryServer on ci-test.hadoop5.iis.openaire.eu
933
November 26, 2015:
934
  - Installed Java 8 on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
935
  - Fixed file "https://www.openaire.eu/cerif_schema/cerif-1.6-2_openaire-1.0.xsd":https://www.openaire.eu/cerif_schema/cerif-1.6-2_openaire-1.0.xsd (copied from furkot2.vls to openaire-www.vls), reported by Jan Dvorak
936
  - Made box8.openaire.eu accessible for testing for Natalia and Pedro
937
November 25, 2015:
938
  - Removed old and unused Zookeeper files on jobtracker1.hadoop.dm.openaire.eu because of near full-filled / partition
939
  - Enabled /usr/local/sbin/make-hdfs-user-home script in PAM on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
940
November 24, 2015:
941
  - Increased quota for Natalia (from 1GB to 5GB) in box.openaire.eu
942
  - Installed YARN on ci-test.hadoop5.iis.openaire.eu (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
943
November 19, 2015:
944
  - Investigating an issue with near full-filled / partition on services.openaire.eu where 8380 container created a few huge .hprof files (removed my Nikon after my request)
945
  - Created backup of Joomla on www.openaire.eu, asked by Argiro
946
  - Assisting during Joomla Security update on www.openaire.eu, done by Argiro
947
November 18, 2015:
948
  - Killed a hunged process for 8586 port on pilot.services.openaire.eu and started 8580 again (reported by Nikon)
949
November 17, 2015:
950
  - Investigating an issue with a bad encoding of the validator messages (reported by Nikon, see Redmine #"921":https://issue.openaire.research-infrastructures.eu/issues/921)
951
  - Investigating an issue with uploading files to box.openaire.eu: "Your storage is full, files can not be updated or synchronized anymore!" (reported by Sahar)
952
  - Set scheduled execution of VACUUM ANALYZE on the dnet_openaireplus database on services.openaire.eu and beta.services.openaire.eu (see Redmine #"1694":https://issue.openaire.research-infrastructures.eu/issues/1694)
953
November 13, 2015:
954
  - Configured authorized SSH keys of jenkins at ci-test.hadoop(5).iis.openaire.eu for SSH connections from ci.ceon.pl (see Mantis #"9573":https://mantis.icm.edu.pl/view.php?id=9573) for running IIS integration tests
955
November 5:
956
  - increased client_max_body_size (to 10M) for postgrantoapilot.openaire.eu (asked by Antonis) 
957
November 4:
958
  - Created Piwik accounts for Portugal pilot repositories (asked by Pedro)
959
  - Fixed broken LDAP configuration of box.openaire.eu
960
November 1, 2015:
961
  - Security upgrade of PHP and MySQL on {beta,test,www}.openaire.eu
962
October 27, 2015:
963
  - Installed php5-gmp package on www.openaire.eu (asked by Eri)
964
  - Copied Joomla directory and database from www.openaire.eu to {beta,test}.openaire.eu (asked by Argiro)
965
  - Upgraded Piwik for OpenAIRE ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.14.3 to 2.15.0.
966
October 26, 2015:
967
  - Installed composer.phar ("https://getcomposer.org/)":https://getcomposer.org/) on www.openaire.eu (asked by Eri)
968
October 23, 2015:
969
  - Security upgrade of PostgreSQL 9.3 on beta.services.openaire.eu (see Redmine #"1646":https://issue.openaire.research-infrastructures.eu/issues/1646) 
970
October 22, 2015:
971
  - Deployed ci-test.hadoop5.iis.openaire.eu machine for a new pseudo Hadoop CDH5 cluster for running IIS integration tests (see Mantis #"9567":https://mantis.icm.edu.pl/view.php?id=9567)
972
  - Security upgrade of PostgreSQL 9.3 on services.openaire.eu (see Redmine #"1646":https://issue.openaire.research-infrastructures.eu/issues/1646) 
973
  - Security upgrade of PostgreSQL 9.3 on stats.openaire.eu & beta.stats.openaire.eu (see Redmine #"1645":https://issue.openaire.research-infrastructures.eu/issues/1645) 
974
October 21, 2015:
975
  - Security upgrade of PostgreSQL 9.3 on pilot.services.openaire.eu (see Redmine #"1646":https://issue.openaire.research-infrastructures.eu/issues/1646) 
976
October 16, 2015:
977
  - Helping Dimitris Pierrakos with his trouble with accessing the portal Joomla logs stored on HDFS of IIS Hadoop cluster
978
  - Helping Natalia & Antonis with their trouble with accessing Piwik stats for blogs.openaire.eu and Post-Grant Pilot
979
  - Answering Antonis who asked about the backups of Post-Grant Pilot DB
980
  - Removed old and unused logs of HDFS, MapReduce and Oozie on ci-test.hadoop.iis.openaire.eu, because they near full-filled / partition
981
October 15, 2015:
982
  - Reported the portal Apache errors to Argiro Kokogiannaki
983
  - Copied Redis server content from stats.openaire.eu to beta.stats.openaire.eu (asked by Eri Katsari)
984
  - Investigating the issues with wrong URLs ("http://localhost:8890/)":http://localhost:8890/) for lod.openaire.eu (see Redmine #"1632":https://issue.openaire.research-infrastructures.eu/issues/1632) 
985
October 14, 2015:
986
  - andrea.mannocci added to driver group at stats.openaire.eu (see Redmine #"1441":https://issue.openaire.research-infrastructures.eu/issues/1441)
987
  - Reported the portal Apache errors to Argiro Kokogiannaki
988
October 13, 2015:
989
  - Created Piwik account for Pedro Principe and given him an access to the stats for all Portugal pilot services (see Redmine #"1483":https://issue.openaire.research-infrastructures.eu/issues/1483)
990
October 12, 2015:
991
  - Fixed LDAP authentication for "https://analytics.openaire.eu/":https://analytics.openaire.eu/ (see Redmine #"1622":https://issue.openaire.research-infrastructures.eu/issues/1622)
992
  - Investigating the issue with unreachable MySQL server of the portal ("/usr/sbin/mysqld: Got an error writing communication packets")
993
October 09, 2015:
994
  - Copied 1.0/ and 0.3/ schema from furkot2.vls to openaire-www.vls (see Redmine #"1617":https://issue.openaire.research-infrastructures.eu/issues/1617)
995
  - alessia.bardi added to driver & joomla groups at www.openaire.eu (see Redmine #"1617":https://issue.openaire.research-infrastructures.eu/issues/1617)
996
October 07, 2015:
997
  - Removed the old and unused ZooKeeper/Hadoop logs on hbase-master[12].hadoop.dm.openaire.eu
998
  - Investigating the issue with LDAP/DAV authentication for "http://virtuoso.openaire.eu/":http://virtuoso.openaire.eu/ (see Redmine #"1391":https://issue.openaire.research-infrastructures.eu/issues/1391)
999
  - Enabled access to HFTP (50070 port) on gateway.hadoop.dm.openaire.eu from spark-gw.vls.icm.edu.pl (see Mantis #"9561":https://mantis.icm.edu.pl/view.php?id=9561)
1000
October 06, 2015:
1001
  - Continued polishing the rewrite/proxy rules for lod.openaire.eu (see Redmine #"1408":https://issue.openaire.research-infrastructures.eu/issues/1408)
1002
October 02, 2015:
1003
  - Fixed an issue of Anja Oberländer (<Anja.Oberlaender@uni-konstanz.de>) who couldn't see some documents under "http://box.openaire.eu":http://box.openaire.eu, because she didn't belong to "Reviewers" group (forwarded by Claudio Atzori)
1004
  - Polished the rewrite/proxy rules for lod.openaire.eu (see Redmine #"1408":https://issue.openaire.research-infrastructures.eu/issues/1408)
1005
October 01, 2015:
1006
  - Ported the missing reverse proxy rules for /validator-{admin,services} from furkot2.vls (old.openaire.eu, Nginx) to openaire-www.vls (www.openaire.eu, Apache2) (reported by Nikon Gasparis, see Redmine #"1577":https://issue.openaire.research-infrastructures.eu/issues/1577)
1007
  - Created /mnt/virtuoso/upload directory writable by driver group on virtuoso.openaire.eu (asked by Giorgos Alexiou, see Redmine #"1408":https://issue.openaire.research-infrastructures.eu/issues/1408)
1008
  - A new proxy rules for ^/data/ requests on lod.openaire.eu (see above)
1009
September 30, 2015:
1010
  - Enabled a redirection from "https://guidelines.openaire.eu/wiki/OpenAIRE_Guidelines:_For_Literature_repositories":https://guidelines.openaire.eu/wiki/OpenAIRE_Guidelines:_For_Literature_repositories to "https://guidelines.openaire.eu/en/latest/literature/index.html":https://guidelines.openaire.eu/en/latest/literature/index.html (asked by Nikon Gasparis, see Redmine #"1571":https://issue.openaire.research-infrastructures.eu/issues/1571)
1011
  - Updated avroknife from 0.9.3 to 1.0.5 on gateway.hadoop.iis.openaire.eu (asked by Mateusz Kobos, see Mantis #"9559":https://mantis.icm.edu.pl/view.php?id=9559)
1012
September 29, 2015:
1013
  - Open access to virtuoso.openaire.eu via SSH from Athena RC network (asked by Giorgos Alexiou)
1014
  - Open access to lod.openaire.eu via HTTP from the whole world (asked by Christoph Lange)
1015
  - /var/www/lod directory made writable for driver group at virtuoso.openaire.eu (see Redmine #"1569":https://issue.openaire.research-infrastructures.eu/issues/1569)
1016
  - christoph.lange & george.papastefanatos added to driver group at virtuoso.openaire.eu (see Redmine #"1568":https://issue.openaire.research-infrastructures.eu/issues/1568)
1017
September 28, 2015:
1018
  - Installed missing packages for Virtuoso, e.g. iSPARQL, Conductor, BPEL, etc
1019
  - Configured a reverse proxy for "http://lod.openaire.eu/sparql":http://lod.openaire.eu/sparql
1020
  - Added permissions for managing Virtuoso server and editing virtuoso.ini file for "driver" group
1021
September 25, 2015:
1022
  - Restored a backup dump of dnet_openaireplus database of PostgreSQL on services.openaire.eu (asked by Alessia Bardi & Michele Artini)
1023
September 24, 2015:
1024
  - Increased /srv from 400GB to 500GB on solr.openaire.eu
1025
  - Configured lod.openaire.eu (see Redmine #"1408":https://issue.openaire.research-infrastructures.eu/issues/1408)
1026
September 23, 2015:
1027
  - Granted the privileges for Dimitris Pierrakos to an access Piwik statistics of pilot Portugal repositories (see Redmine #"1483":https://issue.openaire.research-infrastructures.eu/issues/1483)
1028
September 22, 2015:
1029
  - Now Virtuoso server on virtuoso.openaire.eu runs as an unprivileged "virtuoso" user
1030
  - Configured a reverse proxy for virtuoso.openaire.eu
1031
September 21, 2015:
1032
  - Created a new VM virtuoso.openaire.eu for Virtuoso server (see Redmine #"1391":https://issue.openaire.research-infrastructures.eu/issues/1391)
1033
  - Deployed Virtuoso Opensource 7 server there
1034
September 17, 2015:
1035
  - Removed .hprof file of 8380 (it had 4.8GB) on services.openaire.eu, because its / partition was near full-filled
1036
  - Asked Alessia & Claudio for removing old versions of is.war on services.openaire.eu, because of the same issue (see above)
1037
  - Removed old logs of HDFS, MapReduce and Oozie on ci-test.hadoop.ci.openaire.eu, because its / partition was near full-filled
1038
  - Fixed DNS settings for openaire.eu (see Redmine #"1532":https://issue.openaire.research-infrastructures.eu/issues/1532)
1039
September 16, 2015:
1040
  - Increased /srv on stats.openaire.eu from 150GB to 200GB
1041
  - Configured Joomla for Piwik tracking on www.openaire.eu (we forgot about it yesterday)
1042
  - Debugging an issue with a big load and poor I/O performance on stats.openaire.eu, because of a lot of long running SELECTs of PostgreSQL
1043
September 15, 2015:
1044
  - Migrated Joomla portal from furkot2.vls to openaire-www.vls
1045
  - Stopped and uninstalled Redis on openaire-www.vls
1046
September 14, 2015:
1047
  - Created backup of Joomla on new.openaire.eu, asked by Argiro
1048
September 10, 2015:
1049
  - Created backup of Joomla on new.openaire.eu, asked by Argiro
1050
  - Created backup of Joomla on www.openaire.eu, asked by Katerina
1051
September 8, 2015:
1052
  - Installed and configured Fail2Ban on test.openaire.eu (after Eri's email)
1053
  - Patched apache-{auth,common}.conf rules of Fail2Ban, because the maintainer rules don't work with Apache2 error logs
1054
  - Deployed Fail2Ban also on new.openaire.eu and beta.openaire.eu
1055
September 7, 2015:
1056
  - Installed Redis server on stats.openaire.eu and moved there Redis database content from furkot2 (see Redmine #"1515":https://issue.openaire.research-infrastructures.eu/issues/1515)
1057
  - Stopped furkot2 Redis (see the Redmine ticket above)
1058
  - Open access to port 6379 (Redis) on test.openaire.eu from services.openaire.eu (asked by Alessia, see the Redmine ticket above)
1059
  - Copied Redis database content from test.openaire.eu to new.openaire.eu (see the Redmine ticket above)
1060
September 3, 2015:
1061
  - Reporting that a production portal search is not working, because Thrift on services.openaire.eu (7911 port) is dead
1062
  - Added a new recipients of DNet monitoring on services.openaire.eu and beta.services.openaire.eu
1063
  - Enabled monitoring of a beta portal search by Monit at beta.services.openaire.eu
1064
September 2, 2015:
1065
  - Reconfigured Hive on hue.hadoop.dm.openaire.eu and created MySQL database for it on hbase-master2.hadoop.dm.openaire.eu, deployed Java connector for MySQL
1066
  - Enabled web console of DM Oozie
1067
  - Installed hue-plugins on DM Hadoop JobTrackers
1068
September 1, 2015:
1069
  - Debugging an issue with validating repositories available only via HTTPS (see Redmine #"1479":https://issue.openaire.research-infrastructures.eu/issues/1479)
1070
  - Debugging an issue with Hue of DM Hadoop (reported by Eri)
1071
August 31, 2015:
1072
  - Restarted Hue server on hue.hadoop.dm.openaire.eu, because it was unresponsible (reported by Eri)
1073
  - Synchronised beta.openaire.eu with new.openaire.eu (asked by Katerina)
1074
  - Increased the actions limits for OpenAIRE Piwik (asked by Dimitris Pierrakos)
1075
  - Updated Ubuntu from Precise to Trusty on beta.openaire.eu (asked by Katerina)
1076
August 28, 2015:
1077
  - Debugging I/O issues on beta.services.openaire.eu (see Redmine #"1502":https://issue.openaire.research-infrastructures.eu/issues/1502)
1078
  - lukasz.dumiszewski and krzysztof.madry added to "driver" group on gateway.hadoop.iis.openaire.eu (see Mantis #[9545>>"https://mantis.icm.edu.pl/view.php?id=9545":https://mantis.icm.edu.pl/view.php?id=9545]])
1079
  - Restarted solr.openaire.eu in order to bump memory there
1080
August 27, 2015:
1081
  - Increased memory from 24GB to 32GB on openaire-solr
1082
  - Changed permissions for /etc/apache2/ssl/STAR_openaire_eu.key on new.openaire.eu, because SimpleSAMLphp (asked by Eri) couldn't read it
1083
August 26, 2015:
1084
  - Started nslcd daemon on test.openaire.eu, because it was dead and Eri & Argiro couldn't access there via SSH
1085
  - Synchronised test.openaire.eu with new.openaire.eu (asked by Katerina & Argiro)
1086
  - Moved some NKUA stuff from /srv to /srv2 on services.openaire.eu and gzipped some .csv files under /srv/dnet, because /srv partition was a near full-filled
1087
  - Added self-signed CNR certificate to Java keystore on services.openaire.eu and beta.services.openaire.eu (asked by Andrea Mannocci, see Redmine #"1442":https://issue.openaire.research-infrastructures.eu/issues/1442)
1088
August 25, 2015:
1089
  - Configured Nginx proxy rules for /dfm on services.openaire.eu (see Redmine #"1387":https://issue.openaire.research-infrastructures.eu/issues/1387)
1090
August 24, 2015:
1091
  - Created data_flow_monitoring database owned by dfm user in PostgreSQL and /var/lib/dfm directory on openaire-services.vls (asked by Alessia Bardi)
1092
  - Added a new IP address of Glykeria Katsari in Puppet and on a local PostgreSQL instances for OpenAIRE stats & services
1093
  - Enabled Piwik tracking in Wordpress for "http://blogs.openaire.eu":http://blogs.openaire.eu (asked by Pedro Miguel Oliveira Bento Príncipe)
1094
August 19, 2015:
1095
  - Updated Ubuntu from Precise to Trusty on test.openaire.eu (asked by Katerina)
1096
August 17, 2015:
1097
  - Created backup of Joomla on beta.openaire.eu, asked by Katerina
1098
  - Synchronised beta.openaire.eu with new.openaire.eu (asked by Katerina)
1099
August 12, 2015:
1100
  - Added an user's authentication against a local .htpasswd file on "https://analytics.openaire.eu/":https://analytics.openaire.eu/ (Dimitris Pierrakos asked for a remote access to Piwik data for UMINHO Pilot website)
1101
August 6, 2015:
1102
  - Created a new Piwik websites for 3 Portugal repositories (see Redmine #"1483":https://issue.openaire.research-infrastructures.eu/issues/1483)
1103
  - Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.14.1 to 2.14.3.
1104
August 5, 2015:
1105
  - Updated Ubuntu from Precise to Trusty on services.openaire.eu (see Redmine #"1481":https://issue.openaire.research-infrastructures.eu/issues/1481)
1106
  - Also migrated there PostgreSQL 9.1 to 9.3
1107
  - Also upgraded there MongoDB to 2.4.9
1108
August 3, 2015:
1109
  - Created a reverse proxy rules for "http://api.openaire.eu/provision/mvc/resources":http://api.openaire.eu/provision/mvc/resources (see Redmine #[844>>"https://issue.openaire.research-infrastructures.eu/issues/844":https://issue.openaire.research-infrastructures.eu/issues/844]])
1110
  - Created a reverse proxy rules for "http://api.openaire.eu/search/openSearchDescriptor":http://api.openaire.eu/search/openSearchDescriptor (see Redmine #[348>>"https://issue.openaire.research-infrastructures.eu/issues/348":https://issue.openaire.research-infrastructures.eu/issues/348]])
1111
  - Created an account openaire-blogs in OpenAIRE's Piwik ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) for accessing by Wordpress on blogs.openaire.eu (asked by Pedro Miguel Oliveira Bento Príncipe)
1112
  - Synced with Zenodo "https://www.openaire.eu/cerif_schema/cerif-1.6-2_openaire-1.0.xsd":https://www.openaire.eu/cerif_schema/cerif-1.6-2_openaire-1.0.xsd file (asked by Jan.Dvorak@ff.cuni.cz)
1113
July 17, 2015:
1114
  - Removed the old logs of Zookeeper on the masters of DM Hadoop cluster in order to take some free disk space on / partition
1115
  - Removed the old logs of Zookeeper, Hadoop HDFS and Mapreduce on the masters of test-ci.hadoop.iis.openaire.eu because of the same reason like above
1116
  - Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.13.1 to 2.14.1.
1117
July 16, 2015:
1118
  - Increased memory from 24GB to 32GB on openaire-solr-beta
1119
  - Enabled basic authentication in Nginx for "https://beta.services.openaire.eu/dfm/":https://beta.services.openaire.eu/dfm/ (see Redmine #"1442":https://issue.openaire.research-infrastructures.eu/issues/1442)
1120
July 15, 2015:
1121
  - Enabled the users authentication against CNR LDAP on solr.openaire.eu and beta.solr.openaire.eu (see Redmine #"1438":https://issue.openaire.research-infrastructures.eu/issues/1438)
1122
  - Disabled "monkeys" account on solr.openaire.eu and beta.solr.openaire.eu (see above)
1123
  - alessia.bardi and claudio.atzori added to "driver" group on solr.openaire.eu and beta.solr.openaire.eu (see above)
1124
  - Enabled the users authentication against CNR LDAP on solr.openaire.eu and beta.solr.openaire.eu (see Redmine #"1439":https://issue.openaire.research-infrastructures.eu/issues/1439)
1125
  - Disabled "monkeys" and "joomla" accounts on solr.openaire.eu and beta.solr.openaire.eu (see above)
1126
  - eri.katsari, katerina.iatropoulou and antonis.lempesis added to "driver" group on solr.openaire.eu and beta.solr.openaire.eu (see above)
1127
  - Synchronised beta.openaire.eu with new.openaire.eu (asked by Argiro)
1128
  - andrea.mannocci and alessia.bardi added to "driver" group on beta.stats.openaire.eu (see Redmine #"1441":https://issue.openaire.research-infrastructures.eu/issues/1441)
1129
July 14, 2015:
1130
  - Disabled "monkeys" account on services.openaire.eu (see Redmine #"1434":https://issue.openaire.research-infrastructures.eu/issues/1434)
1131
  - christoph.broschinski added to "driver" group on services.openaire.eu (see Redmine #"1434":https://issue.openaire.research-infrastructures.eu/issues/1434)
1132
July 13, 2015:
1133
  - Added a public SSH key of Argiro Kokogiannaki to keyring of "monkeys" user, because she needs an access to the claims database on services.openaire.eu
1134
  - Open access to port 7911 (Thrift) on services.openaire.eu from scoobydoo.di.uoa.gr (asked by Argiro)
1135
  - Enabled the users authentication against CNR LDAP on services.openaire.eu (see Redmine #"1434":https://issue.openaire.research-infrastructures.eu/issues/1434)
1136
July 10, 2015:
1137
  - Debugging an issue (504 Gateway Timeout) for guidelines.openaire.eu (see Redmine #"1425":https://issue.openaire.research-infrastructures.eu/issues/1425)
1138
  - Fixed UID/GID for "dnet" user on gateway.hadoop.iis.openaire.eu (see Redmine #"903":https://issue.openaire.research-infrastructures.eu/issues/903)
1139
  - Untared the newest bunch of arXiv PDFs: arXiv_pdf_150[456]_*.tar (see Redmine #"903":https://issue.openaire.research-infrastructures.eu/issues/903)
1140
July 09, 2015:
1141
  - Intervention on beta.services.openaire.eu because of a full-filed / partition because of a huge 8380 catelina.out log file (Katerina fixed it quickly and punished a guilty person)
1142
  - Deployed vsftpd on openaire-www.vls (asked by Jochen), because it can be helpful for uploading metadata by enternal publishers (e.g. F-1000)
1143
July 08, 2015:
1144
  - Configured a reverse proxy for /search/api on beta.services.openaire.eu (asked by Katerina for an external parties)
1145
July 07, 2015:
1146
  - Modified a reverse proxy for guidelines.openaire.eu (asked by Jochen Schirrwagen). Now we use guidelines.readthedocs.org site instead of MediaWiki instance on posredni.vls
1147
  - Made a backup of MediaWiki for guidelines.openaire.eu
1148
  - Create a redirect rule for old URLs for MediaWiki for guidelines.openaire.eu
1149
July 06, 2015:
1150
  - jochen.schirrwagen added to "driver" group on beta.services.openaire.eu (see Redmine #"1378":https://issue.openaire.research-infrastructures.eu/issues/1378)
1151
July 02, 2015:
1152
  - Restarted HBase on DM Hadoop cluster after nightly issues
1153
  - Enabled CNR LDAP authentication for the users of {beta,test}.openaire.eu (see Redmine #"1405":https://issue.openaire.research-infrastructures.eu/issues/1405)
1154
July 01, 2015: Rescued OpenAIRE2020 machines from a leap second armaggeddon
1155
June 30, 2015: Replaced a failed disk in slave4.hadoop.dm.openaire.eu
1156
June 29, 2015:
1157
  - Created a database for DFM on beta.services.openaire.eu (see Redmine #"1355":https://issue.openaire.research-infrastructures.eu/issues/1355)
1158
  - Configured Nginx on pilot.services.openaire.eu for supporting domain postgrantoapilot.openaire.eu instead of goldoapilot.openaire.eu (asked byStefania Martziou)
1159
June 26, 2015:
1160
  - Changed permissions for /var/lib/dfm on beta.services.openaire.eu on dnet:dnet (see Redmine #"1355":https://issue.openaire.research-infrastructures.eu/issues/1355)
1161
  - Disabled "monkeys" user on beta.services.openaire.eu (see Redmine #"1387":https://issue.openaire.research-infrastructures.eu/issues/1387)
1162
June 25, 2015:
1163
  - Open access to Redis & PostgreSQL port on beta.stats.openaire.eu from new.openaire.eu (asked by Eri)
1164
  - stefania.martziou added to "driver" group on pilot.services.openaire.eu and granted the same permissions like for Antonis to her (asked by Antonis)
1165
  - Created backup of Joomla on beta.openaire.eu, asked by Eri
1166
  - Synchronised beta.openaire.eu with new.openaire.eu (asked by Eri)
1167
  - Configured Nginx for a reverse proxy for DFM on beta.services.openaire.eu (see Redmine #"1387":https://issue.openaire.research-infrastructures.eu/issues/1387)
1168
June 19, 2015:
1169
  - eri.katsari, nikon.gasparis also added to "driver" group on beta.services.openaire.eu (see Redmine #"1378":https://issue.openaire.research-infrastructures.eu/issues/1378)
1170
June 18, 2015:
1171
  - andrea.manocci, sandro.labruzzo also added to "driver" group on beta.services.openaire.eu (see Redmine #"1378":https://issue.openaire.research-infrastructures.eu/issues/1378)
1172
  - Set the same rights in /etc/sudoers for "driver" group like for "monkeys" user
1173
  - Removed the rights from /etc/sudoers for the commands delivered by dnet-* packages, because they have been uninstalled during the distribution upgrade 
1174
June 17, 2015:
1175
  - Enabled CNR LDAP authentication for the users of beta.services.openaire.eu (see Redmine #"1378":https://issue.openaire.research-infrastructures.eu/issues/1378)
1176
  - alessia.bardi, claudio.atzori, michele.artini, antonis.lempesis, katerina.iatropoulou added to "driver" group there
1177
  - Mounted /home via NFS there
1178
June 16, 2015:
1179
  - Upgraded beta.services.openaire.eu from Ubuntu Precise to Trusty (see Redmine #"1355":https://issue.openaire.research-infrastructures.eu/issues/1355)
1180
June 15, 2015:
1181
  - michele.artini (CNR) added to "driver" group on gateway.hadoop.dm.openaire.eu (see Redmine #"1023":https://issue.openaire.research-infrastructures.eu/issues/1023)
1182
  - Open access to port 6379 (Redis) on new.openaire.eu from test.openaire.eu (asked by Eri)
1183
  - Open access to port 389 (Slapd) on new.openaire.eu from services.openaire.eu
1184
June 10, 2015:
1185
  - Restarted DataNodes & RegionServers of DM Hadoop cluster (see Redmine #"1367":https://issue.openaire.research-infrastructures.eu/issues/1367)
1186
  - Created backup of Joomla 3 on openaire-www.vls (aka new.openaire.eu), asked by Argiro
1187
June 9, 2015: Removed old logs of Oozie on master3.hadoop.iis.openaire.eu because of a lack of a free disk space on / partition
1188
June 8, 2015:
1189
  - Uploaded a fixed versions of Java SSL related .jar files (local_policy.jar & US_export_policy.jar) on services.openaire.eu and beta.services.openaire.eu (see Redmine #"1351":https://issue.openaire.research-infrastructures.eu/issues/1351)
1190
June 3, 2015:
1191
  - Fixed logrotate's config for rotating catalina.log and localhost_access.log on services.openaire.eu and beta.services.openaire.eu
1192
  - Killed hunged mongodump process on services.openaire.eu and restarted MongoDB there (see Redmine #"1342":https://issue.openaire.research-infrastructures.eu/issues/1342)
1193
  - giorgos.alexiou (ATHENA) added to "driver" group on gateway.hadoop.{dm,iis}.openaire.eu (asked by Eri)
1194
June 2, 2015: Open access to port 7911 (Thrift) on beta.services.openaire.eu from scoobydoo.di.uoa.gr (asked by Argiro)
1195
June 1, 2015:
1196
  - Set client_max_body_size 200M for Nginx on furkot2.vls (see Redmine #"1343":https://issue.openaire.research-infrastructures.eu/issues/1343)
1197
  - Set ssl = false for PostgreSQL on openaire-services-{beta,pilot}.vls, because we don't need SSL there
1198
May 31, 2015:
1199
  - Started PostgreSQL server on openaire-services.vls, because it was dead because of issues with permissions to a private SSL certificate
1200
  - Set ssl = false, because we don't need SSL there
1201
May 29, 2015:
1202
  - Untared and next bzipped the newest bunch of arXiv PDFs: arXiv_pdf_1412_*.tar & arXiv_pdf_150[1-3]_*.tar (see Redmine #"904":https://issue.openaire.research-infrastructures.eu/issues/904)
1203
May 28, 2015:
1204
  - Started container 8580 on openaire-services-pilot.vls, because it was dead (asked by Nikon)
1205
  - Disabled an user's authentication for goldoapilot.openaire.eu, because it's a public available now (asked by Antonis)
1206
May 28, 2015: Debuged an issue with sending messages from openaire-services-pilot.vls (asked by Nikon)
1207
May 26, 2015: Created a directory (/srv/www/static/openaire2020/wp10/deadlines/) on oscypek.vls for OpenAIRE2020 WP10 deadlines pages (asked by Mateusz Kobos)
1208
May 25, 2015: Installed php5-mcrypt package on openaire-www.vls (asked by Eri)
1209
May 22, 2015:
1210
  - Removed some old logs of IS (8280) and 8380's .hprof files on services.openaire.eu, because / partition was full-filled.
1211
  - Created backup of Joomla 3 on openaire-www.vls (aka new.openaire.eu), asked by Argiro
1212
  - Restored Joomla from furkot2 on test.openaire.eu, asked by Argiro
1213
May 21, 2015:
1214
  - Migrated a proxy rules for {blogs,box,guidelines,mining,validator}.openaire.eu from furkot2 (Nginx) to openaire-www.vls (Apache2)
1215
May 20, 2015:
1216
  - jyunyao.huang (UBONN) added to "driver" group on gateway.hadoop.dm.openaire.eu
1217
  - Migrated a proxy rules for api.openaire.eu from furkot2 (Nginx) to openaire-www.vls (Apache2)
1218
May 19, 2015:
1219
  - Created a new Piwik website for tracking UMINHO repository (asked by Dimitris)
1220
  - Restarted slave8.hadoop.dm.openaire.eu because of issue with Java zombie processes (see Redmine #"1326":https://issue.openaire.research-infrastructures.eu/issues/1326)
1221
May 14, 2015: Disabled authentication for /simplesaml requests on new.openaire.eu (asked by Eri, see Redmine #"1251":https://issue.openaire.research-infrastructures.eu/issues/1251)
1222
May 12, 2015:
1223
  - Installed python-pip and pymongo on beta.services.openaire.eu (asked by Sandro La Bruzzo, see Redmine #"1271":https://issue.openaire.research-infrastructures.eu/issues/1271)
1224
  - Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.12.0 to 2.13.1.
1225
May 11, 2015:
1226
  - Created NetApp volumes (4TB) for objectStore's PDFs files (see Redmine #"1271":https://issue.openaire.research-infrastructures.eu/issues/1271) adnd mounted via NFS on services.openaire.eu and beta.services.openaire.eu
1227
  - Deployed a new .war files of 8380 container on services.openaire.eu which includes a new settings of webapps log4j.properties
1228
May 8, 2015:
1229
  - Prepared Nginx rules (/validator-admin/ & /validator-service/) for a new production validator (see Redmine #"1303":https://issue.openaire.research-infrastructures.eu/issues/1303)
1230
  - Disabled the last changes for an access policy for goldoapilot.openaire.eu, now it's protected by a basic authentication again
1231
  - Installed python-pip and pymongo on services.openaire.eu (asked by Sandro La Bruzzo, see Redmine #"1271":https://issue.openaire.research-infrastructures.eu/issues/1271)
1232
May 7, 2015: Enabled an open access to goldoapilot.openaire.eu for NKUA's networks, the rest can see a static page
1233
May 6, 2015: Enabled a basic authentication for goldoapilot.openaire.eu, because it's still not ready for a public access (asked by Natalia)
1234
May 4, 2015: Applied a new logging.properties for 8280 and 8980 on beta.services.openaire.eu (see Redmine #"1289":https://issue.openaire.research-infrastructures.eu/issues/1289)
1235
April 30, 2015: Configured goldoa-pilot.openaire.eu as an alias for goldoapilot.openaire.eu 
1236
April 29, 2015:
1237
  - Antonis Lampesis added to the user aliases POSTGRES_ADMINS and DNET_ADMINS in /etc/sudoers on pilot.services.openaire.eu
1238
  - Configured goldoapilot.openaire.eu domain in DNS and Nginx for it on pilot.services.openaire.eu 
1239
  - Removed unused data folder jenshaarld.aasheim/ on box.openaire.eu (Jens Harald Aasheim changed his username to j.aasheim)
1240
April 28, 2015:
1241
  - Created backup of Joomla 3 on openaire-www.vls (aka new.openaire.eu), asked by Argiro
1242
  - Changed symlinks for the logs of 8280 (/var/log/dnet/is instead of /var/log/tomcat_dnet/8280) and 8980 (/var/log/dnet/provision instead of /var/log/tomcat_dnet/8980) containers on beta.services.openaire.eu and services.openaire.eu (see Redmine #"1289":https://issue.openaire.research-infrastructures.eu/issues/1289)
1243
  - Applied a new logging.properties for 8380 on beta.services.openaire.eu (see Redmine #"1289":https://issue.openaire.research-infrastructures.eu/issues/1289)
1244
April 24, 2015:
1245
  - Created backup of Joomla 3 on openaire-www.vls (aka new.openaire.eu), asked by Argiro
1246
  - Allowed access of new.openaire.eu to 7911 port on beta.services.openaire.eu, asked by Argiro
1247
April 19, 2015: Set log_min_duration_statement = 10000 in /etc/postgresql/9.1/main/postgresql.conf on stats.openaire.eu and beta.stats.openaire.eu
1248
April 17, 2015: Set log_min_duration_statement = 100 in /etc/postgresql/9.1/main/postgresql.conf on stats.openaire.eu and beta.stats.openaire.eu, because postgresql.log was too big because of many logged INSERT statements
1249
April 16, 2015: Created group "joomla" on openaire-www.vls (new.openaire.eu) in order to give NKUA people an access to Apache server logs
1250
April 14, 2015: Increased size of /srv2 partition (MongoDB's objectStore) on beta.services.openaire.eu from 1.5TB to 1.7TB (see Redmine #"1271":https://issue.openaire.research-infrastructures.eu/issues/1271)
1251
April 15, 2015: Deployed ci-test.hadoop.iis.openaire.eu, a new pseudo Hadoop cluster for running IIS integration tests (see Redmine #"781":https://issue.openaire.research-infrastructures.eu/issues/781)
1252
April 3, 2015: Deployed SimpleSAMLphp on new.openaire.eu (see Redmine #"1251":https://issue.openaire.research-infrastructures.eu/issues/1251)
1253
March 30, 2015: Removed unused Nginx proxy rules for /usagestats on furkot2 (asked by Eri)
1254
March 30, 2015: Restored /var/www/templates/yoo_solar/styles/openaire/css/*.css files from a weekly snapshot of the backup (asked by Argiro)
1255
March 30, 2015: Created /var/log/dnet/validator/ directory for the validator logs on openaire-services, openaire-services-beta and openaire-services-pilot (asked by Nikon)
1256
March 26, 2015: Created a new Piwik website for tracking the beta validator (asked by Nikon)
1257
March 25, 2015: Restored Joomla from furkot2 on new.openaire.eu, because it has been damaged by Natalia
1258
March 24, 2015: Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.11.0 to 2.12.0.
1259
March 24, 2015: Moved analytics.openaire.eu to piwik.vls.icm.edu.pl which is running under control of Debian Jessie (Apache 2.4.10 & PHP 5.6.6)
1260
March 24, 2015: Configured a reverse proxy (by Nginx) for La Referencia ("http://lareferencia.openaire.eu/)":http://lareferencia.openaire.eu/)
1261
March 24, 2015: Assisting during the upgrade of the openaire Joomla component on the production and 8380 container on services.openaire.eu (asked by Katerina Iatropoulou).
1262
March 23, 2015: Deployed Tomcat instances for Gold Open Access (see Redmine #"1168":https://issue.openaire.research-infrastructures.eu/issues/1168 and La Referencia (see Redmine #"1138":https://issue.openaire.research-infrastructures.eu/issues/1138), added permissions to Nikon Gasparis for managing PostgreSQL server and Tomcat services on openaire-services-pilot machine
1263
March 20, 2015: Fixed proxy rules for "http://api.openaire.eu/projects/":http://api.openaire.eu/projects/{dspace,eprints,tsv}/ requests, now handled by provision.war container at services.openaire.eu:8980 (see Redmine #"1136":https://issue.openaire.research-infrastructures.eu/issues/1136)
1264
March 17, 2015:
1265
  - Unpacked NKUA's .tar files with ArXiv PDF files (arXiv_pdf_1409_*.tar & arXiv_pdf_141[01]_*.tar)
1266
  - Created README file in /mnt/harvested_pdfs/ on openaire-services
1267
  - Compressed NKUA's .tar files (arXiv_pdf_130[89]_*.tar, arXiv_pdf_1409_*.tar & arXiv_pdf_141[01]_*.tar)
1268
March 9-11, 2015: Investigation on why home page of production portal ("http://www.openaire.eu/)":http://www.openaire.eu/) is so slowly (noticed by Natalia). The reason was a huge k0wx9_sh404sef_urls table of Joomla and long running SELECT queries which needed a few seconds to finish and get hundreds of thousands of records and many mega bytes of data.
1269
March 10, 2015: Configured on beta.openaire.eu a reverse proxy to new separated validator services (/validator, /validator-admin, /validator-service) (asked Nikon Gasparis)
1270
March 10, 2015: Directory /var/www/images/ writable for joomla user on furkot2, openaire-www, openaire-www-{beta,test} (asked Katerina)
1271
March 9, 2015: Created dnet.beta and dnet.production users on IIS Hadoop cluster (asked by Claudio and Marek Horst)
1272
March 9, 2015: Installed advancecomp package (which delivers advpng utility) for PNG optimization on furkot2, openaire-www, openaire-www-{beta,test} (asked Katerina)
1273
March 7, 2015: Increased (to 5GB) quota for najla.rettberg on "http://box.openaire.eu/":http://box.openaire.eu/, removed doubled account Najla.Rettberg
1274
March 6, 2015: Installed optipng & pngcrush packages for PNG optimization on furkot2, openaire-www, openaire-www-{beta,test} (asked Katerina)
1275
March 5, 2015: Deployed a new VM openaire-services-pilot for handling OpenAIRE pilot services, for example LaReferencia (#"1138":https://issue.openaire.research-infrastructures.eu/issues/1138) or Gold Open Access (see Redmine #"1168":https://issue.openaire.research-infrastructures.eu/issues/1168)
1276
March 4, 2015: Stopped PostgreSQL on furkot2, openaire-www, openaire-www-{beta,test}, because it's unused there
1277
March 3, 2015: Deployed a new VM openaire-www for upgrading the portal Joomla to version 3.x (asked by Natalia). It will replaces furkot2 in a few months.
1278
March 3, 2015: Integrated Piwik (analytics.openaire.eu) with guidelines.openaire.eu
1279
March 3, 2015: Configured Piwik (analytics.openaire.eu) for validator.openaire.eu, guidelines.openaire.eu, blogs.openaire.eu and goldpilot.openaire.eu (asked by Natalia)
1280
March 3, 2015: Created /user/dnet.beta and /user/dnet.production directories in DM HDFS (asked by Claudio and Marek Horst)
1281
March 3, 2015: Created backup of /var/www/components/com_openaire/ and /var/www/templates/yoo_solar/ directories on openaire-www-beta and assisting during the upgrade of the openaire Joomla component
1282
March 2, 2015: Created /user/dnet.beta and /user/dnet.production directories in IIS HDFS (asked by Claudio and Marek Horst)
1283
March 2, 2015: Fixed LDAP settings on "http://box.openaire.eu/":http://box.openaire.eu/ broken by Natalia
1284
February 27, 2015: Removed doubled account Natalia.manola on "http://box.openaire.eu/":http://box.openaire.eu/
1285
February 20, 2015: Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.10.0 to 2.11.0.
1286
February 17, 2015: Increased memory from 16GB to 24GB on openaire-solr and openaire-solr-beta machines (see Redmine #"1136":https://issue.openaire.research-infrastructures.eu/issues/1136)
1287
February 16, 2015: Fixing a broken search feature of the portal ("https://www.openaire.eu/search/find)":https://www.openaire.eu/search/find) because of java.lang.OutOfMemoryError on openaire-solr machine with the index (please Redmine issue #"1136":https://issue.openaire.research-infrastructures.eu/issues/1136)
1288
February 11, 2015: Added SSH public key of Andrea Mannocci to authorized_keys of "monkeys" user
1289
February 10, 2015: Deployed OwnCloud instance at "https://box.openaire.eu/":https://box.openaire.eu/ (asked by Natalia)
1290
February 6, 2015: Made /srv/www/joomla/api-docs/ on furkot2 writable for "www-data" group (and "joomla" user) (asked by Natalia who wanted to change CSS)
1291
February 4, 2015: Created accounts on the gateway of DM Hadoop cluster for Sahar Vahdati and Christoph Lange from UBONN (please see Redmine issue #"1089":https://issue.openaire.research-infrastructures.eu/issues/1089).
1292
February 4, 2015: Configured a proxy rule for a new API exporting TSV of projects (please see Redmine issue #"1106":https://issue.openaire.research-infrastructures.eu/issues/1106).
1293
February 2, 2015: Renamed the mailing list openaireplus-wp7@bwnmail.icm.edu.pl to openaire-mining@bwnmail.icm.edu.pl (asked by Mateusz Kobos).
1294
January 30, 2015: Increased size of /srv2 partition (from 2 TB to 2.4 TB) on services.openaire.eu.
1295
January 27, 2015: Increased size of /srv3 partition (from 400 GB to 600 GB) on services.openaire.eu.
1296
January 26, 2015: Increased value of Nginx timeouts on www.openaire.eu (please see Redmine issue #"1079":https://issue.openaire.research-infrastructures.eu/issues/1079).
1297
January 26, 2015: Increased size of /srv partition (from 450 GB to 500 GB) on services.openaire.eu.
1298
January 23, 2015: Increased size of /srv partition (from 400 GB to 450 GB) on services.openaire.eu.
1299
January 23, 2015: Installed xmlstarlet package on services.openaire.eu and beta.services.openaire.eu (asked by Alessia Bardi, please see Redmine issue #"1076":https://issue.openaire.research-infrastructures.eu/issues/1076).
1300
January 22, 2015: Assisting during the upgrade of the openaire Joomla component on the production and 8380 container on services.openaire.eu (asked by Katerina Iatropoulou). Fixed the write permissions to /var/www/joomla/components/com_openaire/ directory for joomla user on beta.openaire.eu.
1301
January 16, 2015: Synchronised test.openaire.eu with the production (asked by Katerina Iatropoulou).
1302
January 14, 2015: Assisting during the upgrade of 8380 container on services.openaire.eu (asked by Katerina Iatropoulou).
1303
January 7, 2015: Upgraded Piwik for OpenAIRE+ ("https://analytics.openaire.eu/)":https://analytics.openaire.eu/) from version 2.9.1 to 2.10.0.