| 2015-07-22 16:39:25 |
Andreas Hasenack |
bug |
|
|
added bug |
| 2015-07-22 16:39:25 |
Andreas Hasenack |
attachment added |
|
landscape-cloud-installer-logs-2015-07-22T16_38_33Z.tar.gz https://bugs.launchpad.net/bugs/1477225/+attachment/4432627/+files/landscape-cloud-installer-logs-2015-07-22T16_38_33Z.tar.gz |
|
| 2015-07-22 16:40:21 |
🤖 Landscape Builder |
tags |
cloud-install-failure kanban |
cloud-install-failure |
|
| 2015-07-22 17:03:58 |
Andreas Hasenack |
attachment added |
|
object-internal-error.tar.xz https://bugs.launchpad.net/landscape/+bug/1477225/+attachment/4432629/+files/object-internal-error.tar.xz |
|
| 2015-07-22 17:40:57 |
Andreas Hasenack |
summary |
Internal server error when uploading to object store (ceph-radosgw) |
ceph-radosgw died during deployment |
|
| 2015-07-22 17:41:03 |
Andreas Hasenack |
information type |
Proprietary |
Public |
|
| 2015-07-22 17:41:48 |
Andreas Hasenack |
affects |
landscape |
ceph-radosgw (Juju Charms Collection) |
|
| 2015-08-05 01:15:37 |
Nobuto Murata |
bug |
|
|
added subscriber Nobuto Murata |
| 2015-08-13 16:16:35 |
Alberto Donato |
attachment added |
|
landscape-openstack-autopilot-logs-2015-08-13T16-03-45Z.tar.gz https://bugs.launchpad.net/charms/+source/ceph-radosgw/+bug/1477225/+attachment/4444240/+files/landscape-openstack-autopilot-logs-2015-08-13T16-03-45Z.tar.gz |
|
| 2015-08-13 16:16:50 |
Alberto Donato |
bug |
|
|
added subscriber Landscape |
| 2015-08-13 16:17:11 |
Alberto Donato |
attachment added |
|
ceph-radosgw log https://bugs.launchpad.net/charms/+source/ceph-radosgw/+bug/1477225/+attachment/4444246/+files/radosgw.log |
|
| 2015-08-17 06:57:50 |
Nobuto Murata |
tags |
cloud-install-failure |
cloud-install-failure cpec |
|
| 2015-08-17 07:30:32 |
Lei Wang |
bug |
|
|
added subscriber Ray Wang |
| 2015-09-01 15:09:30 |
Liam Young |
bug task added |
|
ceph-radosgw (Ubuntu) |
|
| 2015-09-01 15:09:48 |
Liam Young |
ceph-radosgw (Juju Charms Collection): status |
New |
Invalid |
|
| 2015-09-01 15:18:32 |
Liam Young |
summary |
ceph-radosgw died during deployment |
ceph-radosgw restart fails |
|
| 2015-09-02 09:43:44 |
Launchpad Janitor |
ceph (Ubuntu): status |
New |
Confirmed |
|
| 2015-09-02 09:43:44 |
Liam Young |
affects |
ceph-radosgw (Ubuntu) |
ceph (Ubuntu) |
|
| 2015-09-02 09:43:58 |
Liam Young |
ceph (Ubuntu): status |
New |
Confirmed |
|
| 2015-09-02 10:31:16 |
Liam Young |
description |
job handler:
Jul 22 16:03:44 job-handler-1 ERR Failed to execute job: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'#012Traceback (most recent call last):#012 File "/opt/canonical/landscape/canonical/landscape/model/activity/jobrunner.py", line 38, in run#012 yield self._run_activity(account_id, activity_id)#012HTTPError: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'
Other logs attached. |
[Impact]
On 14.04 the restart target of the sysvinit script brings the service down
but almost always fails to bring the service back up again.
The proposed fix updates /etc/init.d/radosgw and so that the stop target
waits for up to 30 seconds for the service to stop cleanly
[Test Case]
sudo apt-get install --yes radosgw
sudo mkdir /etc/ceph
cat <<-EOF > /etc/ceph/ceph.conf
[global]
auth cluster required = cephx
auth service required = cephx
auth client required = cephx
mon host = 127.0.0.1:6789
[client.radosgw.gateway]
host = $(hostname -s)
keyring = /etc/ceph/keyring.rados.gateway
rgw socket path = /tmp/radosgw.sock
log file = /var/log/ceph/radosgw.log
rgw frontends = civetweb port=70
EOF
cat <<-EOF > /etc/ceph/keyring.rados.gateway
[client.radosgw.gateway]
key = BBBBBBBBBBBBBBBBB/kkkkkkkkkkkkkkkkkkkk==
EOF
service radosgw stop
service radosgw start
service radosgw status
service radosgw restart
service radosgw status
At this point /usr/bin/radosgw will no be running
[Regression Potential]
* The only change in behaviour that would result from this change is that
running the stop target in the init script will wait for up to 30s before
exiting rather than retuning immediatly. I cannot think of any use cases
where this would be an issue.
[Original Bug Report]
job handler:
Jul 22 16:03:44 job-handler-1 ERR Failed to execute job: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'#012Traceback (most recent call last):#012 File "/opt/canonical/landscape/canonical/landscape/model/activity/jobrunner.py", line 38, in run#012 yield self._run_activity(account_id, activity_id)#012HTTPError: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'
Other logs attached. |
|
| 2015-09-02 10:31:40 |
Liam Young |
description |
[Impact]
On 14.04 the restart target of the sysvinit script brings the service down
but almost always fails to bring the service back up again.
The proposed fix updates /etc/init.d/radosgw and so that the stop target
waits for up to 30 seconds for the service to stop cleanly
[Test Case]
sudo apt-get install --yes radosgw
sudo mkdir /etc/ceph
cat <<-EOF > /etc/ceph/ceph.conf
[global]
auth cluster required = cephx
auth service required = cephx
auth client required = cephx
mon host = 127.0.0.1:6789
[client.radosgw.gateway]
host = $(hostname -s)
keyring = /etc/ceph/keyring.rados.gateway
rgw socket path = /tmp/radosgw.sock
log file = /var/log/ceph/radosgw.log
rgw frontends = civetweb port=70
EOF
cat <<-EOF > /etc/ceph/keyring.rados.gateway
[client.radosgw.gateway]
key = BBBBBBBBBBBBBBBBB/kkkkkkkkkkkkkkkkkkkk==
EOF
service radosgw stop
service radosgw start
service radosgw status
service radosgw restart
service radosgw status
At this point /usr/bin/radosgw will no be running
[Regression Potential]
* The only change in behaviour that would result from this change is that
running the stop target in the init script will wait for up to 30s before
exiting rather than retuning immediatly. I cannot think of any use cases
where this would be an issue.
[Original Bug Report]
job handler:
Jul 22 16:03:44 job-handler-1 ERR Failed to execute job: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'#012Traceback (most recent call last):#012 File "/opt/canonical/landscape/canonical/landscape/model/activity/jobrunner.py", line 38, in run#012 yield self._run_activity(account_id, activity_id)#012HTTPError: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'
Other logs attached. |
[Impact]
On 14.04 the restart target of the sysvinit script brings the service down
but almost always fails to bring the service back up again.
The proposed fix updates /etc/init.d/radosgw so that the stop target
waits for up to 30 seconds for the service to stop cleanly
[Test Case]
sudo apt-get install --yes radosgw
sudo mkdir /etc/ceph
cat <<-EOF > /etc/ceph/ceph.conf
[global]
auth cluster required = cephx
auth service required = cephx
auth client required = cephx
mon host = 127.0.0.1:6789
[client.radosgw.gateway]
host = $(hostname -s)
keyring = /etc/ceph/keyring.rados.gateway
rgw socket path = /tmp/radosgw.sock
log file = /var/log/ceph/radosgw.log
rgw frontends = civetweb port=70
EOF
cat <<-EOF > /etc/ceph/keyring.rados.gateway
[client.radosgw.gateway]
key = BBBBBBBBBBBBBBBBB/kkkkkkkkkkkkkkkkkkkk==
EOF
service radosgw stop
service radosgw start
service radosgw status
service radosgw restart
service radosgw status
At this point /usr/bin/radosgw will no be running
[Regression Potential]
* The only change in behaviour that would result from this change is that
running the stop target in the init script will wait for up to 30s before
exiting rather than retuning immediatly. I cannot think of any use cases
where this would be an issue.
[Original Bug Report]
job handler:
Jul 22 16:03:44 job-handler-1 ERR Failed to execute job: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'#012Traceback (most recent call last):#012 File "/opt/canonical/landscape/canonical/landscape/model/activity/jobrunner.py", line 38, in run#012 yield self._run_activity(account_id, activity_id)#012HTTPError: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'
Other logs attached. |
|
| 2015-09-02 10:32:40 |
Liam Young |
description |
[Impact]
On 14.04 the restart target of the sysvinit script brings the service down
but almost always fails to bring the service back up again.
The proposed fix updates /etc/init.d/radosgw so that the stop target
waits for up to 30 seconds for the service to stop cleanly
[Test Case]
sudo apt-get install --yes radosgw
sudo mkdir /etc/ceph
cat <<-EOF > /etc/ceph/ceph.conf
[global]
auth cluster required = cephx
auth service required = cephx
auth client required = cephx
mon host = 127.0.0.1:6789
[client.radosgw.gateway]
host = $(hostname -s)
keyring = /etc/ceph/keyring.rados.gateway
rgw socket path = /tmp/radosgw.sock
log file = /var/log/ceph/radosgw.log
rgw frontends = civetweb port=70
EOF
cat <<-EOF > /etc/ceph/keyring.rados.gateway
[client.radosgw.gateway]
key = BBBBBBBBBBBBBBBBB/kkkkkkkkkkkkkkkkkkkk==
EOF
service radosgw stop
service radosgw start
service radosgw status
service radosgw restart
service radosgw status
At this point /usr/bin/radosgw will no be running
[Regression Potential]
* The only change in behaviour that would result from this change is that
running the stop target in the init script will wait for up to 30s before
exiting rather than retuning immediatly. I cannot think of any use cases
where this would be an issue.
[Original Bug Report]
job handler:
Jul 22 16:03:44 job-handler-1 ERR Failed to execute job: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'#012Traceback (most recent call last):#012 File "/opt/canonical/landscape/canonical/landscape/model/activity/jobrunner.py", line 38, in run#012 yield self._run_activity(account_id, activity_id)#012HTTPError: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'
Other logs attached. |
[Impact]
On 14.04 the restart target of the sysvinit script brings the service down
but almost always fails to bring the service back up again.
The proposed fix updates /etc/init.d/radosgw so that the stop target
waits for up to 30 seconds for the service to stop cleanly
[Test Case]
sudo apt-get install --yes radosgw
sudo mkdir /etc/ceph
sudo su -
cat <<-EOF > /etc/ceph/ceph.conf
[global]
auth cluster required = cephx
auth service required = cephx
auth client required = cephx
mon host = 127.0.0.1:6789
[client.radosgw.gateway]
host = $(hostname -s)
keyring = /etc/ceph/keyring.rados.gateway
rgw socket path = /tmp/radosgw.sock
log file = /var/log/ceph/radosgw.log
rgw frontends = civetweb port=70
EOF
cat <<-EOF > /etc/ceph/keyring.rados.gateway
[client.radosgw.gateway]
key = BBBBBBBBBBBBBBBBB/kkkkkkkkkkkkkkkkkkkk==
EOF
service radosgw stop
service radosgw start
service radosgw status
service radosgw restart
service radosgw status
At this point /usr/bin/radosgw will no be running
[Regression Potential]
* The only change in behaviour that would result from this change is that
running the stop target in the init script will wait for up to 30s before
exiting rather than retuning immediatly. I cannot think of any use cases
where this would be an issue.
[Original Bug Report]
job handler:
Jul 22 16:03:44 job-handler-1 ERR Failed to execute job: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'#012Traceback (most recent call last):#012 File "/opt/canonical/landscape/canonical/landscape/model/activity/jobrunner.py", line 38, in run#012 yield self._run_activity(account_id, activity_id)#012HTTPError: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'
Other logs attached. |
|
| 2015-09-04 09:00:57 |
James Page |
nominated for series |
|
Ubuntu Trusty |
|
| 2015-09-04 09:00:57 |
James Page |
bug task added |
|
ceph (Ubuntu Trusty) |
|
| 2015-09-04 09:00:57 |
James Page |
nominated for series |
|
Ubuntu Wily |
|
| 2015-09-04 09:00:57 |
James Page |
bug task added |
|
ceph (Ubuntu Wily) |
|
| 2015-09-04 09:01:10 |
James Page |
ceph (Ubuntu Wily): status |
Confirmed |
Fix Released |
|
| 2015-09-04 09:01:12 |
James Page |
ceph (Ubuntu Trusty): status |
New |
Triaged |
|
| 2015-09-04 09:01:14 |
James Page |
ceph (Ubuntu Trusty): importance |
Undecided |
High |
|
| 2015-09-04 09:01:16 |
James Page |
ceph (Ubuntu Wily): importance |
Undecided |
High |
|
| 2015-09-04 13:39:52 |
Liam Young |
description |
[Impact]
On 14.04 the restart target of the sysvinit script brings the service down
but almost always fails to bring the service back up again.
The proposed fix updates /etc/init.d/radosgw so that the stop target
waits for up to 30 seconds for the service to stop cleanly
[Test Case]
sudo apt-get install --yes radosgw
sudo mkdir /etc/ceph
sudo su -
cat <<-EOF > /etc/ceph/ceph.conf
[global]
auth cluster required = cephx
auth service required = cephx
auth client required = cephx
mon host = 127.0.0.1:6789
[client.radosgw.gateway]
host = $(hostname -s)
keyring = /etc/ceph/keyring.rados.gateway
rgw socket path = /tmp/radosgw.sock
log file = /var/log/ceph/radosgw.log
rgw frontends = civetweb port=70
EOF
cat <<-EOF > /etc/ceph/keyring.rados.gateway
[client.radosgw.gateway]
key = BBBBBBBBBBBBBBBBB/kkkkkkkkkkkkkkkkkkkk==
EOF
service radosgw stop
service radosgw start
service radosgw status
service radosgw restart
service radosgw status
At this point /usr/bin/radosgw will no be running
[Regression Potential]
* The only change in behaviour that would result from this change is that
running the stop target in the init script will wait for up to 30s before
exiting rather than retuning immediatly. I cannot think of any use cases
where this would be an issue.
[Original Bug Report]
job handler:
Jul 22 16:03:44 job-handler-1 ERR Failed to execute job: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'#012Traceback (most recent call last):#012 File "/opt/canonical/landscape/canonical/landscape/model/activity/jobrunner.py", line 38, in run#012 yield self._run_activity(account_id, activity_id)#012HTTPError: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'
Other logs attached. |
[Impact]
On 14.04 the restart target of the sysvinit script brings the service down
but sometimes fails to bring the service back up again. There is a race between stop and start and in the failure case the attempt to bring the service up runs before the service has been stopped and the start command is never issued:
The proposed fix updates /etc/init.d/radosgw so that the stop target
waits for up to 30 seconds for the service to stop cleanly
[Test Case]
Bundle:
openstack-services:
services:
mysql:
branch: lp:~openstack-charmers/charms/trusty/percona-cluster/next
constraints: mem=1G
options:
dataset-size: 50%
ceph:
branch: lp:~openstack-charmers/charms/trusty/ceph/next
num_units: 3
constraints: mem=1G
options:
monitor-count: 3
fsid: 6547bd3e-1397-11e2-82e5-53567c8d32dc
monitor-secret: AQCXrnZQwI7KGBAAiPofmKEXKxu5bUzoYLVkbQ==
osd-devices: /dev/vdb
osd-reformat: "yes"
ephemeral-unmount: /mnt
keystone:
branch: lp:~openstack-charmers/charms/trusty/keystone/next
constraints: mem=1G
options:
admin-password: openstack
admin-token: ubuntutesting
ceph-radosgw:
branch: lp:~openstack-charmers/charms/trusty/ceph-radosgw/next
options:
use-embedded-webserver: True
relations:
- [ keystone, mysql ]
- [ ceph-radosgw, keystone ]
- [ ceph-radosgw, ceph ]
# kilo
trusty-kilo:
inherits: openstack-services
series: trusty
overrides:
openstack-origin: cloud:trusty-kilo
source: cloud:trusty-kilo
$ juju-deployer -c next.yaml trusty-kilo
$ juju ssh ceph-radosgw/0
$ sudo su -
# service radosgw status
/usr/bin/radosgw is running.
# service radosgw restart
Starting client.radosgw.gateway...
/usr/bin/radosgw already running.
/usr/bin/radosgw is running.
# service radosgw status
/usr/bin/radosgw is not running.
[Regression Potential]
* The only change in behaviour that would result from this change is that
running the stop target in the init script will wait for up to 30s before
exiting rather than retuning immediatly. I cannot think of any use cases
where this would be an issue.
[Original Bug Report]
job handler:
Jul 22 16:03:44 job-handler-1 ERR Failed to execute job: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'#012Traceback (most recent call last):#012 File "/opt/canonical/landscape/canonical/landscape/model/activity/jobrunner.py", line 38, in run#012 yield self._run_activity(account_id, activity_id)#012HTTPError: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'
Other logs attached. |
|
| 2015-09-04 13:55:27 |
Liam Young |
description |
[Impact]
On 14.04 the restart target of the sysvinit script brings the service down
but sometimes fails to bring the service back up again. There is a race between stop and start and in the failure case the attempt to bring the service up runs before the service has been stopped and the start command is never issued:
The proposed fix updates /etc/init.d/radosgw so that the stop target
waits for up to 30 seconds for the service to stop cleanly
[Test Case]
Bundle:
openstack-services:
services:
mysql:
branch: lp:~openstack-charmers/charms/trusty/percona-cluster/next
constraints: mem=1G
options:
dataset-size: 50%
ceph:
branch: lp:~openstack-charmers/charms/trusty/ceph/next
num_units: 3
constraints: mem=1G
options:
monitor-count: 3
fsid: 6547bd3e-1397-11e2-82e5-53567c8d32dc
monitor-secret: AQCXrnZQwI7KGBAAiPofmKEXKxu5bUzoYLVkbQ==
osd-devices: /dev/vdb
osd-reformat: "yes"
ephemeral-unmount: /mnt
keystone:
branch: lp:~openstack-charmers/charms/trusty/keystone/next
constraints: mem=1G
options:
admin-password: openstack
admin-token: ubuntutesting
ceph-radosgw:
branch: lp:~openstack-charmers/charms/trusty/ceph-radosgw/next
options:
use-embedded-webserver: True
relations:
- [ keystone, mysql ]
- [ ceph-radosgw, keystone ]
- [ ceph-radosgw, ceph ]
# kilo
trusty-kilo:
inherits: openstack-services
series: trusty
overrides:
openstack-origin: cloud:trusty-kilo
source: cloud:trusty-kilo
$ juju-deployer -c next.yaml trusty-kilo
$ juju ssh ceph-radosgw/0
$ sudo su -
# service radosgw status
/usr/bin/radosgw is running.
# service radosgw restart
Starting client.radosgw.gateway...
/usr/bin/radosgw already running.
/usr/bin/radosgw is running.
# service radosgw status
/usr/bin/radosgw is not running.
[Regression Potential]
* The only change in behaviour that would result from this change is that
running the stop target in the init script will wait for up to 30s before
exiting rather than retuning immediatly. I cannot think of any use cases
where this would be an issue.
[Original Bug Report]
job handler:
Jul 22 16:03:44 job-handler-1 ERR Failed to execute job: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'#012Traceback (most recent call last):#012 File "/opt/canonical/landscape/canonical/landscape/model/activity/jobrunner.py", line 38, in run#012 yield self._run_activity(account_id, activity_id)#012HTTPError: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'
Other logs attached. |
[Impact]
On 14.04 the restart target of the sysvinit script brings the service down
but sometimes fails to bring the service back up again. There is a race between stop and start and in the failure case the attempt to bring the service up runs before the service has been stopped and the start command is never issued:
The proposed fix updates /etc/init.d/radosgw so that the stop target
waits for up to 30 seconds for the service to stop cleanly
[Test Case]
Bundle:
openstack-services:
services:
mysql:
branch: lp:~openstack-charmers/charms/trusty/percona-cluster/next
constraints: mem=1G
options:
dataset-size: 50%
ceph:
branch: lp:~openstack-charmers/charms/trusty/ceph/next
num_units: 3
constraints: mem=1G
options:
monitor-count: 3
fsid: 6547bd3e-1397-11e2-82e5-53567c8d32dc
monitor-secret: AQCXrnZQwI7KGBAAiPofmKEXKxu5bUzoYLVkbQ==
osd-devices: /dev/vdb
osd-reformat: "yes"
ephemeral-unmount: /mnt
keystone:
branch: lp:~openstack-charmers/charms/trusty/keystone/next
constraints: mem=1G
options:
admin-password: openstack
admin-token: ubuntutesting
ceph-radosgw:
branch: lp:~openstack-charmers/charms/trusty/ceph-radosgw/next
options:
use-embedded-webserver: True
relations:
- [ keystone, mysql ]
- [ ceph-radosgw, keystone ]
- [ ceph-radosgw, ceph ]
# kilo
trusty-kilo:
inherits: openstack-services
series: trusty
overrides:
openstack-origin: cloud:trusty-kilo
source: cloud:trusty-kilo
trusty-icehouse:
inherits: openstack-services
series: trusty
$ juju-deployer -c next.yaml trusty-icehouse
$ juju ssh ceph-radosgw/0
$ sudo su -
# service radosgw status
/usr/bin/radosgw is running.
# service radosgw restart
Starting client.radosgw.gateway...
/usr/bin/radosgw already running.
/usr/bin/radosgw is running.
# service radosgw status
/usr/bin/radosgw is not running.
# apt-cache policy radosgw
radosgw:
Installed: 0.80.10-0ubuntu0.14.04.1
Candidate: 0.80.10-0ubuntu0.14.04.1
Version table:
*** 0.80.10-0ubuntu0.14.04.1 0
500 http://nova.clouds.archive.ubuntu.com/ubuntu/ trusty-updates/main amd64 Packages
100 /var/lib/dpkg/status
0.79-0ubuntu1 0
500 http://nova.clouds.archive.ubuntu.com/ubuntu/ trusty/main amd64 Packages
root@juju-lytrusty-machine-4:~#
[Regression Potential]
* The only change in behaviour that would result from this change is that
running the stop target in the init script will wait for up to 30s before
exiting rather than retuning immediatly. I cannot think of any use cases
where this would be an issue.
[Original Bug Report]
job handler:
Jul 22 16:03:44 job-handler-1 ERR Failed to execute job: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'#012Traceback (most recent call last):#012 File "/opt/canonical/landscape/canonical/landscape/model/activity/jobrunner.py", line 38, in run#012 yield self._run_activity(account_id, activity_id)#012HTTPError: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'
Other logs attached. |
|
| 2015-09-07 10:00:51 |
Liam Young |
description |
[Impact]
On 14.04 the restart target of the sysvinit script brings the service down
but sometimes fails to bring the service back up again. There is a race between stop and start and in the failure case the attempt to bring the service up runs before the service has been stopped and the start command is never issued:
The proposed fix updates /etc/init.d/radosgw so that the stop target
waits for up to 30 seconds for the service to stop cleanly
[Test Case]
Bundle:
openstack-services:
services:
mysql:
branch: lp:~openstack-charmers/charms/trusty/percona-cluster/next
constraints: mem=1G
options:
dataset-size: 50%
ceph:
branch: lp:~openstack-charmers/charms/trusty/ceph/next
num_units: 3
constraints: mem=1G
options:
monitor-count: 3
fsid: 6547bd3e-1397-11e2-82e5-53567c8d32dc
monitor-secret: AQCXrnZQwI7KGBAAiPofmKEXKxu5bUzoYLVkbQ==
osd-devices: /dev/vdb
osd-reformat: "yes"
ephemeral-unmount: /mnt
keystone:
branch: lp:~openstack-charmers/charms/trusty/keystone/next
constraints: mem=1G
options:
admin-password: openstack
admin-token: ubuntutesting
ceph-radosgw:
branch: lp:~openstack-charmers/charms/trusty/ceph-radosgw/next
options:
use-embedded-webserver: True
relations:
- [ keystone, mysql ]
- [ ceph-radosgw, keystone ]
- [ ceph-radosgw, ceph ]
# kilo
trusty-kilo:
inherits: openstack-services
series: trusty
overrides:
openstack-origin: cloud:trusty-kilo
source: cloud:trusty-kilo
trusty-icehouse:
inherits: openstack-services
series: trusty
$ juju-deployer -c next.yaml trusty-icehouse
$ juju ssh ceph-radosgw/0
$ sudo su -
# service radosgw status
/usr/bin/radosgw is running.
# service radosgw restart
Starting client.radosgw.gateway...
/usr/bin/radosgw already running.
/usr/bin/radosgw is running.
# service radosgw status
/usr/bin/radosgw is not running.
# apt-cache policy radosgw
radosgw:
Installed: 0.80.10-0ubuntu0.14.04.1
Candidate: 0.80.10-0ubuntu0.14.04.1
Version table:
*** 0.80.10-0ubuntu0.14.04.1 0
500 http://nova.clouds.archive.ubuntu.com/ubuntu/ trusty-updates/main amd64 Packages
100 /var/lib/dpkg/status
0.79-0ubuntu1 0
500 http://nova.clouds.archive.ubuntu.com/ubuntu/ trusty/main amd64 Packages
root@juju-lytrusty-machine-4:~#
[Regression Potential]
* The only change in behaviour that would result from this change is that
running the stop target in the init script will wait for up to 30s before
exiting rather than retuning immediatly. I cannot think of any use cases
where this would be an issue.
[Original Bug Report]
job handler:
Jul 22 16:03:44 job-handler-1 ERR Failed to execute job: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'#012Traceback (most recent call last):#012 File "/opt/canonical/landscape/canonical/landscape/model/activity/jobrunner.py", line 38, in run#012 yield self._run_activity(account_id, activity_id)#012HTTPError: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'
Other logs attached. |
Upstream Bug: http://tracker.ceph.com/issues/11140
[Impact]
On 14.04 the restart target of the sysvinit script brings the service down
but sometimes fails to bring the service back up again. There is a race between stop and start and in the failure case the attempt to bring the service up runs before the service has been stopped and the start command is never issued:
The proposed fix updates /etc/init.d/radosgw so that the stop target
waits for up to 30 seconds for the service to stop cleanly
[Test Case]
Bundle:
openstack-services:
services:
mysql:
branch: lp:~openstack-charmers/charms/trusty/percona-cluster/next
constraints: mem=1G
options:
dataset-size: 50%
ceph:
branch: lp:~openstack-charmers/charms/trusty/ceph/next
num_units: 3
constraints: mem=1G
options:
monitor-count: 3
fsid: 6547bd3e-1397-11e2-82e5-53567c8d32dc
monitor-secret: AQCXrnZQwI7KGBAAiPofmKEXKxu5bUzoYLVkbQ==
osd-devices: /dev/vdb
osd-reformat: "yes"
ephemeral-unmount: /mnt
keystone:
branch: lp:~openstack-charmers/charms/trusty/keystone/next
constraints: mem=1G
options:
admin-password: openstack
admin-token: ubuntutesting
ceph-radosgw:
branch: lp:~openstack-charmers/charms/trusty/ceph-radosgw/next
options:
use-embedded-webserver: True
relations:
- [ keystone, mysql ]
- [ ceph-radosgw, keystone ]
- [ ceph-radosgw, ceph ]
# kilo
trusty-kilo:
inherits: openstack-services
series: trusty
overrides:
openstack-origin: cloud:trusty-kilo
source: cloud:trusty-kilo
trusty-icehouse:
inherits: openstack-services
series: trusty
$ juju-deployer -c next.yaml trusty-icehouse
$ juju ssh ceph-radosgw/0
$ sudo su -
# service radosgw status
/usr/bin/radosgw is running.
# service radosgw restart
Starting client.radosgw.gateway...
/usr/bin/radosgw already running.
/usr/bin/radosgw is running.
# service radosgw status
/usr/bin/radosgw is not running.
# apt-cache policy radosgw
radosgw:
Installed: 0.80.10-0ubuntu0.14.04.1
Candidate: 0.80.10-0ubuntu0.14.04.1
Version table:
*** 0.80.10-0ubuntu0.14.04.1 0
500 http://nova.clouds.archive.ubuntu.com/ubuntu/ trusty-updates/main amd64 Packages
100 /var/lib/dpkg/status
0.79-0ubuntu1 0
500 http://nova.clouds.archive.ubuntu.com/ubuntu/ trusty/main amd64 Packages
root@juju-lytrusty-machine-4:~#
[Regression Potential]
* The only change in behaviour that would result from this change is that
running the stop target in the init script will wait for up to 30s before
exiting rather than retuning immediatly. I cannot think of any use cases
where this would be an issue.
[Original Bug Report]
job handler:
Jul 22 16:03:44 job-handler-1 ERR Failed to execute job: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'#012Traceback (most recent call last):#012 File "/opt/canonical/landscape/canonical/landscape/model/activity/jobrunner.py", line 38, in run#012 yield self._run_activity(account_id, activity_id)#012HTTPError: PUT request for http://10.96.4.129:80/swift/v1/simplestreams failed with code 500 Internal Server Error: '<!DOCTYPE HTML PUBLIC "-//IETF//DTD HTML 2.0//EN">\n<html><head>\n<title>500 Internal Server Error</title>\n</head><body>\n<h1>Internal Server Error</h1>\n<p>The server encountered an internal error or\nmisconfiguration and was unable to complete\nyour request.</p>\n<p>Please contact the server administrator at \n ceph@ubuntu.com to inform them of the time this error occurred,\n and the actions you performed just before this error.</p>\n<p>More information about this error may be available\nin the server error log.</p>\n</body></html>\n'
Other logs attached. |
|
| 2015-09-07 11:26:58 |
James Page |
ceph (Ubuntu Wily): status |
Fix Released |
Triaged |
|
| 2015-09-07 11:27:02 |
James Page |
nominated for series |
|
Ubuntu Vivid |
|
| 2015-09-07 11:27:02 |
James Page |
bug task added |
|
ceph (Ubuntu Vivid) |
|
| 2015-09-07 11:27:10 |
James Page |
ceph (Ubuntu Vivid): status |
New |
Triaged |
|
| 2015-09-07 11:27:13 |
James Page |
ceph (Ubuntu Vivid): importance |
Undecided |
High |
|
| 2015-09-07 12:29:54 |
Launchpad Janitor |
branch linked |
|
lp:~gnuoy/ubuntu/trusty/ceph/1477225 |
|
| 2015-09-07 12:36:59 |
Liam Young |
branch unlinked |
lp:~gnuoy/ubuntu/trusty/ceph/1477225 |
|
|
| 2015-09-07 12:42:01 |
Liam Young |
branch linked |
|
lp:~gnuoy/ubuntu/trusty/ceph/1477225 |
|
| 2015-09-07 13:30:57 |
Launchpad Janitor |
branch linked |
|
lp:ubuntu/wily-proposed/ceph |
|
| 2015-09-07 13:45:03 |
James Page |
ceph (Ubuntu Wily): assignee |
|
James Page (james-page) |
|
| 2015-09-07 13:45:05 |
James Page |
ceph (Ubuntu Vivid): assignee |
|
James Page (james-page) |
|
| 2015-09-07 13:45:12 |
James Page |
ceph (Ubuntu Trusty): assignee |
|
Liam Young (gnuoy) |
|
| 2015-09-07 13:45:15 |
James Page |
ceph (Ubuntu Trusty): status |
Triaged |
In Progress |
|
| 2015-09-07 13:45:17 |
James Page |
ceph (Ubuntu Vivid): status |
Triaged |
In Progress |
|
| 2015-09-07 13:45:19 |
James Page |
ceph (Ubuntu Wily): status |
Triaged |
In Progress |
|
| 2015-09-07 14:55:54 |
James Page |
bug |
|
|
added subscriber Ubuntu Stable Release Updates Team |
| 2015-09-08 07:25:10 |
Launchpad Janitor |
ceph (Ubuntu Wily): status |
In Progress |
Fix Released |
|
| 2015-09-08 08:31:15 |
Free Ekanayaka |
tags |
cloud-install-failure cpec |
cloud-install-failure cpec landscape-release-29 |
|
| 2015-10-01 17:44:25 |
Brian Murray |
ceph (Ubuntu Vivid): status |
In Progress |
Fix Committed |
|
| 2015-10-01 17:44:29 |
Brian Murray |
bug |
|
|
added subscriber SRU Verification |
| 2015-10-01 17:44:34 |
Brian Murray |
tags |
cloud-install-failure cpec landscape-release-29 |
cloud-install-failure cpec landscape-release-29 verification-needed |
|
| 2015-10-02 05:09:16 |
David Britton |
tags |
cloud-install-failure cpec landscape-release-29 verification-needed |
cloud-install-failure cpec kanban-cross-team landscape-release-29 verification-needed |
|
| 2015-10-07 14:44:17 |
David Britton |
tags |
cloud-install-failure cpec kanban-cross-team landscape-release-29 verification-needed |
cloud-install-failure cpec kanban-cross-team verification-needed |
|
| 2015-10-07 15:16:40 |
Chris J Arges |
ceph (Ubuntu Trusty): status |
In Progress |
Fix Committed |
|
| 2015-10-07 15:19:51 |
Chris J Arges |
ceph (Ubuntu Vivid): status |
Fix Committed |
Fix Released |
|
| 2015-10-22 06:01:07 |
James Page |
ceph (Ubuntu Vivid): status |
Fix Released |
Fix Committed |
|
| 2015-10-22 06:12:59 |
Ryan Beisner |
bug |
|
|
added subscriber Ryan Beisner |
| 2015-11-04 10:43:02 |
James Page |
tags |
cloud-install-failure cpec kanban-cross-team verification-needed |
cloud-install-failure cpec kanban-cross-team verification-done verification-needed-vivid |
|
| 2015-11-04 10:57:06 |
James Page |
tags |
cloud-install-failure cpec kanban-cross-team verification-done verification-needed-vivid |
cloud-install-failure cpec kanban-cross-team verification-done |
|
| 2015-11-04 15:20:51 |
Mathew Hodson |
bug |
|
|
added subscriber Mathew Hodson |
| 2015-11-04 16:31:57 |
Launchpad Janitor |
ceph (Ubuntu Trusty): status |
Fix Committed |
Fix Released |
|
| 2015-11-04 16:32:06 |
Chris J Arges |
removed subscriber Ubuntu Stable Release Updates Team |
|
|
|
| 2015-11-04 16:44:36 |
Launchpad Janitor |
ceph (Ubuntu Vivid): status |
Fix Committed |
Fix Released |
|
| 2015-11-04 16:50:33 |
Mathew Hodson |
removed subscriber Mathew Hodson |
|
|
|
| 2015-11-04 16:52:31 |
Mathew Hodson |
affects |
ceph-radosgw (Juju Charms Collection) |
ubuntu-translations |
|
| 2015-11-04 16:53:06 |
Mathew Hodson |
bug task deleted |
ubuntu-translations |
|
|
