Glance-API and Glance-Registry Continuously Reload

[Byron McCollum]

1) Release

Ubuntu 12.10 Server

2) Package Version

2012.2+git201207261602~quantal-0ubuntu1 (via ppa:openstack-ubuntu-testing/folsom-trunk-testing)

3) Expected

$ pgrep -l glance
1111 glance-api
2222 glance-registry
$ pgrep -l glance
1111 glance-api
2222 glance-registry
$ pgrep -l glance
1111 glance-api
2222 glance-registry

4) Happened Instead

$ pgrep -l glance
1111 glance-api
2222 glance-registry
$ pgrep -l glance
3333 glance-api
4444 glance-registry
$ pgrep -l glance
5555 glance-api
6666 glance-registry
$ sudo tail /var/log/glance/api.log
2012-07-27 19:46:58 DEBUG glance.common.config [-] Loading glance-api-keystone from /etc/glance/glance-api-paste.ini from (pid=8082) load_paste_app /usr/lib/python2.7/dist-packages/glance/common/config.py:174
2012-07-27 19:46:59 DEBUG glance.common.config [-] Loading glance-api-keystone from /etc/glance/glance-api-paste.ini from (pid=8094) load_paste_app /usr/lib/python2.7/dist-packages/glance/common/config.py:174
2012-07-27 19:47:00 DEBUG glance.common.config [-] Loading glance-api-keystone from /etc/glance/glance-api-paste.ini from (pid=8106) load_paste_app /usr/lib/python2.7/dist-packages/glance/common/config.py:174
2012-07-27 19:47:01 DEBUG glance.common.config [-] Loading glance-api-keystone from /etc/glance/glance-api-paste.ini from (pid=8118) load_paste_app /usr/lib/python2.7/dist-packages/glance/common/config.py:174
2012-07-27 19:47:02 DEBUG glance.common.config [-] Loading glance-api-keystone from /etc/glance/glance-api-paste.ini from (pid=8130) load_paste_app /usr/lib/python2.7/dist-packages/glance/common/config.py:174
$ sudo tail /var/log/glance/registry.log
2012-07-27 19:47:36 DEBUG glance.common.config [-] Loading glance-registry-keystone from /etc/glance/glance-registry-paste.ini from (pid=8625) load_paste_app /usr/lib/python2.7/dist-packages/glance/common/config.py:174
2012-07-27 19:47:37 DEBUG glance.common.config [-] Loading glance-registry-keystone from /etc/glance/glance-registry-paste.ini from (pid=8638) load_paste_app /usr/lib/python2.7/dist-packages/glance/common/config.py:174
2012-07-27 19:47:38 DEBUG glance.common.config [-] Loading glance-registry-keystone from /etc/glance/glance-registry-paste.ini from (pid=8650) load_paste_app /usr/lib/python2.7/dist-packages/glance/common/config.py:174
2012-07-27 19:47:38 DEBUG glance.common.config [-] Loading glance-registry-keystone from /etc/glance/glance-registry-paste.ini from (pid=8663) load_paste_app /usr/lib/python2.7/dist-packages/glance/common/config.py:174
2012-07-27 19:47:39 DEBUG glance.common.config [-] Loading glance-registry-keystone from /etc/glance/glance-registry-paste.ini from (pid=8675) load_paste_app /usr/lib/python2.7/dist-packages/glance/common/config.py:174

[Adam Gandelman (gandelman-a)]

Having a tough time reproducing this.. I've tried on multiple version releases of 12.10, multiple architectures and tried with using the main archive (instead of PPA) to resolve dependencies with older library versions. In all cases, both servers stay up as expected. Any chance you can debug futher by upping the log verbosity, running the servers manually to see if they crash, manually as the glance user, manually using strace? Thanks.

[Byron McCollum (byron-mccollum)]

Sorry...forgot to document the configuration changes I made. This seems to work on Precise, but kills Quantal.

# Create Services Tenant, and Glance Service User
SERVICE_TENANT_ID=`keystone tenant-create --name Services | awk '/ id / { print $4 }'`
ADMIN_ROLE_ID=`keystone role-create --name admin | awk '/ id / { print $4 }'`
GLANCE_USER_ID=`keystone user-create --tenant-id $SERVICE_TENANT_ID --name glance --pass glance | awk '/ id / { print $4 }'`
keystone user-role-add --user-id $GLANCE_USER_ID --tenant-id $SERVICE_TENANT_ID --role-id $ADMIN_ROLE_ID

# Configure Glance-API To Use Keystone
sudo sed -i "s/auth_host = 127.0.0.1/auth_host = 192.168.2.11/g" /etc/glance/glance-api-paste.ini
sudo sed -i 's/admin_tenant_name = %SERVICE_TENANT_NAME%/admin_tenant_name = Services/g' /etc/glance/glance-api-paste.ini
sudo sed -i 's/admin_user = %SERVICE_USER%/admin_user = glance/g' /etc/glance/glance-api-paste.ini
sudo sed -i 's/admin_password = %SERVICE_PASSWORD%/admin_password = glance/g' /etc/glance/glance-api-paste.ini

( cat | sudo tee -a /etc/glance/glance-api.conf ) <<EOF
[paste_deploy]
flavor = keystone
EOF

# Configure Glance-Registry To Use Keystone
sudo sed -i "s/auth_host = 127.0.0.1/auth_host = 192.168.2.11/g" /etc/glance/glance-registry-paste.ini
sudo sed -i 's/admin_tenant_name = %SERVICE_TENANT_NAME%/admin_tenant_name = Services/g' /etc/glance/glance-registry-paste.ini
sudo sed -i 's/admin_user = %SERVICE_USER%/admin_user = glance/g' /etc/glance/glance-registry-paste.ini
sudo sed -i 's/admin_password = %SERVICE_PASSWORD%/admin_password = glance/g' /etc/glance/glance-registry-paste.ini

( cat | sudo tee -a /etc/glance/glance-registry.conf ) <<EOF
[paste_deploy]
flavor = keystone
EOF

sudo service glance-registry restart
sudo service glance-api restart

[Byron McCollum (byron-mccollum)]

These were the instructions from Essex. Don't know if something has changed, but it's suspect that it works in Precise, but not Quantal.

[Launchpad Janitor (janitor)]

[Expired for glance (Ubuntu) because there has been no activity for 60 days.]