Havana + Ubuntu horizon crashes with error 500

[Dmitry Borodaenko]

Environment: fuel-4.0-9-2013-11-06_06-02-06.iso + puppet manifests from havana branch (HEAD at fe1a2a0b1557c8c976ac5f352b47449989a02eed Merge pull request #791 from dmitryilyin/havana).

A simple deployment with 1 controller + 1 compute + 2 ceph-osd with Ceph for volumes, images, and objects has successfully completed, and all openstack components are accessible from command line, but horizon fails with error 500, following stack traces can be found in /var/log/dashboard.log:

<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] mod_wsgi (pid=9599): Exception occurred processing WSGI script '/usr/share/openstack-dashboard/openstack_dashboard/wsgi/django.ws
gi'.
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] Traceback (most recent call last):
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/core/handlers/wsgi.py", line 236, in __call__
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] self.load_middleware()
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 45, in load_middleware
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] for middleware_path in settings.MIDDLEWARE_CLASSES:
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 53, in __getattr__
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] self._setup(name)
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 48, in _setup
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] self._wrapped = Settings(settings_module)
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 132, in __init__
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] mod = importlib.import_module(self.SETTINGS_MODULE)
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/utils/importlib.py", line 35, in import_module
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] __import__(name)
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../openstack_dashboard/settings.py", line 224, in <module>
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] from openstack_dashboard import policy
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../openstack_dashboard/policy.py", line 27, in <module>
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] from openstack_auth import utils as auth_utils
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/openstack_auth/utils.py", line 4, in <module>
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] from django.contrib import auth
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/contrib/auth/__init__.py", line 5, in <module>
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] from django.middleware.csrf import rotate_token
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/middleware/csrf.py", line 16, in <module>
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] from django.utils.cache import patch_vary_headers
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/utils/cache.py", line 26, in <module>
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] from django.core.cache import get_cache
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/core/cache/__init__.py", line 70, in <module>
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] if DEFAULT_CACHE_ALIAS not in settings.CACHES:
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 53, in __getattr__
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] self._setup(name)
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 49, in _setup
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] self._configure_logging()
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 84, in _configure_logging
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] logging_config_func(self.LOGGING)
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/logging/config.py", line 777, in dictConfig
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] dictConfigClass(config).configure()
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/logging/config.py", line 575, in configure
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] '%r: %s' % (name, e))
<139>Nov 8 21:40:21 node-1 apache2[9599]: [error] [client 10.108.5.1] ValueError: Unable to configure handler 'file': [Errno 13] Permission denied: '/var/log/horizon/horizon.log'
<139>Nov 8 21:40:21 node-1 apache2[9602]: [error] [client 10.108.5.1] File does not exist: /etc/apache2/htdocs
<139>Nov 8 21:40:21 node-1 apache2[9602]: [error] [client 10.108.5.1] File does not exist: /etc/apache2/htdocs

and

<139>Nov 8 23:18:08 node-1 apache2[9600]: [error] [client 10.108.5.1] Traceback (most recent call last):
<139>Nov 8 23:18:08 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/core/handlers/wsgi.py", line 236, in __call__
<139>Nov 8 23:18:08 node-1 apache2[9600]: [error] [client 10.108.5.1] self.load_middleware()
<139>Nov 8 23:18:08 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/core/handlers/base.py", line 45, in load_middleware
<139>Nov 8 23:18:08 node-1 apache2[9600]: [error] [client 10.108.5.1] for middleware_path in settings.MIDDLEWARE_CLASSES:
<139>Nov 8 23:18:08 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 53, in __getattr__
<139>Nov 8 23:18:08 node-1 apache2[9600]: [error] [client 10.108.5.1] self._setup(name)
<139>Nov 8 23:18:08 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 48, in _setup
<139>Nov 8 23:18:08 node-1 apache2[9600]: [error] [client 10.108.5.1] self._wrapped = Settings(settings_module)
<139>Nov 8 23:18:08 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 132, in __init__
<139>Nov 8 23:18:08 node-1 apache2[9600]: [error] [client 10.108.5.1] mod = importlib.import_module(self.SETTINGS_MODULE)
<139>Nov 8 23:18:08 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/utils/importlib.py", line 35, in import_module
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] __import__(name)
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../openstack_dashboard/settings.py", line 224, in <module>
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] from openstack_dashboard import policy
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/share/openstack-dashboard/openstack_dashboard/wsgi/../../openstack_dashboard/policy.py", line 27, in <module>
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] from openstack_auth import utils as auth_utils
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/openstack_auth/utils.py", line 4, in <module>
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] from django.contrib import auth
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/contrib/auth/__init__.py", line 5, in <module>
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] from django.middleware.csrf import rotate_token
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/middleware/csrf.py", line 16, in <module>
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] from django.utils.cache import patch_vary_headers
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/utils/cache.py", line 26, in <module>
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] from django.core.cache import get_cache
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/core/cache/__init__.py", line 70, in <module>
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] if DEFAULT_CACHE_ALIAS not in settings.CACHES:
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 53, in __getattr__
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] self._setup(name)
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 49, in _setup
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] self._configure_logging()
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 84, in _configure_logging
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] logging_config_func(self.LOGGING)
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/logging/config.py", line 777, in dictConfig
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] dictConfigClass(config).configure()
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] File "/usr/lib/python2.7/logging/config.py", line 575, in configure
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] '%r: %s' % (name, e))
<139>Nov 8 23:18:09 node-1 apache2[9600]: [error] [client 10.108.5.1] ValueError: Unable to configure handler 'file': [Errno 13] Permission denied: '/var/log/horizon/horizon.log'

Diagnostic snapshot attached.