Horizon failing with os profiler issue

Bug #1475279 reported by Sudheer Kalla
8
This bug affects 1 person
Affects Status Importance Assigned to Milestone
OpenStack Dashboard (Horizon)
Expired
Undecided
Unassigned

Bug Description

Whenever i try to open horizon i will get an error and horizon won't show up .The following is the error i got

[Thu Jul 16 08:11:48.966357 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] Traceback (most recent call last):, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.966400 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/openstack_dashboard/wsgi/django.wsgi", line 14, in <module>, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.966534 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] application = get_wsgi_application(), referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.966572 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/django/core/wsgi.py", line 14, in get_wsgi_application, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.966677 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] django.setup(), referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.966708 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/django/__init__.py", line 20, in setup, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.966807 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] configure_logging(settings.LOGGING_CONFIG, settings.LOGGING), referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.966844 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 46, in __getattr__, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.967004 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] self._setup(name), referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.967034 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 42, in _setup, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.967086 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] self._wrapped = Settings(settings_module), referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.967112 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/django/conf/__init__.py", line 94, in __init__, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.967150 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] mod = importlib.import_module(self.SETTINGS_MODULE), referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.967178 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/importlib/__init__.py", line 37, in import_module, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.967284 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] __import__(name), referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.967314 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/openstack_dashboard/wsgi/../../openstack_dashboard/settings.py", line 27, in <module>, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.967512 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] from openstack_dashboard import exceptions, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.967582 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/openstack_dashboard/wsgi/../../openstack_dashboard/exceptions.py", line 22, in <module>, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.967706 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] from keystoneclient import exceptions as keystoneclient, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.967737 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/openstack_dashboard/wsgi/../../keystoneclient/__init__.py", line 34, in <module>, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.967946 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] from keystoneclient import client, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.968005 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/openstack_dashboard/wsgi/../../keystoneclient/client.py", line 13, in <module>, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.968132 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] from keystoneclient import discover, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.968162 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/openstack_dashboard/wsgi/../../keystoneclient/discover.py", line 20, in <module>, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.968432 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] from keystoneclient import session as client_session, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.968467 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/openstack_dashboard/wsgi/../../keystoneclient/session.py", line 32, in <module>, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.968875 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] osprofiler_web = importutils.try_import("osprofiler.web"), referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.968909 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/openstack_dashboard/wsgi/../../oslo_utils/importutils.py", line 71, in try_import, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.969054 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] return import_module(import_str), referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.969086 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/openstack_dashboard/wsgi/../../oslo_utils/importutils.py", line 57, in import_module, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.969128 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] __import__(import_str), referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.969152 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/openstack_dashboard/wsgi/../../osprofiler/__init__.py", line 23, in <module>, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.969252 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] utils.import_modules_from_package("osprofiler._notifiers"), referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.969282 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] File "/usr/lib/python2.7/dist-packages/openstack_dashboard/wsgi/../../osprofiler/_utils.py", line 172, in import_modules_from_package, referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.969428 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] __import__(module_name), referer: https://10.35.58.13:5290/project/
[Thu Jul 16 08:11:48.969501 2015] [:error] [pid 3442:tid 139893606598400] [client 192.168.122.1:37270] ValueError: Empty module name, referer: https://10.35.58.13:5290/project/

I have my settings file in the same directory as it should be and iam still getting this error.

Revision history for this message
Matthias Runge (mrunge) wrote :

Could you please give more context? Version, distro, additional plugins, url called, login (like admin or user); it may be worth to share your config, if you distrust your config.

Revision history for this message
Matthias Runge (mrunge) wrote :

Horizon does not use osprofiler at all.

Revision history for this message
Sudheer Kalla (sudheer-kalla) wrote :

But heatclient internal uses osprofiler so while loading this is causing issue . And moreover if i comment the line __import__(module_name) in the file openstack_dashboard/wsgi/../../osprofiler/_utils.py (line no 172) i can load my horizon and iam able to access it .

Revision history for this message
Matthias Runge (mrunge) wrote :

then it's a heatclient issue (missing dependency)

Revision history for this message
Sudheer Kalla (sudheer-kalla) wrote :

For me it is reproducible in mitaka also, osprofiler is dependency for heat and it is installed.

Revision history for this message
Gary W. Smith (gary-w-smith) wrote :

As Matthias suggested, this appears to be a configuration issue. If you can
reproduce this with horizon directly, then please supply the additional
requested details and reopen the bug.

Changed in horizon:
status: New → Incomplete
Revision history for this message
Harri Heikkilä (hh61) wrote :

It might be configuration issue, but then that is something that is missing from defaults or documentation. If that is documented somewhere, please provide exact link here.

-I have installed Open stack Liberty straight from sources in 2016 and encountered this (or related issue, among many other), which I reported https://bugs.launchpad.net/python-heatclient/+bug/1539607 newer receiving proper attention. I got Liberty somewhat up and running, but needed to deep digging individual patches mentioned only in individual bug reports. So I then gave up on Liberty release.
-I gave OpenStack one more chance again in March 2017 using Kolla-ansible packaging following their documentation (Newton&Ocata) and found exactly the same issue. Which I reported then in #openstack-kolla IRC channel which was noted. But didn't follow what happened to it after that.

_I think all mentioned bug reports are related to same missing symbolic link issue._

Also Sudheer also mentions above (openstack_dashboard/wsgi/../../) which imo points to same problem.

I made local quick and dirty workaround to my local Ansible scripts that I wrote now following official documented kolla-ansible procedure. Without this workaround, Horizon UI starts, but is missing all static content (icons, .css etc.) resulting unbearable UI.

The workaround I needed also with Kolla-Ansible (Ubuntu 16.10 running in KVM):
- name: Check is kolla folder/link missing
  command: ls /usr/local/share/kolla
  register: kolla_link_missing
  always_run: True
  ignore_errors: True
  changed_when: False

- name: Link kolla-ansible to kolla (needed still?)
  shell: ln -s /usr/local/share/kolla-ansible /usr/local/share/kolla
  become: True
  when: kolla_link_missing.rc != 0

Should you do regression testing against installation documentation also? In my opinion would help on expanding OpenStack install base on private/hybrid clouds thus being money well spent. I don't need single new features to OpenStack before basic installation is properly working and documented and official 'release' is bug free.

Othervise Kolla-ansible is huge improvement on installation burden. With this my workaround and Kolla-ansible documented preparation work I can now (almost)automatically install OpenStack as private cloud running on top of single KVM (running all those OpenStack Docker containers). I have some pending Networking visibility issues, but they must be related to my own VLAN configurations from iron to KVM.

Revision history for this message
Launchpad Janitor (janitor) wrote :

[Expired for OpenStack Dashboard (Horizon) because there has been no activity for 60 days.]

Changed in horizon:
status: Incomplete → Expired
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.