[keystone] keystone-all log is being filled with TRACE message end with <type 'exceptions.TypeError'>: 'NoneType' object is not callable

[Stanislav Kolenkin]

MOS 9.0

The following error occurs consistently in the log file /var/log/keystone-all.log:
<12>Aug 29 07:39:58 node-1 keystone-admin: 2016-08-29 07:39:58.377 20790 WARNING keystone.common.manager [req-8876e5f1-6e7b-41cf-a7a4-db4b5461de75 - - - - -] Deprecated: Direct import of driver 'keyston
e.token.providers.fernet.Provider' is deprecated as of Liberty in favor of its entrypoint from 'keystone.token.provider' and may be removed in N.
<46>Aug 29 07:39:58 node-1 keystone_wsgi_admin_access - - - [29/Aug/2016:07:39:53 +0000] "GET /v3 HTTP/1.0" 200 253 3979430 "-" "-"
<43>Aug 29 07:39:58 node-1 keystone_wsgi_admin_error [Mon Aug 29 07:39:50.232778 2016] [wsgi:error] [pid 12862:tid 140297248732928] Exception in thread Thread-3 (most likely raised during interpreter sh
utdown):
<43>Aug 29 07:39:58 node-1 keystone_wsgi_admin_error [Mon Aug 29 07:39:50.233006 2016] [wsgi:error] [pid 12862:tid 140297248732928] Traceback (most recent call last):
<43>Aug 29 07:39:58 node-1 keystone_wsgi_admin_error [Mon Aug 29 07:39:50.233029 2016] [wsgi:error] [pid 12862:tid 140297248732928] File "/usr/lib/python2.7/threading.py", line 810, in __bootstrap_inner
<43>Aug 29 07:39:58 node-1 keystone_wsgi_admin_error [Mon Aug 29 07:39:50.233039 2016] [wsgi:error] [pid 12862:tid 140297248732928] File "/usr/lib/python2.7/threading.py", line 763, in run
<43>Aug 29 07:39:58 node-1 keystone_wsgi_admin_error [Mon Aug 29 07:39:50.233047 2016] [wsgi:error] [pid 12862:tid 140297248732928] File "/usr/lib/python2.7/dist-packages/oslo_messaging/_drivers/impl_rabbit.py", line 907, in _heartbeat_thread_job
<43>Aug 29 07:39:58 node-1 keystone_wsgi_admin_error [Mon Aug 29 07:39:50.233054 2016] [wsgi:error] [pid 12862:tid 140297248732928] File "/usr/lib/python2.7/contextlib.py", line 84, in helper
<43>Aug 29 07:39:58 node-1 keystone_wsgi_admin_error [Mon Aug 29 07:39:50.233063 2016] [wsgi:error] [pid 12862:tid 140297248732928] <type 'exceptions.TypeError'>: 'NoneType' object is not callable
<43>Aug 29 07:39:58 node-1 keystone_wsgi_admin_error [Mon Aug 29 07:39:55.065631 2016] [wsgi:error] [pid 20791:tid 140080251320064] Option "verbose" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future.
<43>Aug 29 07:39:58 node-1 keystone_wsgi_admin_error [Mon Aug 29 07:39:58.019760 2016] [wsgi:error] [pid 20790:tid 140080259712768] Option "verbose" from group "DEFAULT" is deprecated for removal. Its value may be silently ignored in the future.

ii keystone 2:9.0.2-1~u14.04+mos3 all OpenStack identity service
ii python-keystone 2:9.0.2-1~u14.04+mos3 all OpenStack identity service - library
ii python-keystoneauth1 2.3.0-2~u14.04+mos1 all authentication library for OpenStack Identity - Python 2.7
ii python-keystoneclient 1:2.3.1-3~u14.04+mos2 all client library for the OpenStack Keystone API - Python 2.x
ii python-keystonemiddleware 4.4.1-1~u14.04+mos0 all Middleware for OpenStack Identity (Keystone) - Python 2.x

[Vitaly Sedelnik (vsedelnik)]

Stanislav, please provide details of cloud configuration, steps to reproduce, expected result. Is there some impact other than unexpected log messages?

[Stanislav Kolenkin (skolenkin)]

I use vanilla MOS9.0

shotgun2 short-report
cat /etc/fuel_build_id:
 495
cat /etc/fuel_build_number:
 495
cat /etc/fuel_release:
 9.0
cat /etc/fuel_openstack_version:
 mitaka-9.0
rpm -qa | egrep 'fuel|astute|network-checker|nailgun|packetary|shotgun':
 fuel-release-9.0.0-1.mos6349.noarch
 fuel-misc-9.0.0-1.mos8460.noarch
 python-packetary-9.0.0-1.mos140.noarch
 fuel-bootstrap-cli-9.0.0-1.mos285.noarch
 fuel-migrate-9.0.0-1.mos8460.noarch
 rubygem-astute-9.0.0-1.mos750.noarch
 fuel-mirror-9.0.0-1.mos140.noarch
 shotgun-9.0.0-1.mos90.noarch
 fuel-openstack-metadata-9.0.0-1.mos8743.noarch
 fuel-notify-9.0.0-1.mos8460.noarch
 nailgun-mcagents-9.0.0-1.mos750.noarch
 python-fuelclient-9.0.0-1.mos325.noarch
 fuel-9.0.0-1.mos6349.noarch
 fuel-utils-9.0.0-1.mos8460.noarch
 fuel-setup-9.0.0-1.mos6349.noarch
 fuel-provisioning-scripts-9.0.0-1.mos8743.noarch
 fuel-library9.0-9.0.0-1.mos8460.noarch
 network-checker-9.0.0-1.mos74.x86_64
 fuel-agent-9.0.0-1.mos285.noarch
 fuel-ui-9.0.0-1.mos2717.noarch
 fuel-ostf-9.0.0-1.mos936.noarch
 fuelmenu-9.0.0-1.mos274.noarch
 fuel-nailgun-9.0.0-1.mos8743.noarch

fuel node
id | status | name | cluster | ip | mac | roles | pending_roles | online | group_id
---+--------+------------------+---------+------------+-------------------+--------------------+---------------+--------+---------
 4 | ready | Untitled (eb:5b) | 3 | 10.200.0.6 | 64:3f:e2:93:eb:5b | compute | | 1 | 3
 7 | ready | Untitled (97:d9) | 3 | 10.200.0.9 | 64:87:d8:b5:97:d9 | base-os | | 1 | 3
 5 | ready | Untitled (ce:9d) | 3 | 10.200.0.4 | 3e:3a:d4:48:85:11 | compute | | 1 | 3
 6 | ready | Untitled (2e:bd) | 3 | 10.200.0.8 | 46:e7:e7:3f:d4:0b | mongo | | 1 | 3
 1 | ready | Untitled (0f:9b) | 3 | 10.200.0.5 | 64:00:6b:07:0f:9b | cinder, controller | | 1 | 3
 3 | ready | Untitled (99:3c) | 3 | 10.200.0.7 | 4a:7b:c7:02:9f:6b | cinder, controller | | 1 | 3
 2 | ready | Untitled (c4:59) | 3 | 10.200.0.3 | 64:ea:b8:d0:c4:59 | cinder, controller | | 1 | 3