cinder cannot start because of: oslo_config.cfg.DuplicateOptError: duplicate option: fatal_exception_format_errors

[Victor Laza]

cinder cannot start because of: oslo_config.cfg.DuplicateOptError: duplicate option: fatal_exception_format_errors

2015-05-14 09:23:02.421 | + /usr/local/bin/cinder-manage db sync
2015-05-14 09:23:02.921 | Traceback (most recent call last):
2015-05-14 09:23:02.921 | File "/usr/local/bin/cinder-manage", line 6, in <module>
2015-05-14 09:23:02.921 | from cinder.cmd.manage import main
2015-05-14 09:23:02.921 | File "/opt/stack/cinder/cinder/cmd/manage.py", line 75, in <module>
2015-05-14 09:23:02.921 | from cinder import context
2015-05-14 09:23:02.921 | File "/opt/stack/cinder/cinder/context.py", line 27, in <module>
2015-05-14 09:23:02.921 | from cinder import policy
2015-05-14 09:23:02.921 | File "/opt/stack/cinder/cinder/policy.py", line 21, in <module>
2015-05-14 09:23:02.921 | from cinder import exception
2015-05-14 09:23:02.921 | File "/opt/stack/cinder/cinder/exception.py", line 45, in <module>
2015-05-14 09:23:02.921 | CONF.register_opts(exc_log_opts)
2015-05-14 09:23:02.922 | File "/usr/local/lib/python2.7/dist-packages/oslo_config/cfg.py", line 1794, in __inner
2015-05-14 09:23:02.922 | result = f(self, *args, **kwargs)
2015-05-14 09:23:02.922 | File "/usr/local/lib/python2.7/dist-packages/oslo_config/cfg.py", line 1951, in register_opts
2015-05-14 09:23:02.922 | self.register_opt(opt, group, clear_cache=False)
2015-05-14 09:23:02.922 | File "/usr/local/lib/python2.7/dist-packages/oslo_config/cfg.py", line 1798, in __inner
2015-05-14 09:23:02.922 | return f(self, *args, **kwargs)
2015-05-14 09:23:02.922 | File "/usr/local/lib/python2.7/dist-packages/oslo_config/cfg.py", line 1940, in register_opt
2015-05-14 09:23:02.923 | if _is_opt_registered(self._opts, opt):
2015-05-14 09:23:02.923 | File "/usr/local/lib/python2.7/dist-packages/oslo_config/cfg.py", line 573, in _is_opt_registered
2015-05-14 09:23:02.923 | raise DuplicateOptError(opt.name)
2015-05-14 09:23:02.923 | oslo_config.cfg.DuplicateOptError: duplicate option: fatal_exception_format_errors

we already removed cinder pyc files before re-running the stack

I believe this is related to https://review.openstack.org/#/c/160209/25/cinder/exception.py

[Waldemar Znoinski (wznoinsk)]

try updating your oslo.* packages,
sudo -E -H pip search oslo - you may want to check which ones are not on LATEST

mine before updating:
oslo.messaging - Oslo Messaging API
  INSTALLED: 1.8.0
  LATEST: 1.10.0
oslo.config - Oslo Configuration API
  INSTALLED: 1.11.0 (latest)
oslo.db - Oslo Database library
  INSTALLED: 1.7.1
  LATEST: 1.9.0
oslo.vmware - Oslo VMware library
  INSTALLED: 0.11.1
  LATEST: 0.12.0
oslo.i18n - Oslo i18n library
  INSTALLED: 1.5.0
  LATEST: 1.6.0
oslo.rootwrap - Oslo Rootwrap
  INSTALLED: 1.6.0
  LATEST: 1.7.0
oslo.utils - Oslo Utility library
  INSTALLED: 1.4.0
  LATEST: 1.5.0
oslotest - Oslo test framework
oslo.concurrency - Oslo Concurrency library
  INSTALLED: 1.8.0
  LATEST: 1.9.0
oslosphinx - OpenStack Sphinx Extensions and Theme
oslo.serialization - Oslo Serialization library
  INSTALLED: 1.4.0
  LATEST: 1.5.0
oslo.middleware - Oslo Middleware library
  INSTALLED: 1.0.0
  LATEST: 1.2.0
oslo.policy - oslo.policy library
  INSTALLED: 0.3.1
  LATEST: 1.0.0
oslo.log - oslo.log library
  INSTALLED: 1.0.0
  LATEST: 1.1.0
oslobysykkel - Interface for ClearChannel's Oslo city bike API.
oslo.versionedobjects - Oslo Versioned Objects library
  INSTALLED: 0.1.1
  LATEST: 0.2.0
oslo.context - Oslo Context library
  INSTALLED: 0.2.0
  LATEST: 0.3.0
oslo.sphinx - OpenStack Sphinx Extensions
oslom-runner - An OSLOM (community finding) runner for Python
nose-tooslow - Treat tests that execute too slowly as failed
oslo.cache -
oslo.test -

I have the cinder problem sorted after:
sudo -E -H pip install -U oslo.messaging oslo.db oslo.vmware oslo.i18n oslo.rootwrap oslo.utils oslo.concurrency oslo.serialization oslo.middleware oslo.policy oslo.log oslo.versionedobjects oslo.context

hope that helps

[John Griffith (john-griffith)]

@Victor
You're correct, the change you referenced added the conf definition to the exception file. The problem is however the versioned_objects library also defines it.

[Ethan Lynn (ethanlynn)]

Any progress or update for this bug?

[Victor Laza (vlaza)]

On our side it was a cumulus of things:

We had a temporary bug fix for devstack in place related to requirements that was always downgrading our oslo.* modules even if we forced upgrade before running devstack.

Extra to that we had to add in local.conf of devstack: "GIT_BASE=https://git.openstack.org" as sometimes ssh was hanging

As Waldemar said "sudo -E -H pip install -U oslo.messaging oslo.db oslo.vmware oslo.i18n oslo.rootwrap oslo.utils oslo.concurrency oslo.serialization oslo.middleware oslo.policy oslo.log oslo.versionedobjects oslo.context" before running devstack fixes the issue.