tempest: import errors on master

[Nicolas Hicher]

When running tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001 on vexxhost, there is an issue during tempest run with import:

2018-10-30 15:12:17 | =========================
2018-10-30 15:12:17 | Failures during discovery
2018-10-30 15:12:17 | =========================
2018-10-30 15:12:17 | --- import errors ---
2018-10-30 15:12:17 | Failed to import test module: tempest.api.compute.admin.test_create_server
2018-10-30 15:12:17 | Traceback (most recent call last):
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 456, in _find_test_path
2018-10-30 15:12:17 | module = self._get_module_from_name(name)
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 395, in _get_module_from_name
2018-10-30 15:12:17 | __import__(name)
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/tempest/api/compute/admin/test_create_server.py", line 29, in <module>
2018-10-30 15:12:17 | class ServersWithSpecificFlavorTestJSON(base.BaseV2ComputeAdminTest):
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/tempest/api/compute/admin/test_create_server.py", line 41, in ServersWithSpecificFlavorTestJSON
2018-10-30 15:12:17 | @testtools.skipUnless(CONF.validation.run_validation,
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/tempest/config.py", line 1222, in __getattr__
2018-10-30 15:12:17 | self._config = TempestConfigPrivate(config_path=self._path)
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/tempest/config.py", line 1194, in __init__
2018-10-30 15:12:17 | logging.setup(_CONF, 'tempest')
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/oslo_log/log.py", line 264, in setup
2018-10-30 15:12:17 | _setup_logging_from_conf(conf, product_name, version)
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/oslo_log/log.py", line 353, in _setup_logging_from_conf
2018-10-30 15:12:17 | filelog = file_handler(logpath)
2018-10-30 15:12:17 | File "/usr/lib64/python2.7/logging/handlers.py", line 392, in __init__
2018-10-30 15:12:17 | logging.FileHandler.__init__(self, filename, mode, encoding, delay)
2018-10-30 15:12:17 | File "/usr/lib64/python2.7/logging/__init__.py", line 902, in __init__
2018-10-30 15:12:17 | StreamHandler.__init__(self, self._open())
2018-10-30 15:12:17 | File "/usr/lib64/python2.7/logging/__init__.py", line 925, in _open
2018-10-30 15:12:17 | stream = open(self.baseFilename, self.mode)
2018-10-30 15:12:17 | IOError: [Errno 13] Permission denied: '/var/log/tempest/tempest.log'
2018-10-30 15:12:17 |
2018-10-30 15:12:17 | Failed to import test module: tempest.api.compute.admin.test_floating_ips_bulk
2018-10-30 15:12:17 | Traceback (most recent call last):
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 456, in _find_test_path
2018-10-30 15:12:17 | module = self._get_module_from_name(name)
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/unittest2/loader.py", line 395, in _get_module_from_name
2018-10-30 15:12:17 | __import__(name)
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/tempest/api/compute/admin/test_floating_ips_bulk.py", line 30, in <module>
2018-10-30 15:12:17 | class FloatingIPsBulkAdminTestJSON(base.BaseV2ComputeAdminTest):
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/tempest/api/compute/admin/test_floating_ips_bulk.py", line 64, in FloatingIPsBulkAdminTestJSON
2018-10-30 15:12:17 | @utils.services('network')
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/tempest/common/utils/__init__.py", line 73, in decorator
2018-10-30 15:12:17 | known_services = get_service_list()
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/tempest/common/utils/__init__.py", line 49, in get_service_list
2018-10-30 15:12:17 | 'compute': CONF.service_available.nova,
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/tempest/config.py", line 1222, in __getattr__
2018-10-30 15:12:17 | self._config = TempestConfigPrivate(config_path=self._path)
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/tempest/config.py", line 1181, in __init__
2018-10-30 15:12:17 | logging.register_options(_CONF)
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/oslo_log/log.py", line 250, in register_options
2018-10-30 15:12:17 | conf.register_cli_opts(_options.common_cli_opts)
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/oslo_config/cfg.py", line 2033, in __inner
2018-10-30 15:12:17 | result = f(self, *args, **kwargs)
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/oslo_config/cfg.py", line 2316, in register_cli_opts
2018-10-30 15:12:17 | self.register_cli_opt(opt, group, clear_cache=False)
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/oslo_config/cfg.py", line 2037, in __inner
2018-10-30 15:12:17 | return f(self, *args, **kwargs)
2018-10-30 15:12:17 | File "/usr/lib/python2.7/site-packages/oslo_config/cfg.py", line 2308, in register_cli_opt
2018-10-30 15:12:17 | raise ArgsAlreadyParsedError("cannot register CLI option")
2018-10-30 15:12:17 | ArgsAlreadyParsedError: arguments already parsed: cannot register CLI option
...

You can find the full log on https://logs.rdoproject.org/80/582180/28/openstack-check/tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001/2ba08b0/logs/undercloud/home/zuul/tempest.log.txt.gz#_2018-10-30_15_12_17

[wes hayutin (weshayutin)]

Fix is here https://review.openstack.org/#/c/614321/

[chandan kumar (chkumar246)]

It also might be a dependency issue because we were using tempest container from docker.io which might not got updated or promoted.
On doing undercloud_enable_tempest to true, it pulls the tempest container from rdo registry and then rebuild and update the container using tht during undercloud image prepare process that's why enable to this option fixes the issue.

[OpenStack Infra (hudson-openstack)]

Change abandoned by Juan Antonio Osorio Robles (<email address hidden>) on branch: master
Review: https://review.openstack.org/614321
Reason: clearing up the gate.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/614738

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/614738
Committed: https://git.openstack.org/cgit/openstack/tripleo-quickstart/commit/?id=2552cec1f554c446d1a628c5bb85fbb02bf89451
Submitter: Zuul
Branch: master

commit 2552cec1f554c446d1a628c5bb85fbb02bf89451
Author: Chandan Kumar <email address hidden>
Date: Thu Nov 1 16:37:22 2018 +0530

    Use undercloud_enable_tempest for fs035 and fs053

    * Since tempest is runned using tempest container so undercloud_enable_tempest
      is set to be true so that it will enable tempest in undercloud.conf and pull
      tempest container on undercloud registry and reuse it from there while running it.
    * Fixed table of content for tempest-setup in these FS

    * https://tree.taiga.io/project/tripleo-ci-board/issue/306

    Change-Id: I81255f8b400f7be96f61ce12baed19a874b75d77
    Closes-Bug: #1800682

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/614321
Committed: https://git.openstack.org/cgit/openstack/tripleo-quickstart/commit/?id=a59889960fd53685201cfb1120e70b64e172ce51
Submitter: Zuul
Branch: master

commit a59889960fd53685201cfb1120e70b64e172ce51
Author: Chandan Kumar <email address hidden>
Date: Tue Oct 30 23:30:22 2018 +0530

    Enable undercloud_enable_tempest to true for FS01

    * Since tempest is runned using tempest container so
      undercloud_enable_tempest is set to be true so that it will enable
      tempest in undercloud.conf and pull tempest container on undercloud
      registry and reuse it from there while running it.

    Closes-Bug: #1800682
    Change-Id: I75e641942b6467ed7a7266d0c32e3e6ce8603a00

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/615123

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/615123
Committed: https://git.openstack.org/cgit/openstack/tripleo-quickstart/commit/?id=ebdc7553976be9da031742f7d94d71b16c40fe67
Submitter: Zuul
Branch: master

commit ebdc7553976be9da031742f7d94d71b16c40fe67
Author: Chandan Kumar <email address hidden>
Date: Fri Nov 2 15:38:15 2018 +0530

    Enable undercloud_enable_tempest to true for minimal

    * Since tempest is runned using tempest container so
      undercloud_enable_tempest is set to be true so that it will enable
      tempest in undercloud.conf and pull tempest container on undercloud
      registry and reuse it from there while running it.

    Change-Id: Ibe7e873f204679f25c09ea51b3818f7eed3b53e5
    Closes-Bug: #1800682

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/615766
Committed: https://git.openstack.org/cgit/openstack/tripleo-quickstart/commit/?id=aa3cecd042a69cbc9f6a899de8b1773ee1a98c53
Submitter: Zuul
Branch: master

commit aa3cecd042a69cbc9f6a899de8b1773ee1a98c53
Author: Chandan Kumar <email address hidden>
Date: Tue Nov 6 13:31:12 2018 +0530

    Run tempest from package in non_containerized env

    * In non_containerized environement, tempest should be installed
      from packages otherwise installing from container will pull tempest
      from docker.io registery which is not promoted and tested and
      resulting in failure.
    * set containerized_undercloud to false in fs03 as it is non
      containerized environment.

    Closes-Bug:#1800682
    Change-Id: If6e70e05aca946500d40e7e703267dd934250d54

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-quickstart 2.1.1 release.