scenario002 ResourceInError: resources.volume1: Went to status error due to "Unknown"

[Alex Schultz]

The scenario002-multinode job is currently failing on the volume creation for the ping test. This is affecting puppet-cinder as well as we gate on this test.

http://logs.openstack.org/15/423815/1/check/gate-tripleo-ci-centos-7-scenario002-multinode-puppet/22178ca/console.html#_2017-01-23_17_07_29_405393

I spotted two different errors in the cinder volume logs:

1) DuplicateOptError: duplicate option: default_availability_zone
http://logs.openstack.org/15/423815/1/check/gate-tripleo-ci-centos-7-scenario002-multinode-puppet/22178ca/logs/subnode-2/var/log/cinder/volume.txt.gz#_2017-01-23_17_04_52_890

2) ImportError: cannot import name api
http://logs.openstack.org/15/423815/1/check/gate-tripleo-ci-centos-7-scenario002-multinode-puppet/22178ca/logs/subnode-2/var/log/cinder/volume.txt.gz#_2017-01-23_17_05_31_336

[Gorka Eguileor (gorka)]

It looks like it's a regression in os-brick introduced by [1], as the volume type for cinder is using an out of tree encryption provider "nova.volume.encryptors.luks.LuksEncryptor" because it's no longer being detected as a LuksEncryptor and is being used directly instead.

There's an os-brick warning [2], and it should have been able to detect is lucks and use internal code like it used to, but since it doesn't the effect we see is that nova/conf/availability_zone.py is trying to register configuration option default_availability_zone that has already been defined by cinder.

[1] https://review.openstack.org/#/c/416672/
[2] http://logs.openstack.org/15/423815/1/check/gate-tripleo-ci-centos-7-scenario002-multinode-puppet/22178ca/logs/subnode-2/var/log/cinder/volume.txt.gz#_2017-01-23_17_04_51_492
[3] http://logs.openstack.org/15/423815/1/check/gate-tripleo-ci-centos-7-scenario002-multinode-puppet/22178ca/logs/subnode-2/var/log/cinder/volume.txt.gz#_2017-01-23_17_04_52_890

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/424302

[Emilien Macchi (emilienm)]

Gorka, if I understand correctly, Nova is using the old name:
nova.volume.encryptors.luks.LuksEncryptor.

Shouldn't we fix Nova also?

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/424307

[OpenStack Infra (hudson-openstack)]

Change abandoned by Emilien Macchi (<email address hidden>) on branch: master
Review: https://review.openstack.org/424302
Reason: https://review.openstack.org/424307

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.openstack.org/424539

[Lee Yarwood (lyarwood)]

Apologies about this, the os-brick needed to include the legacy nova.volume.encryptor paths for this use case to work correctly. I've added these in now and updated the THT change to use the new `luks` constant so we don't have to change this again for Pike.

As noted in the os-brick change I'll create a Cinder bug to tackle updating these legacy paths to the new provider format constants in Pike.

[OpenStack Infra (hudson-openstack)]

Change abandoned by Lee Yarwood (<email address hidden>) on branch: master
Review: https://review.openstack.org/424539
Reason: Duplicate of https://review.openstack.org/#/c/424324/

[OpenStack Infra (hudson-openstack)]

Change abandoned by Emilien Macchi (<email address hidden>) on branch: master
Review: https://review.openstack.org/424302

[Emilien Macchi (emilienm)]

Will be fixed by https://review.openstack.org/#/c/424307/

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/424307
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=44ec61345d128065df24ff99d04c11a82811df80
Submitter: Jenkins
Branch: master

commit 44ec61345d128065df24ff99d04c11a82811df80
Author: Emilien Macchi <email address hidden>
Date: Mon Jan 23 14:42:23 2017 -0500

    scenario002: updating volume encryption provider

    https://review.openstack.org/#/c/416672 made the new luks provider required.
    Let's use it.

    Closes-Bug: #1658755
    Change-Id: Icc7c3c933af6621959ce3e6af99c73b4afd87509

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/424324
Committed: https://git.openstack.org/cgit/openstack/os-brick/commit/?id=10a5e3f5d569d7691c6a7181e6225a4895569008
Submitter: Jenkins
Branch: master

commit 10a5e3f5d569d7691c6a7181e6225a4895569008
Author: Eric Harney <email address hidden>
Date: Mon Jan 23 15:17:57 2017 -0500

    Encryptors: Fix compat with Nova encryptors for Ocata

    The change 916cfaf "Introduce encryption provider constants"
    intended to issue deprecation messages for encryptors that
    are no longer going to be supported in Pike, and continue
    loading the current os_brick encryptors instead.

    However, since it removed the "'LuksEncryptor' in provider"
    style checks, any config values that were not explicitly listed
    in LEGACY_PROVIDER_CLASS_TO_FORMAT_MAP will not be translated.

    This results in a configuration using a provider of
    "nova.volume.encryptors.luks.LuksEncryptor" to attempt to
    import this module directly into Cinder when previously it
    would use the os_brick encryptor. This is generally wrong
    and causes a number of problems.

    Closes-Bug: #1658755

    Change-Id: I3ec6e3fe919bc03d158da04a18fb8b651002ed52

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/os-brick 1.11.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-heat-templates 6.0.0.0rc1 release candidate.