Gate builds are suddenly failing due to possible authentication issues early in the process

[Martin Falatic]

Builds that were working fine yesterday are failing today. Notably, these are doc-only builds.

The problems may be related to authentication:
glance image-show ... ---> "An auth plugin is required to fetch a token."
nova keypair-add default ---> "ERROR (DiscoveryFailure): Could not determine a suitable URL for the plugin"

Examples:

Successful build yesterday:
https://review.openstack.org/#/c/199212/ patch 4
http://logs.openstack.org/12/199212/4/check/check-functional-dsvm-magnum/c73dd1c/

Failed build today:
https://review.openstack.org/#/c/199212/ patch 6
http://logs.openstack.org/12/199212/6/check/check-functional-dsvm-magnum/36414da/

A different failed build today:
https://review.openstack.org/#/c/200426/ patch 3
http://logs.openstack.org/26/200426/3/check/check-functional-dsvm-magnum/30932e3/

[Martin Falatic (martinfalatic)]

This affects the check-functional-dsvm-magnum gate for magnum

[Martin Falatic (martinfalatic)]

A little more data that might help debug this:

Earlier in the logs, there is a section starting with a call to
source /opt/stack/new/devstack/accrc/admin/admin

Several variables are set up, but notably a couple have changed since yesterday's last successful build:

These:
export OS_TENANT_NAME=admin
OS_TENANT_NAME=admin

Are now:
export OS_PROJECT_NAME=admin
OS_PROJECT_NAME=admin

Perhaps that has some bearing on why authentication is failing?

[Martin Falatic (martinfalatic)]

FWIW, that TENANT-->PROJECT change seems to have come from here:

https://git.openstack.org/cgit/openstack-dev/devstack/commit/?id=45f0e3d0572f247c0487dd1df9cb15d39b7c0cf4

[Martin Falatic (martinfalatic)]

OS_TENANT_NAME gets set (again) later in the process (before the failure occurs) so the change I noted in #3 above may be irrelevant to this problem.

[Yusaku Sawai (sawai)]

+

[Martin Falatic (martinfalatic)]

FYI all, there is some discussion on the following review that it might have something to do with this breakage:

https://review.openstack.org/#/c/193935/

[Martin Falatic (martinfalatic)]

Console logs for the builds.

console1 = worked
console2 and console3 = failed due to this issue

[Martin Falatic (martinfalatic)]

Because this is looking like a devstack issue I've added devstack to the notification list for this bug.

[Sean Dague (sdague)]

This devstack bug was last updated over 180 days ago, as devstack
is a fast moving project and we'd like to get the tracker down to
currently actionable bugs, this is getting marked as Invalid. If the
issue still exists, please feel free to reopen it.