It seems difficult to get complete data for non-voting tests, but all results that I have checked starting on 2016-08-04 show the same failure in the devstack setup phase while trying to upload the cirros image:
2016-08-19 10:18:25.627 21976 DEBUG keystoneclient.auth.identity.v3.base [req-5d46098e-a4e6-469e-968c-ff9269f1f05e 91bbd5bf421b448a966030ed9f2f80bf 77a269bd219646a0a370134a3150d970 - default default] Making authentication request to http://127.0.0.1/identity/v3/auth/tokens get_auth_ref /usr/local/lib/python2.7/dist-packages/keystoneclient/auth/identity/v3/base.py:189
2016-08-19 10:18:28.796 21976 DEBUG keystoneclient.session [req-5d46098e-a4e6-469e-968c-ff9269f1f05e 91bbd5bf421b448a966030ed9f2f80bf 77a269bd219646a0a370134a3150d970 - default default] Request returned failure status: 401 request /usr/local/lib/python2.7/dist-packages/keystoneclient/session.py:418
2016-08-19 10:18:28.797 21976 DEBUG oslo_messaging._drivers.amqpdriver [req-5d46098e-a4e6-469e-968c-ff9269f1f05e 91bbd5bf421b448a966030ed9f2f80bf 77a269bd219646a0a370134a3150d970 - default default] CAST unique_id: b5337d20062a4b708029b33f2b7d0cc0 NOTIFY exchange 'glance' topic 'notifications.error' _send /usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py:432
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data [req-5d46098e-a4e6-469e-968c-ff9269f1f05e 91bbd5bf421b448a966030ed9f2f80bf 77a269bd219646a0a370134a3150d970 - default default] Failed to upload image data due to internal error
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data Traceback (most recent call last):
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/opt/stack/new/glance/glance/api/v2/image_data.py", line 114, in upload
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data image.set_data(data, size)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/opt/stack/new/glance/glance/domain/proxy.py", line 195, in set_data
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data self.base.set_data(data, size)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/opt/stack/new/glance/glance/notifier.py", line 449, in set_data
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data _send_notification(notify_error, 'image.upload', msg)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data self.force_reraise()
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data six.reraise(self.type_, self.value, self.tb)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/opt/stack/new/glance/glance/notifier.py", line 396, in set_data
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data self.repo.set_data(data, size)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/opt/stack/new/glance/glance/api/policy.py", line 185, in set_data
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data return self.image.set_data(*args, **kwargs)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/opt/stack/new/glance/glance/quota/__init__.py", line 304, in set_data
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data self.image.set_data(data, size=size)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/opt/stack/new/glance/glance/location.py", line 430, in set_data
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data verifier=verifier)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/usr/local/lib/python2.7/dist-packages/glance_store/backend.py", line 371, in add_to_backend
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data verifier)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/usr/local/lib/python2.7/dist-packages/glance_store/backend.py", line 344, in store_add_to_backend
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data verifier=verifier)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/usr/local/lib/python2.7/dist-packages/glance_store/capabilities.py", line 225, in op_checker
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data return store_op_fun(store, *args, **kwargs)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/usr/local/lib/python2.7/dist-packages/glance_store/_drivers/swift/store.py", line 662, in add
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data allow_reauth=need_chunks) as manager:
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/usr/local/lib/python2.7/dist-packages/glance_store/_drivers/swift/store.py", line 1301, in get_manager_for_store
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data store, store_location, context, allow_reauth)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/usr/local/lib/python2.7/dist-packages/glance_store/_drivers/swift/connection_manager.py", line 64, in __init__
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data self.storage_url = self._get_storage_url()
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data File "/usr/local/lib/python2.7/dist-packages/glance_store/_drivers/swift/connection_manager.py", line 160, in _get_storage_url
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data raise exceptions.BackendException(msg)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data BackendException: Cannot find swift service endpoint : The request you have made requires authentication. (HTTP 401) (Request-ID: req-9dc24405-0c91-40b3-bbd0-284c4b12edbe)
2016-08-19 10:18:28.802 21976 ERROR glance.api.v2.image_data
I've tried to reproduce this error on locally running trusty instances using the reproduce.sh from various failures, but the failure does not happen for me there, everything is just working fine, so there seems to be some correlation to the infra trusty images.
O.k., after finding a bug in devstack-gate when creating reproduce.sh, I can see the error now locally. It seems related to OSC getting confused when --os-cloud is used in combination with other variables being set (e.g. by sourcing openrc). Initially everything is fine:
stack@jr- t5:~/devstack$ openstack --os-cloud devstack token issue ------+ ------- ------- ------- ------- ------+ ------+ ------- ------- ------- ------- ------+ 381346+ 00:00 | 1a7e25a7d0b322c a6 | 29681504422a931 cb | 18a6c163441dd83 45 | ------+ ------- ------- ------- ------- ------+ t5:~/devstack$ openstack --os-cloud devstack-admin token issue ------+ ------- ------- ------- ------- ------+ ------+ ------- ------- ------- ------- ------+ 164681+ 00:00 | d8955c35c1bfe3c b7 | c871cba73cd7465 78 | b9e8c60077e7a54 d1 | ------+ ------- ------- ------- ------- ------+
+------
| Field | Value |
+------
| expires | 2016-09-13 21:19:39.
| id | ffcc967f3ba3432
| project_id | a8512069cebe4f9
| user_id | ec224c917f8641b
+------
stack@jr-
+------
| Field | Value |
+------
| expires | 2016-09-13 21:19:48.
| id | 660da9458ceb40c
| project_id | cb5b39acff6a49b
| user_id | 0da7c28639cf4f0
+------
But after sourcing openrc things for the other cloud definition get off track:
stack@jr- t5:~/devstack$ . openrc t5:~/devstack$ openstack --os-cloud devstack token issue ------+ ------- ------- ------- ------- ------+ ------+ ------- ------- ------- ------- ------+ 915116+ 00:00 | 88912a006af8e9f 54 | 29681504422a931 cb | 18a6c163441dd83 45 | ------+ ------- ------- ------- ------- ------+ t5:~/devstack$ openstack --os-cloud devstack-admin token issue 9c99-4b85- 8ed3-af1c8c4dee b3)
WARNING: setting legacy OS_TENANT_NAME to support cli tools.
stack@jr-
+------
| Field | Value |
+------
| expires | 2016-09-13 21:19:59.
| id | 4491e058a9f440a
| project_id | a8512069cebe4f9
| user_id | ec224c917f8641b
+------
stack@jr-
The request you have made requires authentication. (HTTP 401) (Request-ID: req-b8772035-