tempest.scenario.test_minimum_basic.TestMinimumBasicScenario failure in CI

[Martin André]

Tempest failed on tempest.scenario.test_minimum_basic.TestMinimumBasicScenario for tripleo-ci-centos-7-standalone job:

2019-01-08 00:47:13 | ==============================
2019-01-08 00:47:13 | Failed 1 tests - output below:
2019-01-08 00:47:13 | ==============================
2019-01-08 00:47:13 |
2019-01-08 00:47:13 | tempest.scenario.test_minimum_basic.TestMinimumBasicScenario.test_minimum_basic_scenario[compute,id-bdbb5441-9204-419d-a225-b4fdbfb1a1a8,image,network,volume]
2019-01-08 00:47:13 | --------------------------------------------------------------------------------------------------------------------------------------------------------------
2019-01-08 00:47:13 |
2019-01-08 00:47:13 | Captured traceback:
2019-01-08 00:47:13 | ~~~~~~~~~~~~~~~~~~~
2019-01-08 00:47:13 | Traceback (most recent call last):
2019-01-08 00:47:13 | File "/usr/lib/python2.7/site-packages/tempest/common/utils/__init__.py", line 89, in wrapper
2019-01-08 00:47:13 | return f(*func_args, **func_kwargs)
2019-01-08 00:47:13 | File "/usr/lib/python2.7/site-packages/tempest/scenario/test_minimum_basic.py", line 117, in test_minimum_basic_scenario
2019-01-08 00:47:13 | self.cinder_show(volume)
2019-01-08 00:47:13 | File "/usr/lib/python2.7/site-packages/tempest/scenario/test_minimum_basic.py", line 63, in cinder_show
2019-01-08 00:47:13 | self.assertEqual(volume, got_volume)
2019-01-08 00:47:13 | File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 350, in assertEqual
2019-01-08 00:47:13 | self.assertThat(observed, matcher, message)
2019-01-08 00:47:13 | File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 435, in assertThat
2019-01-08 00:47:13 | raise mismatch_error
2019-01-08 00:47:13 | testtools.matchers._impl.MismatchError: !=:
2019-01-08 00:47:13 | reference = {u'attachments': [],
2019-01-08 00:47:13 | u'availability_zone': u'nova',
2019-01-08 00:47:13 | u'bootable': u'false',
2019-01-08 00:47:13 | u'consistencygroup_id': None,
2019-01-08 00:47:13 | u'created_at': u'2019-01-08T00:14:00.000000',
2019-01-08 00:47:13 | u'description': None,
2019-01-08 00:47:13 | u'encrypted': False,
2019-01-08 00:47:13 | u'id': u'f58ae72e-9348-4409-8973-46140a0f5c87',
2019-01-08 00:47:13 | u'links': [{u'href': u'http://192.168.24.1:8776/v3/29a46f51dd42419d8d473133035b0ac5/volumes/f58ae72e-9348-4409-8973-46140a0f5c87',
2019-01-08 00:47:13 | u'rel': u'self'},
2019-01-08 00:47:13 | {u'href': u'http://192.168.24.1:8776/29a46f51dd42419d8d473133035b0ac5/volumes/f58ae72e-9348-4409-8973-46140a0f5c87',
2019-01-08 00:47:13 | u'rel': u'bookmark'}],
2019-01-08 00:47:13 | u'metadata': {},
2019-01-08 00:47:13 | u'multiattach': False,
2019-01-08 00:47:13 | u'name': u'tempest-TestMinimumBasicScenario-volume-1778231837',
2019-01-08 00:47:13 | u'os-vol-tenant-attr:tenant_id': u'29a46f51dd42419d8d473133035b0ac5',
2019-01-08 00:47:13 | u'replication_status': None,
2019-01-08 00:47:13 | u'size': 1,
2019-01-08 00:47:13 | u'snapshot_id': None,
2019-01-08 00:47:13 | u'source_volid': None,
2019-01-08 00:47:13 | u'status': u'available',
2019-01-08 00:47:13 | u'updated_at': u'2019-01-08T00:14:05.000000',
2019-01-08 00:47:13 | u'user_id': u'612aee3b36854909b896b7917fc99b22',
2019-01-08 00:47:13 | u'volume_type': u'tripleo'}
2019-01-08 00:47:13 | actual = {u'attachments': [],
2019-01-08 00:47:13 | u'availability_zone': u'nova',
2019-01-08 00:47:13 | u'bootable': u'false',
2019-01-08 00:47:13 | u'consistencygroup_id': None,
2019-01-08 00:47:13 | u'created_at': u'2019-01-08T00:14:00.000000',
2019-01-08 00:47:13 | u'description': None,
2019-01-08 00:47:13 | u'encrypted': False,
2019-01-08 00:47:13 | u'id': u'f58ae72e-9348-4409-8973-46140a0f5c87',
2019-01-08 00:47:13 | u'links': [{u'href': u'http://192.168.24.1:8776/v3/29a46f51dd42419d8d473133035b0ac5/volumes/f58ae72e-9348-4409-8973-46140a0f5c87',
2019-01-08 00:47:13 | u'rel': u'self'},
2019-01-08 00:47:13 | {u'href': u'http://192.168.24.1:8776/29a46f51dd42419d8d473133035b0ac5/volumes/f58ae72e-9348-4409-8973-46140a0f5c87',
2019-01-08 00:47:13 | u'rel': u'bookmark'}],
2019-01-08 00:47:13 | u'metadata': {},
2019-01-08 00:47:13 | u'multiattach': False,
2019-01-08 00:47:13 | u'name': u'tempest-TestMinimumBasicScenario-volume-1778231837',
2019-01-08 00:47:13 | u'os-vol-tenant-attr:tenant_id': u'29a46f51dd42419d8d473133035b0ac5',
2019-01-08 00:47:13 | u'replication_status': None,
2019-01-08 00:47:13 | u'size': 1,
2019-01-08 00:47:13 | u'snapshot_id': None,
2019-01-08 00:47:13 | u'source_volid': None,
2019-01-08 00:47:13 | u'status': u'available',
2019-01-08 00:47:13 | u'updated_at': u'2019-01-08T00:14:06.000000',
2019-01-08 00:47:13 | u'user_id': u'612aee3b36854909b896b7917fc99b22',
2019-01-08 00:47:13 | u'volume_type': u'tripleo'}

http://logs.openstack.org/13/619713/5/gate/tripleo-ci-centos-7-standalone/2db9fb6/logs/undercloud/home/zuul/tempest.log.txt.gz

Seen in https://review.openstack.org/#/c/619713/

[wes hayutin (weshayutin)]

http://logs.openstack.org/52/615552/9/check/tripleo-ci-centos-7-scenario003-standalone/092686e/logs/stackviz/#/testrepository.subunit/test-details/tempest.scenario.test_network_basic_ops.TestNetworkBasicOps.test_network_basic_ops

This is also seen in scen003

[Ronelle Landy (rlandy)]

Looking at http://logs.openstack.org/13/619713/6/check/tripleo-ci-centos-7-standalone/b181ed0/ - this is now passing.
tripleo-ci-centos-7-standalone is running cleanly in both check and gate now.

There is still a tempest failure on tripleo-ci-centos-7-scenario003-standalone but that is a different trace.

[Ronelle Landy (rlandy)]

Last results for tripleo-ci-centos-7-standalone:

| 2019-01-08 19:57 | | 94 min | | SUCCESS | | 594077,5 ? | | Logs | | master | | - | | check |
| 2019-01-08 19:30 | | 92 min | | SUCCESS | | 612948,11 ? | | Logs | | master | | - | | check |
| 2019-01-08 19:26 | | 96 min | | SUCCESS | | 629242,2 ? | | Logs | | master | | - | | check |
| 2019-01-08 19:25 | | 110 min | | SUCCESS | | 612371,4 ? | | Logs | | stable/rocky | | - | | gate |
| 2019-01-08 19:25 | | 109 min | | SUCCESS | | 612370,5 ? | | Logs | | stable/rocky | | - | | gate |
| 2019-01-08 19:25 | | 105 min | | SUCCESS | | 629246,1 ? | | Logs | | master | | - | | check |

Closing this and opening a bug for scen003 standalone failure