tempest test tempest.scenario.test_minimum_basic.TestMinimumBasicScenario.test_minimum_basic_scenario fails because floating IPs don't match. 10.0.0.0 networks is from network isolation jobs, doesn't match 192.168.24.0 (from non network isolation).
https://logs.rdoproject.org/openstack-periodic/periodic-tripleo-ci-centos-7-ovb-1ctlr_1comp-featureset020-master/e86a214/undercloud/home/jenkins/tempest_output.log.txt.gz#_2018-02-05_22_10_31
tempest.scenario.test_minimum_basic.TestMinimumBasicScenario.test_minimum_basic_scenario[compute,id-bdbb5441-9204-419d-a225-b4fdbfb1a1a8,image,network,volume]
2018-02-05 22:10:31 | --------------------------------------------------------------------------------------------------------------------------------------------------------------
2018-02-05 22:10:31 |
2018-02-05 22:10:31 | Captured traceback:
2018-02-05 22:10:31 | ~~~~~~~~~~~~~~~~~~~
2018-02-05 22:10:31 | Traceback (most recent call last):
2018-02-05 22:10:31 | File "/usr/lib/python2.7/site-packages/tempest/common/utils/__init__.py", line 88, in wrapper
2018-02-05 22:10:31 | return f(*func_args, **func_kwargs)
2018-02-05 22:10:31 | File "/usr/lib/python2.7/site-packages/tempest/scenario/test_minimum_basic.py", line 135, in test_minimum_basic_scenario
2018-02-05 22:10:31 | (floating_ip['ip'], server['addresses']))
2018-02-05 22:10:31 | File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 374, in assertIsNotNone
2018-02-05 22:10:31 | self.assertThat(observed, matcher, message)
2018-02-05 22:10:31 | File "/usr/lib/python2.7/site-packages/testtools/testcase.py", line 435, in assertThat
2018-02-05 22:10:31 | raise mismatch_error
2018-02-05 22:10:31 | testtools.matchers._impl.MismatchError: None matches Is(None): Failed to find floating IP '192.168.24.102' in server addresses: {u'tempest-TestMinimumBasicScenario-778423294-network': [{u'OS-EXT-IPS-MAC:mac_addr': u'fa:16:3e:0d:ef:e6', u'version': 4, u'addr': u'10.100.0.11', u'OS-EXT-IPS:type': u'fixed'}]}
openstack-