Tempest tests fail with "Multiple possible networks found" error

[Thierry Carrez]

Couldn't find an already-filed bug for this one (seen on milestone-proposed backport):

Tempest test runs sometimes fail with "NetworkAmbiguous" errors (Multiple possible networks found...)

2013-10-08 21:28:27.943 | tempest.thirdparty.boto.test_s3_objects.S3BucketsTest.test_create_get_delete_object[gate,smoke] ... ok
2013-10-08 21:28:27.981 | Error in atexit._run_exitfuncs:
2013-10-08 21:28:27.982 | Traceback (most recent call last):
2013-10-08 21:28:27.984 | File "/usr/lib/python2.7/atexit.py", line 24, in _run_exitfuncs
2013-10-08 21:28:27.985 | func(*targs, **kargs)
2013-10-08 21:28:27.986 | File "tempest/test.py", line 167, in validate_tearDownClass
2013-10-08 21:28:27.987 | + str(at_exit_set))
2013-10-08 21:28:27.988 | RuntimeError: tearDownClass does not calls the super's tearDownClass in these classes: set([<class 'tempest.scenario.test_network_basic_ops.TestNetworkBasicOps'>])
2013-10-08 21:28:27.989 | Error in sys.exitfunc:
2013-10-08 21:28:28.099 |
2013-10-08 21:28:28.100 | process-returncode
2013-10-08 21:28:28.100 | process-returncode ... FAIL
2013-10-08 21:28:28.537 |
2013-10-08 21:28:28.537 | ======================================================================
2013-10-08 21:28:28.538 | FAIL: tearDownClass (tempest.scenario.test_network_basic_ops.TestNetworkBasicOps)
2013-10-08 21:28:28.538 | tearDownClass (tempest.scenario.test_network_basic_ops.TestNetworkBasicOps)
2013-10-08 21:28:28.538 | ----------------------------------------------------------------------
2013-10-08 21:28:28.539 | _StringException: Traceback (most recent call last):
2013-10-08 21:28:28.539 | File "tempest/scenario/manager.py", line 239, in tearDownClass
2013-10-08 21:28:28.539 | thing.delete()
2013-10-08 21:28:28.540 | File "tempest/api/network/common.py", line 54, in delete
2013-10-08 21:28:28.540 | self.client.delete_network(self.id)
2013-10-08 21:28:28.540 | File "/opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py", line 112, in with_params
2013-10-08 21:28:28.540 | ret = self.function(instance, *args, **kwargs)
2013-10-08 21:28:28.541 | File "/opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py", line 354, in delete_network
2013-10-08 21:28:28.541 | return self.delete(self.network_path % (network))
2013-10-08 21:28:28.541 | File "/opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py", line 1233, in delete
2013-10-08 21:28:28.542 | headers=headers, params=params)
2013-10-08 21:28:28.542 | File "/opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py", line 1222, in retry_request
2013-10-08 21:28:28.543 | headers=headers, params=params)
2013-10-08 21:28:28.543 | File "/opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py", line 1165, in do_request
2013-10-08 21:28:28.543 | self._handle_fault_response(status_code, replybody)
2013-10-08 21:28:28.543 | File "/opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py", line 1135, in _handle_fault_response
2013-10-08 21:28:28.544 | exception_handler_v20(status_code, des_error_body)
2013-10-08 21:28:28.544 | File "/opt/stack/new/python-neutronclient/neutronclient/v2_0/client.py", line 85, in exception_handler_v20
2013-10-08 21:28:28.544 | message=error_dict)
2013-10-08 21:28:28.545 | NeutronClientException: Request Failed: internal server error while processing your request.
2013-10-08 21:28:28.545 |
2013-10-08 21:28:28.545 |
2013-10-08 21:28:28.546 | ======================================================================
2013-10-08 21:28:28.546 | FAIL: tempest.thirdparty.boto.test_ec2_instance_run.InstanceRunTest.test_run_idempotent_instances[gate,smoke]
2013-10-08 21:28:28.546 | tempest.thirdparty.boto.test_ec2_instance_run.InstanceRunTest.test_run_idempotent_instances[gate,smoke]
2013-10-08 21:28:28.546 | ----------------------------------------------------------------------
2013-10-08 21:28:28.547 | _StringException: Empty attachments:
2013-10-08 21:28:28.547 | stderr
2013-10-08 21:28:28.547 | stdout
2013-10-08 21:28:28.548 |
2013-10-08 21:28:28.548 | pythonlogging:'': {{{
2013-10-08 21:28:28.548 | 2013-10-08 21:27:45,619 400 Bad Request
2013-10-08 21:28:28.549 | 2013-10-08 21:27:45,619 <?xml version="1.0"?>
2013-10-08 21:28:28.549 | <Response><Errors><Error><Code>NetworkAmbiguous</Code><Message>Multiple possible networks found, use a Network ID to be more specific.</Message></Error></Errors><RequestID>req-f4f2c6d2-c16e-4444-a9ea-6be9b12a0864</RequestID></Response>
2013-10-08 21:28:28.549 | }}}
2013-10-08 21:28:28.549 |
2013-10-08 21:28:28.550 | Traceback (most recent call last):
2013-10-08 21:28:28.550 | File "tempest/thirdparty/boto/test_ec2_instance_run.py", line 110, in test_run_idempotent_instances
2013-10-08 21:28:28.550 | reservation_1, rcuk_1 = _run_instance('token_1')
2013-10-08 21:28:28.551 | File "tempest/thirdparty/boto/test_ec2_instance_run.py", line 100, in _run_instance
2013-10-08 21:28:28.551 | client_token=client_token)
2013-10-08 21:28:28.551 | File "tempest/services/botoclients.py", line 77, in func
2013-10-08 21:28:28.552 | return getattr(conn, name)(*args, **kwargs)
2013-10-08 21:28:28.552 | File "/usr/local/lib/python2.7/dist-packages/boto/ec2/connection.py", line 867, in run_instances
2013-10-08 21:28:28.552 | verb='POST')
2013-10-08 21:28:28.553 | File "/usr/local/lib/python2.7/dist-packages/boto/connection.py", line 1102, in get_object
2013-10-08 21:28:28.553 | raise self.ResponseError(response.status, response.reason, body)
2013-10-08 21:28:28.553 | EC2ResponseError: EC2ResponseError: 400 Bad Request
2013-10-08 21:28:28.553 | <?xml version="1.0"?>
2013-10-08 21:28:28.554 | <Response><Errors><Error><Code>NetworkAmbiguous</Code><Message>Multiple possible networks found, use a Network ID to be more specific.</Message></Error></Errors><RequestID>req-f4f2c6d2-c16e-4444-a9ea-6be9b12a0864</RequestID></Response>

[Conte (vd-fallout)]

I assume it is because create_test_server that is defined in BaseComputeTest (tempest/api/compute/base.py) is not configured to get the default network ID from config.
Guys in issue https://bugs.launchpad.net/tempest/+bug/1250866 have the same problem.
In setUpClass for BaseComputeTest tests should set the option of getting the ID of default network to be attached.
But this may break some other network related tests.

[Salvatore Orlando (salvatore-orlando)]

Since we have another bug filed for the same problem I would mark this as a duplicate.
Un-duplicate it if you feel it's different.

As stated by Conte, this could be as well an issue on the tempest side; I am considering that among the other options.
Conte - if you want to assign bug 1251448 to yourself go ahead as I won't be able to work on it until 2013-11-18 13:00UTC