TestLoadBalancerBasic fails and leads to consequent tests failures

[Eugene Nikanorov]

Logstash query:

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOnRlbXBlc3Quc2NlbmFyaW8udGVzdF9sb2FkX2JhbGFuY2VyX2Jhc2ljLlRlc3RMb2FkQmFsYW5jZXJCYXNpYy50ZXN0X2xvYWRfYmFsYW5jZXJfYmFzaWMgQU5EIG1lc3NhZ2U6RkFJTEVEIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiI2MDQ4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxNDA3OTE1MTA0MTQwfQ==

[Salvatore Orlando (salvatore-orlando)]

This bug has two manifestations:

The first is caused appears as a "SSH connection failure" to the FIP associated with the VIP
The latter manifests as a mismatch [server1, server2] != [server1] [1]

But the root cause always appears to be [2]

[1] [2] http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwic2V0KFsnc2VydmVyMScsICdzZXJ2ZXIyJ10pICE9IHNldChbJ3NlcnZlcjEnXSlcIiIsImZpZWxkcyI6W10sIm9mZnNldCI6MCwidGltZWZyYW1lIjoiNjA0ODAwIiwiZ3JhcGhtb2RlIjoiY291bnQiLCJ0aW1lIjp7InVzZXJfaW50ZXJ2YWwiOjB9LCJzdGFtcCI6MTQwNzkxODQxNjkzOCwibW9kZSI6IiIsImFuYWx5emVfZmllbGQiOiIifQ==
[2] http://logs.openstack.org/54/113754/2/check/check-tempest-dsvm-neutron/5149396/logs/screen-q-lbaas.txt.gz?level=TRACE#_2014-08-13_06_39_27_792

[Salvatore Orlando (salvatore-orlando)]

As there is only a single gate failure at the moment is probably still too early to file an e-r query.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/113854

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/113854
Committed: https://git.openstack.org/cgit/openstack/neutron/commit/?id=65de01dcb1c49271ad1e5067d8dfd206788086d4
Submitter: Jenkins
Branch: master

commit 65de01dcb1c49271ad1e5067d8dfd206788086d4
Author: Eugene Nikanorov <email address hidden>
Date: Wed Aug 13 15:10:45 2014 +0400

    Reorder operations in create_vip

    Previously VIP's port creation was moved outside the transaction
    to avoid deadlocks related to rpc calls.
    It led to small chance of VIP being fetched by rpc code with
    port being still None.

    This patch reorders VIP association with the pool so it's done
    only after port has been created.

    This patch also leaves small possibility of uncaught exception in
    case of pool being concurrently deleted in the process of VIP creation

    Change-Id: I584558aecc92db4d19fb72b1d006868b840a4d8c
    Closes-Bug: #1356227