lbaas is unreliable in the gate

Bug #1295165 reported by Sean Dague
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
neutron
Fix Released
Critical
Eugene Nikanorov
tempest
Invalid
Critical
Eugene Nikanorov

Bug Description

the lbaas service is quite unreliable in the gate, and causing a large number of gate resets.

http://logs.openstack.org/78/81778/1/check/check-tempest-dsvm-neutron/0a85d7c/console.html#_2014-03-20_13_43_58_324

TRACE & ERROR logs for this run here

http://logs.openstack.org/78/81778/1/check/check-tempest-dsvm-neutron/0a85d7c/logs/screen-q-lbaas.txt.gz?level=TRACE

regardless, the fact that lbaas is making lots of blind network namespace calls that are failing (and exploding) seems bad.

Sean Dague (sdague)
Changed in neutron:
importance: Undecided → Critical
Changed in neutron:
assignee: nobody → Eugene Nikanorov (enikanorov)
Aaron Rosen (arosen)
Changed in neutron:
status: New → Confirmed
affects: neutron → tempest
Changed in tempest:
status: Confirmed → In Progress
Revision history for this message
Aaron Rosen (arosen) wrote :

 I'm curious why this is done: https://github.com/openstack/neutron/blob/master/neutron/services/loadbalancer/drivers/common/agent_driver_base.py#L98 : Seems status is is PENDING_UPDATE when this is called. Raising here causes this failure.

Changed in neutron:
importance: Undecided → Critical
assignee: nobody → Eugene Nikanorov (enikanorov)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to tempest (master)

Reviewed: https://review.openstack.org/81831
Committed: https://git.openstack.org/cgit/openstack/tempest/commit/?id=c4aee3528ab9b2e7d29a163014292be6a08b31aa
Submitter: Jenkins
Branch: master

commit c4aee3528ab9b2e7d29a163014292be6a08b31aa
Author: Eugene Nikanorov <email address hidden>
Date: Thu Mar 20 18:17:00 2014 +0400

    Skip loadbalancer basic scenario test

    Change-Id: I5feeddba784d7ca568485b7c03a17883eff6cef9
    Partial-Bug: #1295165

Revision history for this message
Eugene Nikanorov (enikanorov) wrote :

The thing is that API tests for loadbalancer may cause different stack traces on the server side because API tests don't care about consistency on the agent or backend. And that is fine.

The real issue is with scenario test, which has some real connectivity problem test_client->floatingip->vip ip->haproxy

Revision history for this message
Eugene Nikanorov (enikanorov) wrote :
Changed in neutron:
status: New → Fix Committed
Thierry Carrez (ttx)
Changed in neutron:
milestone: none → icehouse-rc1
status: Fix Committed → Fix Released
Revision history for this message
Attila Fazekas (afazekas) wrote :

https://review.openstack.org/#/c/84542/ The fix is not confirmed.

Thierry Carrez (ttx)
Changed in neutron:
milestone: icehouse-rc1 → 2014.1
Matt Riedemann (mriedem)
Changed in tempest:
status: In Progress → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.