Bonding in balance slb mode: no internet connectivity on compute node

Bug #1323261 reported by Andrey Sledzinskiy
12
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
High
Nastya Urlapova
5.0.x
Fix Committed
High
Nastya Urlapova

Bug Description

http://jenkins-product.srt.mirantis.net:8080/view/5.0_swarm/job/5.0_fuelmain.system_test.ubuntu.bonding/4/testReport/junit/%28root%29/deploy_bonding_balance_slb/deploy_bonding_balance_slb/

deploy_bonding_balance_slb test failed because there is no internet on compute node

Steps:
1. Create cluster
2. Add 1 node with controller role
3. Add 1 node with compute role
4. Setup bonding for all interfaces - balance-slb mode
5. Deploy the cluster
6. Run network verification
7. Run OSTF

OSTF failed on checking internet on compute node

Logs are attached

Revision history for this message
Andrey Sledzinskiy (asledzinskiy) wrote :
Mike Scherbakov (mihgen)
summary: - Bonding in balance slb node: no internet connectivity on compute node
+ Bonding in balance slb mode: no internet connectivity on compute node
Changed in fuel:
assignee: Fuel Library Team (fuel-library) → Fuel QA Team (fuel-qa)
status: New → Confirmed
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :

reproduce on latest 5.0 run

I fresh logs -look at the compute (node-2) Seems compute and ovs agent can not get connection to the rabbit
2014-06-23T19:38:14.794200+00:00 debug: 2014-06-23 19:38:10.279 18205 INFO neutron.openstack.common.rpc.common [req-5e550bfd-72cf-40a4-a36d-29f72e8e4695 None] Delaying reconnect for 5.0 seconds...
2014-06-23T19:38:24.802397+00:00 debug: 2014-06-23 19:38:18.292 18205 ERROR neutron.openstack.common.rpc.common [req-5e550bfd-72cf-40a4-a36d-29f72e8e4695 None] AMQP server on 10.108.27.2:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 11 seconds.
2014-06-23T19:38:34.803644+00:00 debug: 2014-06-23 19:38:29.303 18205 INFO neutron.openstack.common.rpc.common [req-5e550bfd-72cf-40a4-a36d-29f72e8e4695 None] Reconnecting to AMQP server on 10.108.27.2:5672
2014-06-23T19:38:34.803644+00:00 debug: 2014-06-23 19:38:29.304 18205 INFO neutron.openstack.common.rpc.common [req-5e550bfd-72cf-40a4-a36d-29f72e8e4695 None] Delaying reconnect for 5.0 seconds...
2014-06-23T19:38:44.812334+00:00 debug: 2014-06-23 19:38:37.333 18205 ERROR neutron.openstack.common.rpc.common [req-5e550bfd-72cf-40a4-a36d-29f72e8e4695 None] AMQP server on 10.108.27.2:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 13 seconds.
2014-06-23T19:38:54.818365+00:00 debug: 2014-06-23 19:38:50.343 18205 INFO neutron.openstack.common.rpc.common [req-5e550bfd-72cf-40a4-a36d-29f72e8e4695 None] Reconnecting to AMQP server on 10.108.27.2:5672
2014-06-23T19:38:54.818365+00:00 debug: 2014-06-23 19:38:50.343 18205 INFO neutron.openstack.common.rpc.common [req-5e550bfd-72cf-40a4-a36d-29f72e8e4695 None] Delaying reconnect for 5.0 seconds...
2014-06-23T19:39:04.827428+00:00 debug: 2014-06-23 19:38:58.377 18205 ERROR neutron.openstack.common.rpc.common [req-5e550bfd-72cf-40a4-a36d-29f72e8e4695 None] AMQP server on 10.108.27.2:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 15 seconds.
2014-06-23T19:39:14.837434+00:00 debug: 2014-06-23 19:39:13.391 18205 INFO neutron.openstack.common.rpc.common [req-5e550bfd-72cf-40a4-a36d-29f72e8e4695 None] Reconnecting to AMQP server on 10.108.27.2:5672
2014-06-23T19:39:14.837434+00:00 debug: 2014-06-23 19:39:13.392 18205 INFO neutron.openstack.common.rpc.common [req-5e550bfd-72cf-40a4-a36d-29f72e8e4695 None] Delaying reconnect for 5.0 seconds...
2014-06-23T19:39:24.842462+00:00 debug: 2014-06-23 19:39:21.425 18205 ERROR neutron.openstack.common.rpc.common [req-5e550bfd-72cf-40a4-a36d-29f72e8e4695 None] AMQP server on 10.108.27.2:5672 is unreachable: [Errno 113] EHOSTUNREACH. Trying again in 17 seconds.

Changed in fuel:
assignee: Fuel QA Team (fuel-qa) → Fuel Library Team (fuel-library)
Revision history for this message
Tatyanka (tatyana-leontovich) wrote :
Changed in fuel:
assignee: Fuel Library Team (fuel-library) → Fuel QA Team (fuel-qa)
Revision history for this message
Nastya Urlapova (aurlapova) wrote :

This issue is our fault, we don't properly configure networks for bonding.

Changed in fuel:
assignee: Fuel QA Team (fuel-qa) → Nastya Urlapova (aurlapova)
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (master)

Fix proposed to branch: master
Review: https://review.openstack.org/102874

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-main (master)

Change abandoned by Nastya Urlapova (<email address hidden>) on branch: master
Review: https://review.openstack.org/102874

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (master)

Fix proposed to branch: master
Review: https://review.openstack.org/102875

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-main (master)

Reviewed: https://review.openstack.org/102875
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=39754e7a27b89ce0f967fb9f5bd744a36616b563
Submitter: Jenkins
Branch: master

commit 39754e7a27b89ce0f967fb9f5bd744a36616b563
Author: NastyaUrlapova <email address hidden>
Date: Thu Jun 26 20:21:53 2014 +0400

    Fix for bonding tests

    Change-Id: Iac5f02569f6d934659d3907811e7aadada357f85
    Closes-Bug: #1323261

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (stable/5.0)

Fix proposed to branch: stable/5.0
Review: https://review.openstack.org/103308

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-main (stable/5.0)

Reviewed: https://review.openstack.org/103308
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=ad49fdf051baa28ba8377684da59f4ebd58103aa
Submitter: Jenkins
Branch: stable/5.0

commit ad49fdf051baa28ba8377684da59f4ebd58103aa
Author: NastyaUrlapova <email address hidden>
Date: Thu Jun 26 20:21:53 2014 +0400

    Fix for bonding tests

    Change-Id: Iac5f02569f6d934659d3907811e7aadada357f85
    Closes-Bug: #1323261

Changed in fuel:
importance: Critical → High
Revision history for this message
Dmitry Tyzhnenko (dtyzhnenko) wrote :

Verified on 5.1 iso 11

Changed in fuel:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.