Deployment hangs if conection is lost on admin network (image-based provisioning)

[Kirill Omelchenko]

Scenario:

1. Create a cluster (configurattion doesn't matter)
2. Start the deployment process
3. During provision simulate connection lose on on of the nodes' admin-net nic.

Expected:
Provisioning fails and relevant error is shown on the affected node and on the UI (CLI)

Actual:
Provisioning hangs.
Affected node shows that it has been provisioned successfully with only difference, it has no

'ext4-fs (dm-0): mounted filesystem with ordered data mode'

it shows right away (on connection lose) the one which usually follows the above one:

'md: md0: rsync done.'

UPD: Later on the cluster deployment fails with an erro of Timeout, but all the nodes get marked as offline, which they are not.

[Alexander Gordeev (a-gordeev)]

will be addressed by https://blueprints.launchpad.net/fuel/+spec/ibp-reconnect

[Bartłomiej Piotrowski (bpiotrowski)]

IIRC IBP is an experimental issue, so we won't fix it in 6.0.1, sorry.

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: stable/6.0
Review: https://review.openstack.org/161721

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/6.0
Review: https://review.openstack.org/161722

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/160787
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=21c929d576c2159e886d32bd1d01142ab4c2e335
Submitter: Jenkins
Branch: master

commit 21c929d576c2159e886d32bd1d01142ab4c2e335
Author: Alexander Gordeev <email address hidden>
Date: Tue Mar 3 16:19:18 2015 +0300

    IBP: Add python-urllib3 to fuel-agent rpm spec

    In order to handle network errors correctly, python-urllib3 package
    should be added to dependencies.

    Fuel-agent relies on a recent version of python-requests (1.2.3),
    which's known for raising exceptions from urllib3 library.

    Partially implements: blueprint ibp-reconnect

    Related-Bug: #1389120
    Change-Id: I29495e03c3ad7c2697d554265b1b9c299187d875

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/161722
Committed: https://git.openstack.org/cgit/stackforge/fuel-web/commit/?id=c3cb6625de2ed1a482569c9369697d7c46810415
Submitter: Jenkins
Branch: stable/6.0

commit c3cb6625de2ed1a482569c9369697d7c46810415
Author: Alexander Gordeev <email address hidden>
Date: Wed Feb 18 21:06:45 2015 +0300

    [IBP] Add http connection tracking to fuel-agent

    Fuel-agent should handle networking issues and HTTP errors properly.

    Implements: blueprint ibp-reconnect
    Depends on: I29495e03c3ad7c2697d554265b1b9c299187d875
    Closes-Bug: #1389120
    Change-Id: I31ada444aa143a6d25851fd3a4c98243ed58f870

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/161721
Committed: https://git.openstack.org/cgit/stackforge/fuel-main/commit/?id=c205c6e658bbe3e130c981d41afb44d276c27e5c
Submitter: Jenkins
Branch: stable/6.0

commit c205c6e658bbe3e130c981d41afb44d276c27e5c
Author: Alexander Gordeev <email address hidden>
Date: Tue Mar 3 16:19:18 2015 +0300

    IBP: Add python-urllib3 to fuel-agent rpm spec

    In order to handle network errors correctly, python-urllib3 package
    should be added to dependencies.

    Fuel-agent relies on a recent version of python-requests (1.2.3),
    which's known for raising exceptions from urllib3 library.

    Partially implements: blueprint ibp-reconnect

    Related-Bug: #1389120
    Change-Id: I29495e03c3ad7c2697d554265b1b9c299187d875

[Vitaly Sedelnik (vsedelnik)]

Won't Fix for 6.0-updates as we don't expect new 6.0 deployments and IBP is not relevant for 6.0