[BVT2] DHCP checker fails

[Vladimir Kozhukalov]

BVT job fails with the error

2016-09-02 05:41:17,122 - ERROR __init__.py:67 -- assert_task_success raised: AssertionError("Task 'verify_networks' has incorrect status. error != ready, 'DHCP discover check failed on node with ID=5. Check logs for details.\nDHCP discover check failed on node with ID=1. Check logs for details.\nDHCP discover check failed on node with ID=4. Check logs for details.\nDHCP discover check failed on node with ID=2. Check logs for details.\nDHCP discover check failed on node with ID=3. Check logs for details.\nDHCP discover check failed on node with ID=6. Check logs for details.'",)
Traceback: Traceback (most recent call last):
  File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/__init__.py", line 60, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/10.0.main.ubuntu.bvt_2/fuelweb_test/models/fuel_web_client.py", line 332, in assert_task_success
    task["name"], task['status'], 'ready', _message(task)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/asserts.py", line 55, in assert_equal
    raise ASSERTION_ERROR(message)
AssertionError: Task 'verify_networks' has incorrect status. error != ready, 'DHCP discover check failed on node with ID=5. Check logs for details.

In astute.log there are following lines

2016-09-01 14:00:29 DEBUG [14472] cb5b2178-2971-4d17-8131-27156e04b3a8: MC agent 'net_probe', method 'dhcp_discover', results:
{:sender=>"2",
 :statuscode=>0,
 :statusmsg=>"OK",
 :data=>
  {:err=>
    "Spawning listener for enp0s6 failed.\nSpawning listener for enp0s7 failed.\nSpawning listener for enp0s5 failed.\nNetwork for iface enp0s6 is down.Network for iface enp0s7 is down.
Network for iface enp0s5 is down.Iface enp0s6.102 does not exist.Iface enp0s7.960 does not exist.Iface enp0s5.101 does not exist.Network for iface enp0s6 is down.Network for iface enp0s
7 is down.Network for iface enp0s5 is down.Iface enp0s6.102 does not exist.Iface enp0s7.960 does not exist.Iface enp0s5.101 does not exist.Network for iface enp0s6 is down.Network for iface enp0s7 is down.Network for iface enp0s5 is down.Iface enp0s6.102 does not exist.Iface enp0s7.960 does not exist.Iface enp0s5.101 does not exist.",
   :out=>
    "[{\"iface\": \"enp0s3\", \"mac\": \"64:ed:8a:67:fb:cf\", \"server_ip\": \"10.109.0.2\", \"server_id\": \"10.109.0.2\", \"gateway\": \"0.0.0.0\", \"dport\": 67, \"message\": \"offer\", \"yiaddr\": \"10.109.0.6\"}]\n",
   :status=>0}}

[Vladimir Kozhukalov (kozhukalov)]

These patches revert those that caused the issue

https://review.openstack.org/#/c/364719/
https://review.openstack.org/#/c/364732/
https://review.openstack.org/#/c/364761/

[OpenStack Infra (hudson-openstack)]

Change abandoned by Vladimir Kozhukalov (<email address hidden>) on branch: master
Review: https://review.openstack.org/364719

[OpenStack Infra (hudson-openstack)]

Change abandoned by Vladimir Kozhukalov (<email address hidden>) on branch: master
Review: https://review.openstack.org/364732

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/364761
Committed: https://git.openstack.org/cgit/openstack/fuel-astute/commit/?id=db5ed8ba4964e487f9a469e0c3c9556c5f8e8bb4
Submitter: Jenkins
Branch: master

commit db5ed8ba4964e487f9a469e0c3c9556c5f8e8bb4
Author: Vladimir Kozhukalov <email address hidden>
Date: Fri Sep 2 08:28:31 2016 +0000

    Revert "Save error status if err data is present in dhcp checker response"

    This reverts commit d6a40e059011ee3ba3621560982ae473c1181ebe.
    Also, this change pins activesupport gem version used for ruby 2.1.5

    Change-Id: I4002b11fe7716a38ff2321643a8bad9af9de3fa0
    Closes-Bug: #1619621
    Signed-off-by: Maksim Malchuk <email address hidden>

[Maksym Strukov (unbelll)]

Still an issue:

https://product-ci.infra.mirantis.net/job/10.0.main.ubuntu.smoke_neutron/633/console
https://product-ci.infra.mirantis.net/job/10.0.main.ubuntu.bvt_2/637/console

[Maksim Malchuk (mmalchuk)]

The issue is fixed, it still failed on product ci due to the old iso with old package.
Please wait until the community bvt is passed and iso would be replaced.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/fuel-astute 10.0.0rc1 release candidate.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/fuel-astute 10.0.0 release.