deployment cluster with example plugin failed with "Error unhashable type"

[Artem Hrechanychenko]

Detailed bug description:
 Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 331, in run
    testMethod()
  File "/usr/lib/python2.7/unittest/case.py", line 1043, in runTest
    self._testFunc()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/9.0.system_test.ubuntu.plugins.fuel_plugin_example/fuelweb_test/helpers/decorators.py", line 120, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.0.system_test.ubuntu.plugins.fuel_plugin_example/fuelweb_test/tests/plugins/plugin_example/test_fuel_plugin_example.py", line 188, in deploy_ha_one_controller_neutron_example_v3
    self.fuel_web.deploy_cluster_wait(cluster_id)
  File "/home/jenkins/workspace/9.0.system_test.ubuntu.plugins.fuel_plugin_example/fuelweb_test/helpers/decorators.py", line 455, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.0.system_test.ubuntu.plugins.fuel_plugin_example/fuelweb_test/helpers/decorators.py", line 440, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.0.system_test.ubuntu.plugins.fuel_plugin_example/fuelweb_test/helpers/decorators.py", line 491, in wrapper
    return func(*args, **kwargs)
  File "/home/jenkins/workspace/9.0.system_test.ubuntu.plugins.fuel_plugin_example/fuelweb_test/helpers/decorators.py", line 498, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.0.system_test.ubuntu.plugins.fuel_plugin_example/fuelweb_test/helpers/decorators.py", line 382, in wrapper
    return func(*args, **kwargs)
  File "/home/jenkins/workspace/9.0.system_test.ubuntu.plugins.fuel_plugin_example/fuelweb_test/models/fuel_web_client.py", line 817, in deploy_cluster_wait
    self.assert_task_success(task, interval=interval, timeout=timeout)
  File "/home/jenkins/workspace/9.0.system_test.ubuntu.plugins.fuel_plugin_example/fuelweb_test/__init__.py", line 59, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.0.system_test.ubuntu.plugins.fuel_plugin_example/fuelweb_test/models/fuel_web_client.py", line 319, in assert_task_success
    task["name"], task['status'], 'ready', _message(task)
  File "/home/jenkins/venv-nailgun-tests-2.9/local/lib/python2.7/site-packages/proboscis/asserts.py", line 55, in assert_equal
    raise ASSERTION_ERROR(message)
AssertionError: Task 'deploy' has incorrect status. error != ready, 'unhashable type'

Steps to reproduce:

    1)Upload plugin to the master node
    2)Install plugin
    3)Create cluster
    4)Add 1 node with controller role
    5)Add 1 node with compute role
    6)Add 1 node with custom role
    7)Deploy the cluster <<<<<<<failed here
    8)Run network verification
    9)Check plugin health
    10)Run OSTF

Expected results:
 deployment finished without errors

Actual result:
 Task 'deploy' has incorrect status. error != ready, 'unhashable type'

Reproducibility:
 https://product-ci.infra.mirantis.net/job/9.0.system_test.ubuntu.plugins.fuel_plugin_example/78/testReport/%28root%29/deploy_ha_one_controller_neutron_example_v3/deploy_ha_one_controller_neutron_example_v3/
Workaround:
 -
Impact:
 swarm test
Description of the environment:
 cat /etc/fuel_build_id:
 201
cat /etc/fuel_build_number:
 201
cat /etc/fuel_release:
 9.0
cat /etc/fuel_openstack_version:
 mitaka-9.0
rpm -qa | egrep 'fuel|astute|network-checker|nailgun|packetary|shotgun':
 fuel_plugin_example_v3-3.0-3.0.0-1.noarch
 fuel-release-9.0.0-1.mos6333.noarch
 fuel-misc-9.0.0-1.mos8294.noarch
 python-packetary-9.0.0-1.mos131.noarch
 fuel-openstack-metadata-9.0.0-1.mos8650.noarch
 fuel-provisioning-scripts-9.0.0-1.mos8650.noarch
 python-fuelclient-9.0.0-1.mos306.noarch
 fuel-9.0.0-1.mos6333.noarch
 fuel-nailgun-9.0.0-1.mos8650.noarch
 rubygem-astute-9.0.0-1.mos738.noarch
 fuel-library9.0-9.0.0-1.mos8294.noarch
 fuel-agent-9.0.0-1.mos272.noarch
 fuel-ui-9.0.0-1.mos2659.noarch
 fuel-setup-9.0.0-1.mos6333.noarch
 nailgun-mcagents-9.0.0-1.mos738.noarch
 shotgun-9.0.0-1.mos87.noarch
 network-checker-9.0.0-1.mos72.x86_64
 fuel-bootstrap-cli-9.0.0-1.mos272.noarch
 fuel-migrate-9.0.0-1.mos8294.noarch
 fuelmenu-9.0.0-1.mos268.noarch
 fuel-notify-9.0.0-1.mos8294.noarch
 fuel-ostf-9.0.0-1.mos924.noarch
 fuel-mirror-9.0.0-1.mos131.noarch
 fuel-utils-9.0.0-1.mos8294.noarch

[Artem Hrechanychenko (agrechanichenko)]

also failed with same error - https://product-ci.infra.mirantis.net/job/9.0.system_test.ubuntu.fuel_plugin_reboot/78/testReport/%28root%29/deploy_cluster_with_reboot_plugin/deploy_cluster_with_reboot_plugin/

[Artem Hrechanychenko (agrechanichenko)]

also failed
https://product-ci.infra.mirantis.net/job/9.0.system_test.ubuntu.fuel_plugin_vip_reservation/78/testReport/%28root%29/vip_reservation_for_plugin_haproxy_ns/
https://product-ci.infra.mirantis.net/job/9.0.system_test.ubuntu.fuel_plugin_vip_reservation/78/testReport/%28root%29/vip_reservation_for_plugin/vip_reservation_for_plugin/

[Dmitry Pyzhov (dpyzhov)]

Please check current list of swarm blockers before creation of one more duplicate of existing bug.
https://bugs.launchpad.net/fuel/+bug/1569807
https://bugs.launchpad.net/fuel/+bug/1569764
https://bugs.launchpad.net/fuel/+bug/1569778