[Contrail 3.0] Some nova services have not been started

[Yevgeniy]

        Scenario:
            1. Create an environment with
               "Neutron with tunneling segmentation"
               as a network configuration and CEPH storage
            2. Enable and configure Contrail plugin
            3. Add some controller, compute + storage (at least 4) nodes
            4. Add a node with "contrail-db", "contarail-config" and
               "contrail-control" roles
            5. Deploy cluster
            6. Run OSTF tests
            7. Delete a compute node and deploy changes
            8. Run OSTF tests
            9. Add a node with "compute" role and deploy changes
            10. Run OSTF tests

Actual results:

2016-03-10 02:19:29,028 - INFO decorators.py:295 -- <<<<<****************************************************************************************************>>>>>
2016-03-10 02:19:29,028 - INFO decorators.py:296 -- Failed in method 'contrail_plugin_add_delete_compute_node'. Make snapshot: error_contrail_plugin_add_delete_compute_node
2016-03-10 02:19:29,029 - INFO decorators.py:306 -- You could revert and ssh to master node: [source /home/jenkins/70-venv/bin/activate; dos.py revert-resume 7.0.contrail.301 --snapshot-name error_contrail_plugin_add_delete_compute_node && ssh root@10.109.0.2]
2016-03-10 02:19:29,029 - INFO decorators.py:308 -- <<<<<****************************************************************************************************>>>>>
FAIL

======================================================================
FAIL: Verify that Compute node can be deleted and added after deploying
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/jenkins/70-venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/70-venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/70-venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/7.0.contrail.3.0.contrail_plugin_add_delete_compute_node.juniper/plugin_test/fuel-qa/fuelweb_test/helpers/decorators.py", line 80, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/7.0.contrail.3.0.contrail_plugin_add_delete_compute_node.juniper/plugin_test/tests/test_functional.py", line 149, in contrail_plugin_add_delete_compute_node
    is_vsrx=vsrx_setup_result)
  File "/home/jenkins/workspace/7.0.contrail.3.0.contrail_plugin_add_delete_compute_node.juniper/plugin_test/helpers/openstack.py", line 89, in update_deploy_check
    obj.fuel_web.run_ostf(cluster_id=obj.cluster_id)
  File "/home/jenkins/workspace/7.0.contrail.3.0.contrail_plugin_add_delete_compute_node.juniper/plugin_test/fuel-qa/fuelweb_test/__init__.py", line 58, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/7.0.contrail.3.0.contrail_plugin_add_delete_compute_node.juniper/plugin_test/fuel-qa/fuelweb_test/models/fuel_web_client.py", line 1147, in run_ostf
    failed_test_name=failed_test_name, test_sets=test_sets)
  File "/home/jenkins/workspace/7.0.contrail.3.0.contrail_plugin_add_delete_compute_node.juniper/plugin_test/fuel-qa/fuelweb_test/__init__.py", line 58, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/7.0.contrail.3.0.contrail_plugin_add_delete_compute_node.juniper/plugin_test/fuel-qa/fuelweb_test/models/fuel_web_client.py", line 259, in assert_ostf_run
    indent=1)))
AssertionError: Failed 1 OSTF tests; should fail 0 tests. Names of failed tests: [
 {
  "Check that required services are running (failure)": "Some nova services have not been started.. Please refer to OpenStack logs for more details."
 }
]

CI log: http://jenkins-tpi.bud.mirantis.net:8080/view/7.0.contrail.3.0/job/7.0.contrail.3.0.contrail_plugin_add_delete_compute_node.juniper/23/console

[Illia Polliul (ipolliul)]

This is a correct behavior. After deleting compute node it is not removed from Openstack database, so showing services on that node as down.