[9.1][PCE] Failed tasks: Task[upload_cirros/1]

Bug #1614090 reported by Ruslan Khozinov
14
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Invalid
High
vnaumov

Bug Description

Fuel version: 9.x snapshot #145

[ START Deploy cluster with vCenter and dvs plugin. ]

Configuration: 3 controllers, 1 compute + cinder, 1 cinder-vmware, 1 compute-vmware on Neutron/VLAN with DVS plugin

    Scenario:
        0. Setup master node
        1. Configuration releases
        2. Bootstrap slave and make snapshot
        3. Revert bootstrapped nodes
        4. Upload plugin to master node
        5. Install plugin to Fuel
        6. Create Fuel Environment
        7. Configure DVS plugin.
        8. Add nodes to environment
        9. Configure vCenter settings.
        10. Deploy environment
        11. Run health checker Sanity, Smoke and HA
FAIL: Deploy environment
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/home/jenkins/90-venv/local/lib/python2.7/site-packages/proboscis/case.py", line 296, in testng_method_mistake_capture_func
    compatability.capture_type_error(s_func)
  File "/home/jenkins/90-venv/local/lib/python2.7/site-packages/proboscis/compatability/exceptions_2_6.py", line 27, in capture_type_error
    func()
  File "/home/jenkins/90-venv/local/lib/python2.7/site-packages/proboscis/case.py", line 350, in func
    func(test_case.state.get_state())
  File "/home/jenkins/workspace/9.1.vcenter.vcenter_dvs_bvt/system_test/core/factory.py", line 37, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.1.vcenter.vcenter_dvs_bvt/system_test/helpers/decorators.py", line 40, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.1.vcenter.vcenter_dvs_bvt/system_test/actions/base.py", line 390, in deploy_cluster
    self.fuel_web.deploy_cluster_wait(self.cluster_id)
  File "/home/jenkins/workspace/9.1.vcenter.vcenter_dvs_bvt/fuelweb_test/helpers/decorators.py", line 457, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.1.vcenter.vcenter_dvs_bvt/fuelweb_test/helpers/decorators.py", line 442, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.1.vcenter.vcenter_dvs_bvt/fuelweb_test/helpers/decorators.py", line 493, in wrapper
    return func(*args, **kwargs)
  File "/home/jenkins/workspace/9.1.vcenter.vcenter_dvs_bvt/fuelweb_test/helpers/decorators.py", line 500, in wrapper
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.1.vcenter.vcenter_dvs_bvt/fuelweb_test/helpers/decorators.py", line 384, in wrapper
    return func(*args, **kwargs)
  File "/home/jenkins/workspace/9.1.vcenter.vcenter_dvs_bvt/fuelweb_test/models/fuel_web_client.py", line 927, in deploy_cluster_wait
    self.assert_task_success(task, interval=interval, timeout=timeout)
  File "/home/jenkins/workspace/9.1.vcenter.vcenter_dvs_bvt/fuelweb_test/__init__.py", line 60, in wrapped
    result = func(*args, **kwargs)
  File "/home/jenkins/workspace/9.1.vcenter.vcenter_dvs_bvt/fuelweb_test/models/fuel_web_client.py", line 331, in assert_task_success
    task["name"], task['status'], 'ready', _message(task)
AssertionError: Task 'deploy' has incorrect status. error != ready, 'Deployment has failed. All nodes are finished. Failed tasks: Task[upload_cirros/1] Stopping the deployment process!'

----------------------------------------------------------------------

Changed in fuel:
status: New → Confirmed
importance: Undecided → High
milestone: none → 9.2
Igor Zinovik (izinovik)
Changed in fuel:
assignee: Partner Centric Engineering (fuel-partner-engineering) → Igor Zinovik (izinovik)
Revision history for this message
Igor Zinovik (izinovik) wrote :

Diagnostic snapshot analysis revealed that there is an infrastructure problem:
NFS datastore is not available that is used by Glance backed (vmware_datastore).

Things goes this way:
openstack client tries to upload Cirros image into Glance.
Glance is configured with vmware_datastore (uses remote that is
available via vCenter server) as backend, but it cannot use it because
it is unavalable. Here is a snippet from glance-api.log

<147>Dec 27 23:16:47 node-1 glance-glare: 2016-12-27 23:16:47.309 23878 ERROR glance_store._drivers.vmware_datastore [-] Could not find datastore nfs in datacenter Datacenter
 <148>Dec 27 23:16:47 node-1 glance-glare: 2016-12-27 23:16:47.310 23878 WARNING glance_store.driver [-] Failed to configure store correctly: Store vmware_datastore could not be configured correctly. Reason: Could not find datastore nfs in

Possible hypothesises are network connectivity problems or NFS host is down.

Marking as invalid.

Changed in fuel:
status: Confirmed → Invalid
Changed in fuel:
assignee: Igor Zinovik (izinovik) → nobody
assignee: nobody → vnaumov (vnaumov-b)
status: Invalid → In Progress
Changed in fuel:
status: In Progress → Fix Committed
Changed in fuel:
status: Fix Committed → In Progress
Revision history for this message
Ruslan Khozinov (rkhozinov) wrote :

It's infra problem, not fuel

Changed in fuel:
status: In Progress → Invalid
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.