zVM Cloud Connector

vmur error in get console output

Bug #1775149 reported by Huang Rui
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
zVM Cloud Connector
Triaged
Low
Unassigned

Bug Description

Error occurred when zcc getting guest console outputs:

2018-06-05 07:27:03.312 26308 ERROR nova.virt.zvm.utils [req-c4141e07-0fda-4533-9ef7-d495a45d6839 tempest-ServerActionsTestJSON-1112777961 tempest-ServerActionsTestJSON-1112777961] zVM Cloud Connector request guest_get_console_output failed with parameters: ('VPC0000e',) {} . Results: {u'rs': 408, u'overallRC': 4, u'modID': 1, u'rc': 4, u'output': u'', u'errmsg': u"Failed to get console log reader file list for guest vm: VPC0000e. SMUT error: SMUT request failed. RequestData: 'getvm VPC0000e consoleoutput', Results: '{'rs': 408, 'errno': 0, 'strError': '', 'overallRC': 4, 'rc': 4, 'response': ['(Error) ULTGVM0408E Error getting list of files in the reader to search for logs from user VPC0000E. Response from sudo /usr/sbin/vmur list is vmur: A concurrent instance of vmur is already active. No file processed.']}'"}
2018-06-05 07:27:03.475 26308 ERROR oslo_messaging.rpc.server [req-c4141e07-0fda-4533-9ef7-d495a45d6839 tempest-ServerActionsTestJSON-1112777961 tempest-ServerActionsTestJSON-1112777961] Exception during message handling: ZVMConnectorError: zVM Cloud Connector request failed: {u'rs': 408, u'overallRC': 4, u'modID': 1, u'rc': 4, u'output': u'', u'errmsg': u"Failed to get console log reader file list for guest vm: VPC0000e. SMUT error: SMUT request failed. RequestData: 'getvm VPC0000e consoleoutput', Results: '{'rs': 408, 'errno': 0, 'strError': '', 'overallRC': 4, 'rc': 4, 'response': ['(Error) ULTGVM0408E Error getting list of files in the reader to search for logs from user VPC0000E. Response from sudo /usr/sbin/vmur list is vmur: A concurrent instance of vmur is already active. No file processed.']}'"}
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server Traceback (most recent call last):
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 163, in _process_incoming
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message)
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 265, in dispatch
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args)
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 194, in _do_dispatch
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args)
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 226, in inner
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server return func(*args, **kwargs)
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/opt/stack/new/nova/nova/exception_wrapper.py", line 76, in wrapped
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server function_name, call_dict, binary)
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server self.force_reraise()
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/opt/stack/new/nova/nova/exception_wrapper.py", line 67, in wrapped
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw)
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/opt/stack/new/nova/nova/compute/manager.py", line 213, in decorated_function
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server kwargs['instance'], e, sys.exc_info())
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 220, in __exit__
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server self.force_reraise()
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/usr/local/lib/python2.7/dist-packages/oslo_utils/excutils.py", line 196, in force_reraise
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server six.reraise(self.type_, self.value, self.tb)
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/opt/stack/new/nova/nova/compute/manager.py", line 201, in decorated_function
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server return function(self, context, *args, **kwargs)
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/opt/stack/new/nova/nova/compute/manager.py", line 5018, in get_console_output
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server output = self.driver.get_console_output(context, instance)
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/opt/stack/new/nova/nova/virt/zvm/driver.py", line 404, in get_console_output
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server return self._hypervisor.guest_get_console_output(instance.name)
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/opt/stack/new/nova/nova/virt/zvm/hypervisor.py", line 151, in guest_get_console_output
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server return self._reqh.call('guest_get_console_output', name)
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server File "/opt/stack/new/nova/nova/virt/zvm/utils.py", line 66, in call
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server raise exception.ZVMConnectorError(results=results)
2018-06-05 07:27:03.475 ERROR oslo_messaging.rpc.server ZVMConnectorError: zVM Cloud Connector request failed: {u'rs': 408, u'overallRC': 4, u'modID': 1, u'rc': 4, u'output': u'', u'errmsg': u"Failed to get console log reader file list for guest vm: VPC0000e. SMUT error: SMUT request failed. RequestData: 'getvm VPC0000e consoleoutput', Results: '{'rs': 408, 'errno': 0, 'strError': '', 'overallRC': 4, 'rc': 4, 'response': ['(Error) ULTGVM0408E Error getting list of files in the reader to search for logs from user VPC0000E. Response from sudo /usr/sbin/vmur list is vmur: A concurrent instance of vmur is already active. No file processed.']}'"}

Revision history for this message
Huang Rui (bjhuangr) wrote :

The root cause is when zcc trying to get guest console via vmur, another vmur instance is running.

Changed in python-zvm-sdk:
status: New → Triaged
importance: Undecided → Low
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.