StarlingX

  1. Bug #1917308
  2. Comment #13

Comment 13 for bug 1917308

Revision history for this message
Alexandru Dimofte (adimofte) wrote :

I checked again today(20210408T015657Z) and I still see the issue:
sysinv 2021-04-08 17:40:06.274 920503 INFO sysinv.helm.utils [-] Caught HelmTillerFailure exception. Retrying... Exception: Helm operation failure: Failed to obtain pending charts list: Helm operation failure: Error: write tcp 172.16.166.148:52966->10.10.59.10:5432: write: broken pipe
command terminated with exit code 1
sysinv 2021-04-08 17:40:06.691 920503 INFO sysinv.helm.utils [-] Caught HelmTillerFailure exception. Retrying... Exception: Helm operation failure: Failed to obtain pending charts list: Helm operation failure: Error: write tcp 172.16.166.148:55046->10.10.59.10:5432: write: broken pipe
command terminated with exit code 1
sysinv 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app [-] Helm operation failure: Failed to obtain pending charts list: Helm operation failure: Error: write tcp 172.16.166.148:55046->10.10.59.10:5432: write: broken pipe
command terminated with exit code 1
: HelmTillerFailure: Helm operation failure: Failed to obtain pending charts list: Helm operation failure: Error: write tcp 172.16.166.148:55046->10.10.59.10:5432: write: broken pipe
command terminated with exit code 1
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app Traceback (most recent call last):
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 2294, in perform_app_apply
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app self.app_lifecycle_actions(None, None, rpc_app, lifecycle_hook_info_app_apply)
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 1891, in app_lifecycle_actions
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app lifecycle_op.app_lifecycle_actions(context, conductor_obj, self, app, hook_info)
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/opt/platform/helm/21.05/stx-openstack/1.0-78-centos-stable-versioned/plugins/k8sapp_openstack/lifecycle/lifecycle_openstack.py", line 56, in app_lifecycle_actions
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app return self.pre_manifest_apply(app, app_op, hook_info)
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/opt/platform/helm/21.05/stx-openstack/1.0-78-centos-stable-versioned/plugins/k8sapp_openstack/lifecycle/lifecycle_openstack.py", line 144, in pre_manifest_apply
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app result = helm_utils.get_openstack_pending_install_charts()
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib/python2.7/site-packages/retrying.py", line 68, in wrapped_f
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app return Retrying(*dargs, **dkw).call(f, *args, **kw)
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib/python2.7/site-packages/retrying.py", line 229, in call
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app raise attempt.get()
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib/python2.7/site-packages/retrying.py", line 261, in get
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app six.reraise(self.value[0], self.value[1], self.value[2])
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib/python2.7/site-packages/retrying.py", line 217, in call
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/helm/utils.py", line 214, in get_openstack_pending_install_charts
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app reason="Failed to obtain pending charts list: %s" % e)
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app HelmTillerFailure: Helm operation failure: Failed to obtain pending charts list: Helm operation failure: Error: write tcp 172.16.166.148:55046->10.10.59.10:5432: write: broken pipe
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app command terminated with exit code 1
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app
2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app
sysinv 2021-04-08 17:40:06.702 920503 INFO sysinv.conductor.kube_app [-] lifecycle hook for application stx-openstack (1.0-78-centos-stable-versioned) started {'lifecycle_type': u'manifest', 'relative_timing': u'post', 'mode': u'auto', 'operation': u'apply', 'extra': {'manifest_applied': False, 'was_applied': True}}.
sysinv 2021-04-08 17:40:06.702 920503 INFO sysinv.conductor.kube_app [-] lifecycle hook for application stx-openstack (1.0-78-centos-stable-versioned) started {'lifecycle_type': u'rbd', 'relative_timing': u'post', 'mode': u'auto', 'operation': u'apply', 'extra': {'manifest_applied': False, 'was_applied': True}}.
sysinv 2021-04-08 17:40:06.702 920503 INFO sysinv.conductor.kube_app [-] lifecycle hook for application stx-openstack (1.0-78-centos-stable-versioned) started {'lifecycle_type': u'resource', 'relative_timing': u'post', 'mode': u'auto', 'operation': u'apply', 'extra': {'manifest_applied': False, 'was_applied': True}}.
sysinv 2021-04-08 17:40:06.952 920503 ERROR sysinv.conductor.kube_app [-] Application apply aborted!.: HelmTillerFailure: Helm operation failure: Failed to obtain pending charts list: Helm operation failure: Error: write tcp 172.16.166.148:55046->10.10.59.10:5432: write: broken pipe
sysinv 2021-04-08 17:40:06.952 920503 INFO sysinv.conductor.kube_app [-] Deregister the abort status of app stx-openstack
sysinv 2021-04-08 17:40:06.953 920503 INFO sysinv.conductor.kube_app [-] lifecycle hook for application stx-openstack (1.0-78-centos-stable-versioned) started {'lifecycle_type': u'operation', 'relative_timing': u'post', 'mode': u'auto', 'operation': u'apply', 'extra': {'app_applied': False, 'manifest_applied': False, 'was_applied': True}}.
sysinv 2021-04-08 17:40:12.956 920503 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 10.10.59.10:5672
[sysadmin@controller-1 ~(keystone_admin)]$