I checked again today(20210408T015657Z) and I still see the issue: sysinv 2021-04-08 17:40:06.274 920503 INFO sysinv.helm.utils [-] Caught HelmTillerFailure exception. Retrying... Exception: Helm operation failure: Failed to obtain pending charts list: Helm operation failure: Error: write tcp 172.16.166.148:52966->10.10.59.10:5432: write: broken pipe command terminated with exit code 1 sysinv 2021-04-08 17:40:06.691 920503 INFO sysinv.helm.utils [-] Caught HelmTillerFailure exception. Retrying... Exception: Helm operation failure: Failed to obtain pending charts list: Helm operation failure: Error: write tcp 172.16.166.148:55046->10.10.59.10:5432: write: broken pipe command terminated with exit code 1 sysinv 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app [-] Helm operation failure: Failed to obtain pending charts list: Helm operation failure: Error: write tcp 172.16.166.148:55046->10.10.59.10:5432: write: broken pipe command terminated with exit code 1 : HelmTillerFailure: Helm operation failure: Failed to obtain pending charts list: Helm operation failure: Error: write tcp 172.16.166.148:55046->10.10.59.10:5432: write: broken pipe command terminated with exit code 1 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app Traceback (most recent call last): 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 2294, in perform_app_apply 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app self.app_lifecycle_actions(None, None, rpc_app, lifecycle_hook_info_app_apply) 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/conductor/kube_app.py", line 1891, in app_lifecycle_actions 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app lifecycle_op.app_lifecycle_actions(context, conductor_obj, self, app, hook_info) 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/opt/platform/helm/21.05/stx-openstack/1.0-78-centos-stable-versioned/plugins/k8sapp_openstack/lifecycle/lifecycle_openstack.py", line 56, in app_lifecycle_actions 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app return self.pre_manifest_apply(app, app_op, hook_info) 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/opt/platform/helm/21.05/stx-openstack/1.0-78-centos-stable-versioned/plugins/k8sapp_openstack/lifecycle/lifecycle_openstack.py", line 144, in pre_manifest_apply 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app result = helm_utils.get_openstack_pending_install_charts() 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib/python2.7/site-packages/retrying.py", line 68, in wrapped_f 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app return Retrying(*dargs, **dkw).call(f, *args, **kw) 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib/python2.7/site-packages/retrying.py", line 229, in call 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app raise attempt.get() 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib/python2.7/site-packages/retrying.py", line 261, in get 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app six.reraise(self.value[0], self.value[1], self.value[2]) 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib/python2.7/site-packages/retrying.py", line 217, in call 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app attempt = Attempt(fn(*args, **kwargs), attempt_number, False) 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app File "/usr/lib64/python2.7/site-packages/sysinv/helm/utils.py", line 214, in get_openstack_pending_install_charts 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app reason="Failed to obtain pending charts list: %s" % e) 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app HelmTillerFailure: Helm operation failure: Failed to obtain pending charts list: Helm operation failure: Error: write tcp 172.16.166.148:55046->10.10.59.10:5432: write: broken pipe 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app command terminated with exit code 1 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app 2021-04-08 17:40:06.692 920503 ERROR sysinv.conductor.kube_app sysinv 2021-04-08 17:40:06.702 920503 INFO sysinv.conductor.kube_app [-] lifecycle hook for application stx-openstack (1.0-78-centos-stable-versioned) started {'lifecycle_type': u'manifest', 'relative_timing': u'post', 'mode': u'auto', 'operation': u'apply', 'extra': {'manifest_applied': False, 'was_applied': True}}. sysinv 2021-04-08 17:40:06.702 920503 INFO sysinv.conductor.kube_app [-] lifecycle hook for application stx-openstack (1.0-78-centos-stable-versioned) started {'lifecycle_type': u'rbd', 'relative_timing': u'post', 'mode': u'auto', 'operation': u'apply', 'extra': {'manifest_applied': False, 'was_applied': True}}. sysinv 2021-04-08 17:40:06.702 920503 INFO sysinv.conductor.kube_app [-] lifecycle hook for application stx-openstack (1.0-78-centos-stable-versioned) started {'lifecycle_type': u'resource', 'relative_timing': u'post', 'mode': u'auto', 'operation': u'apply', 'extra': {'manifest_applied': False, 'was_applied': True}}. sysinv 2021-04-08 17:40:06.952 920503 ERROR sysinv.conductor.kube_app [-] Application apply aborted!.: HelmTillerFailure: Helm operation failure: Failed to obtain pending charts list: Helm operation failure: Error: write tcp 172.16.166.148:55046->10.10.59.10:5432: write: broken pipe sysinv 2021-04-08 17:40:06.952 920503 INFO sysinv.conductor.kube_app [-] Deregister the abort status of app stx-openstack sysinv 2021-04-08 17:40:06.953 920503 INFO sysinv.conductor.kube_app [-] lifecycle hook for application stx-openstack (1.0-78-centos-stable-versioned) started {'lifecycle_type': u'operation', 'relative_timing': u'post', 'mode': u'auto', 'operation': u'apply', 'extra': {'app_applied': False, 'manifest_applied': False, 'was_applied': True}}. sysinv 2021-04-08 17:40:12.956 920503 INFO sysinv.openstack.common.rpc.common [-] Connected to AMQP server on 10.10.59.10:5672 [sysadmin@controller-1 ~(keystone_admin)]$