stx-openstack apply fails on Debian - configmap "ceph-etc" not found

[Thales Elero Cervi]

Brief Description
-----------------
When trying to apply stx-openstack on Debian (k8s 1.24) for the first time, it was noticed that the ceph-etc configmap is missing in the kube-system namespace and therefore the application can not be applied.

Severity
--------
Critical: stx-openstack can not be applied

Steps to Reproduce
------------------
 * Upload stx-openstack application with system application-upload
 * Apply stx-openstack application with system application-apply

Expected Behavior
------------------
Application apply process should start.

Actual Behavior
----------------
Application apply is aborted.

Reproducibility
---------------
Reproducible

System Configuration
--------------------
AIO-SX

Branch/Pull Time/Commit
-----------------------
master:
* starlingx/master/debian/monolithic/20221128T070000Z

Last Pass
---------
N/A

Timestamp/Logs
--------------
sysinv 2022-11-29 12:00:45.139 70175 INFO sysinv.conductor.kube_app [-] Register the initial abort status of app stx-openstack
sysinv 2022-11-29 12:00:45.354 70175 INFO sysinv.conductor.kube_app [-] Application stx-openstack (1.0-1) apply started.
sysinv 2022-11-29 12:00:45.576 70175 INFO sysinv.conductor.kube_app [-] lifecycle hook for application stx-openstack (1.0-1) started {'mode': 'manual', 'lifecycle_type': 'resource', 'relative_timing': 'pre', 'oper
ation': 'apply', 'extra': {'was_applied': False}}.
sysinv 2022-11-29 12:00:45.578 70175 INFO sysinv.common.rest_api [-] GET cmd:http://192.168.204.1:5491/v1/query/ hdr:None payload:None
sysinv 2022-11-29 12:00:45.658 70175 INFO sysinv.helm.lifecycle_utils [-] Secret default-registry-key created under Namespace openstack.
sysinv 2022-11-29 12:00:45.694 70175 ERROR sysinv.common.kubernetes [-] Failed to copy ConfigMap ceph-etc from Namespace kube-system to Namespace openstack: (404)
Reason: Not Found
HTTP response headers: HTTPHeaderDict({'Audit-Id': '570cfbf3-', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': '5d09cfa7', 'X-Kubernetes-Pf-Prioritylevel-Uid': '653228ac-', 'Date': 'Tue, 29 Nov 2022 12:00:45 GMT', 'Content-Length': '196'})
HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"configmaps \"ceph-etc\" not found","reason":"NotFound","details":{"name":"ceph-etc","kind":"configmaps"},"code":40
4}

2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp During handling of the above exception, another exception occurred:
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp Traceback (most recent call last):
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp File "/usr/lib/python3/dist-packages/sysinv/openstack/common/rpc/amqp.py", line 435, in _process_data
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp rval = self.proxy.dispatch(ctxt, version, method, namespace,
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp File "/usr/lib/python3/dist-packages/sysinv/openstack/common/rpc/dispatcher.py", line 172, in dispatch
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp result = getattr(proxyobj, method)(ctxt, **kwargs)
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp File "/usr/lib/python3/dist-packages/sysinv/conductor/manager.py", line 14186, in perform_app_apply
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp app_applied = self._app.perform_app_apply(rpc_app, mode, lifecycle_hook_info_app_apply)
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp File "/usr/lib/python3/dist-packages/sysinv/conductor/kube_app.py", line 2935, in perform_app_apply
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp raise exception.KubeAppApplyFailure(
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp sysinv.common.exception.KubeAppApplyFailure: Deployment of application stx-openstack (1.0-1) failed: (404)
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp Reason: Not Found
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp HTTP response headers: HTTPHeaderDict({'Audit-Id': '570cfbf3-', 'Cache-Control': 'no-cache, private', 'Content-Type': 'application/json', 'X-Kubernetes-Pf-Flowschema-Uid': '5d09cfa7-', 'X-Kubernetes-Pf-Prioritylevel-Uid': '653228ac-', 'Date': 'Tue, 29 Nov 2022 12:00:45 GMT',
'Content-Length': '196'})
2022-11-29 12:00:45.924 70175 ERROR sysinv.openstack.common.rpc.amqp HTTP response body: {"kind":"Status","apiVersion":"v1","metadata":{},"status":"Failure","message":"configmaps \"ceph-etc\" not found","reason":"NotFound","details":{"name":"ceph-etc","kind":"configmaps"},"code":404}

Test Activity
-------------
Developer Testing

Workaround
----------
None

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/starlingx/openstack-armada-app/+/866160

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/starlingx/openstack-armada-app/+/866160
Committed: https://opendev.org/starlingx/openstack-armada-app/commit/b9f0f0ff7989c40a1ebffdb5bca2fcd4aa9f5aea
Submitter: "Zuul (22348)"
Branch: master

commit b9f0f0ff7989c40a1ebffdb5bca2fcd4aa9f5aea
Author: Rafael Falcao <email address hidden>
Date: Wed Nov 30 10:18:00 2022 -0300

    Copy ceph-etc through ceph-etc-pools-audit

    In latest versions of the platform-integ-apps app the
    current provisioner has been changed to ceph-csi [1].
    In this provisioner the ceph-etc ConfigMap no longer
    exists. In order to create the ceph-etc in the openstack
    namespace we now use the ceph-etc-pools-audit ConfigMap.
    A storyboard has been created [2] in order to keep track
    of the adaptation that needs to take place to make use of
    the correct ceph resources.

    Test Plan:
    PASS - Build stx-openstack tarball.
    PASS - Upload stx-openstack.
    PASS - Apply stx-openstack and check that the ceph-etc
           ConfigMap has been successfully created.

    Closes-Bug: 1998230

    [1] - https://review.opendev.org/c/starlingx/platform-armada-app/+/858737
    [2] - https://storyboard.openstack.org/#!/story/2010456

    Signed-off-by: Rafael Falcao <email address hidden>
    Change-Id: I52a5ded7fcc14a1aafd6eee0c92e1db29dba52e1