RGW not working with deployed ceph

[John Fulton]

After deploying my overcloud with deployed ceph [1] RGW does not work and attempting a new storage container fails with a 401:

 [CentOS-8 - stack@undercloud ~]$ openstack container create foo
Unauthorized (HTTP 401) (Request-ID: tx0000000000000000062d1-0061576efc-5f0c-default)
 [CentOS-8 - stack@undercloud ~]$

[1] https://docs.openstack.org/project-deploy-guide/tripleo-docs/latest/features/deployed_ceph.html

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/813208

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/tripleo-docs/+/813209

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-ansible/+/812230
Committed: https://opendev.org/openstack/tripleo-ansible/commit/cc47629712b2f1aea39adb5a8e60a7df1a714d99
Submitter: "Zuul (22348)"
Branch: master

commit cc47629712b2f1aea39adb5a8e60a7df1a714d99
Author: John Fulton <email address hidden>
Date: Fri Oct 1 21:37:10 2021 +0000

    Apply ceph_conf_overrides for non-deployed_ceph services

    When deployed_ceph is not used, all ceph_conf_overrides in
    cephadm-extra-vars-heat.yml are applied during the bootstrap
    process via cephadm's config assimilation. This might include
    overrides needed by services like RGW which is out of scope of
    deployed_ceph. When deployed_ceph is used, these configurations
    were not getting applied as they missed their chance during
    bootstrap which casued bug 1946253. Thus, add a new task to
    assimilate configuration not just during bootstrap but any
    time the tripleo_cephadm role is run.

    Rename tripleo_cephadm_{bootstrap,assimilation}_conf as
    it's used in assimilatiaon not just during bootstrap but
    also when new configurations are added (e.g. adding RGW
    to a deployed ceph cluster).

    Closes-Bug: #1946253
    Change-Id: Iac75ab454b3a5983f3a700f2e47d73706ec5b834

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/813208
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/42d74692136e889ca05c2169f44296ac2ab3bcf7
Submitter: "Zuul (22348)"
Branch: master

commit 42d74692136e889ca05c2169f44296ac2ab3bcf7
Author: John Fulton <email address hidden>
Date: Fri Oct 8 15:36:45 2021 +0000

    Introduce ApplyCephConfigOverridesOnUpdate

    Add ApplyCephConfigOverridesOnUpdate boolean which defaults
    to false. If this parameter is true, CephConfigOverrides are
    applied to the Ceph cluster not only during the initial
    deployment but also during each update.

    Related-Bug: #1946253
    Depends-On: Iac75ab454b3a5983f3a700f2e47d73706ec5b834
    Change-Id: I798cfc13df8f199326e2ea9275cf605e7cf961af

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-docs/+/813209
Committed: https://opendev.org/openstack/tripleo-docs/commit/ac118847042c339e2018b129d5e58457698b8b8f
Submitter: "Zuul (22348)"
Branch: master

commit ac118847042c339e2018b129d5e58457698b8b8f
Author: John Fulton <email address hidden>
Date: Fri Oct 8 15:38:10 2021 +0000

    Document ApplyCephConfigOverridesOnUpdate

    Explain what ApplyCephConfigOverridesOnUpdate is for and
    why it is used with "deployed ceph".

    Also, fix broken links to ceph documentation.

    Related-Bug: #1946253
    Depends-On: I798cfc13df8f199326e2ea9275cf605e7cf961af
    Change-Id: Ibf7d5746ec27bbb51947b63a1feaff8e5ad6f56d

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/tripleo-ansible/+/813765

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/813766

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-ansible/+/813765
Committed: https://opendev.org/openstack/tripleo-ansible/commit/a806e7d94cf24e95eedbb5da2fb315153760d7e5
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit a806e7d94cf24e95eedbb5da2fb315153760d7e5
Author: John Fulton <email address hidden>
Date: Fri Oct 1 21:37:10 2021 +0000

    Apply ceph_conf_overrides for non-deployed_ceph services

    When deployed_ceph is not used, all ceph_conf_overrides in
    cephadm-extra-vars-heat.yml are applied during the bootstrap
    process via cephadm's config assimilation. This might include
    overrides needed by services like RGW which is out of scope of
    deployed_ceph. When deployed_ceph is used, these configurations
    were not getting applied as they missed their chance during
    bootstrap which casued bug 1946253. Thus, add a new task to
    assimilate configuration not just during bootstrap but any
    time the tripleo_cephadm role is run.

    Rename tripleo_cephadm_{bootstrap,assimilation}_conf as
    it's used in assimilatiaon not just during bootstrap but
    also when new configurations are added (e.g. adding RGW
    to a deployed ceph cluster).

    Closes-Bug: #1946253
    Change-Id: Iac75ab454b3a5983f3a700f2e47d73706ec5b834
    (cherry picked from commit cc47629712b2f1aea39adb5a8e60a7df1a714d99)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/813766
Committed: https://opendev.org/openstack/tripleo-heat-templates/commit/aa076360754a712ccfd1719d179236290e893c43
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit aa076360754a712ccfd1719d179236290e893c43
Author: John Fulton <email address hidden>
Date: Fri Oct 8 15:36:45 2021 +0000

    Introduce ApplyCephConfigOverridesOnUpdate

    Add ApplyCephConfigOverridesOnUpdate boolean which defaults
    to false. If this parameter is true, CephConfigOverrides are
    applied to the Ceph cluster not only during the initial
    deployment but also during each update.

    Related-Bug: #1946253
    Depends-On: Iac75ab454b3a5983f3a700f2e47d73706ec5b834
    Change-Id: I798cfc13df8f199326e2ea9275cf605e7cf961af
    (cherry picked from commit 42d74692136e889ca05c2169f44296ac2ab3bcf7)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-ansible 4.2.0 release.