Activity log for bug #1989538

Date Who What changed Old value New value Message
2022-09-14 06:01:40 JamesLin bug added bug
2022-09-14 10:19:11 Alex Kavanagh charm-keystone: status New Triaged
2022-09-14 10:19:16 Alex Kavanagh charm-keystone: importance Undecided Critical
2022-09-14 10:19:19 Alex Kavanagh charm-keystone: assignee Alex Kavanagh (ajkavanagh)
2022-09-14 15:33:52 OpenStack Infra charm-keystone: status Triaged In Progress
2022-09-14 19:12:29 OpenStack Infra charm-keystone: status In Progress Fix Committed
2022-10-04 19:32:36 Corey Bryant bug task added charm-heat
2022-10-04 19:32:44 Corey Bryant bug task added charm-glance
2022-10-04 19:32:53 Corey Bryant bug task added charm-neutron-api
2022-10-04 19:33:03 Corey Bryant bug task added charm-nova-cloud-controller
2022-10-04 19:33:09 Corey Bryant charm-glance: status New Triaged
2022-10-04 19:33:12 Corey Bryant charm-heat: status New Triaged
2022-10-04 19:33:13 Corey Bryant charm-neutron-api: status New Triaged
2022-10-04 19:33:15 Corey Bryant charm-nova-cloud-controller: status New Triaged
2022-10-04 19:33:18 Corey Bryant charm-nova-cloud-controller: importance Undecided Critical
2022-10-04 19:33:20 Corey Bryant charm-neutron-api: importance Undecided Critical
2022-10-04 19:33:21 Corey Bryant charm-heat: importance Undecided Critical
2022-10-04 19:33:22 Corey Bryant charm-glance: importance Undecided Critical
2022-10-04 19:36:54 Corey Bryant summary keystone bootstrap fail on latest/edge prevent unnecessary config-changed hook openstack-upgrade on initial install (was: keystone bootstrap fail on latest/edge)
2022-10-04 19:37:14 Corey Bryant summary prevent unnecessary config-changed hook openstack-upgrade on initial install (was: keystone bootstrap fail on latest/edge) prevent unnecessary openstack-upgrade on initial install (was: keystone bootstrap fail on latest/edge)
2022-10-04 19:37:51 OpenStack Infra charm-nova-cloud-controller: status Triaged In Progress
2022-10-04 19:38:05 OpenStack Infra charm-neutron-api: status Triaged In Progress
2022-10-04 19:38:22 OpenStack Infra charm-glance: status Triaged In Progress
2022-10-04 19:38:33 OpenStack Infra charm-heat: status Triaged In Progress
2022-10-04 19:41:02 Corey Bryant description Keystone bootstrap failure when deploy this bundle: ``` local_overlay_enabled: False series: jammy applications: keystone-mysql-router: charm: ch:mysql-router channel: latest/edge vault-mysql-router: charm: ch:mysql-router channel: latest/edge mysql-innodb-cluster: channel: latest/edge charm: ch:mysql-innodb-cluster num_units: 3 keystone: charm: ch:keystone num_units: 1 channel: latest/edge vault: charm: ch:vault num_units: 1 channel: latest/edge relations: - - vault:certificates - mysql-innodb-cluster:certificates - - vault:certificates - keystone:certificates - - keystone:shared-db - keystone-mysql-router:shared-db - - vault:shared-db - vault-mysql-router:shared-db - - keystone-mysql-router:db-router - mysql-innodb-cluster:db-router - - vault-mysql-router:db-router - mysql-innodb-cluster:db-router ``` Error msg: ``` unit.keystone/0.config-changed logger.go:60 raise CalledProcessError(retcode, cmd) 2022-09-12 01:54:16 WARNING unit.keystone/0.config-changed logger.go:60 subprocess.CalledProcessError: Command '('keystone-manage', 'bootstrap', '--bootstrap-username', '_charm-keystone-admin', '--bootstrap-password', 'RfGNgwLSwVtBPx6dTZ8LpWHm6F3rL9HSC8Cz38tFKFFL7FJRYfNVzjgfqPXxXjHd', '--bootstrap-project-name', 'admin', '--bootstrap-role-name', 'Admin', '--bootstrap-service-name', 'keystone', '--bootstrap-admin-url', 'http://10.5.1.103:35357/v3', '--bootstrap-public-url', 'http://10.5.1.103:5000/v3', '--bootstrap-internal-url', 'http://10.5.1.103:5000/v3', '--bootstrap-region-id', 'RegionOne')' returned non-zero exit status 1 ``` In root: ``` root@juju-39d662-zaza-86e9ebd11c76-0:/home/ubuntu# keystone-manage bootstrap --bootstrap-username _charm-keystone-admin --bootstrap-password RfGNgwLSwVtBPx6dTZ8LpWHm6F3rL9HSC8Cz38tFKFFL7FJRYfNVzjgfqPXxXjHd --bootstrap-project-name admin --bootstrap-role-name Admin --bootstrap-service-name keystone --bootstrap-admin-url http://10.5.1.103:35357/v3 --bootstrap-public-url 'http://10.5.1.103:5000/v3 --bootstrap-internal-url 'http://10.5.1.103:5000/v3 --bootstrap-region-id RegionOne /etc/keystone/fernet-keys/ does not contain keys, use keystone-manage fernet_setup to create Fernet keys. ``` The `key-setup` file didn't exist at `/etc/keystone/`. So this bug is because the keystone bootstrap fire before `key_setup()` keystone is working fine at yoga/stable & focal series == keystone == Keystone bootstrap failure when deploy this bundle: ``` local_overlay_enabled: False series: jammy applications:   keystone-mysql-router:     charm: ch:mysql-router     channel: latest/edge   vault-mysql-router:     charm: ch:mysql-router     channel: latest/edge   mysql-innodb-cluster:     channel: latest/edge     charm: ch:mysql-innodb-cluster     num_units: 3   keystone:     charm: ch:keystone     num_units: 1     channel: latest/edge   vault:     charm: ch:vault     num_units: 1     channel: latest/edge relations:   - - vault:certificates     - mysql-innodb-cluster:certificates   - - vault:certificates     - keystone:certificates   - - keystone:shared-db     - keystone-mysql-router:shared-db   - - vault:shared-db     - vault-mysql-router:shared-db   - - keystone-mysql-router:db-router     - mysql-innodb-cluster:db-router   - - vault-mysql-router:db-router     - mysql-innodb-cluster:db-router ``` Error msg: ``` unit.keystone/0.config-changed logger.go:60 raise CalledProcessError(retcode, cmd) 2022-09-12 01:54:16 WARNING unit.keystone/0.config-changed logger.go:60 subprocess.CalledProcessError: Command '('keystone-manage', 'bootstrap', '--bootstrap-username', '_charm-keystone-admin', '--bootstrap-password', 'RfGNgwLSwVtBPx6dTZ8LpWHm6F3rL9HSC8Cz38tFKFFL7FJRYfNVzjgfqPXxXjHd', '--bootstrap-project-name', 'admin', '--bootstrap-role-name', 'Admin', '--bootstrap-service-name', 'keystone', '--bootstrap-admin-url', 'http://10.5.1.103:35357/v3', '--bootstrap-public-url', 'http://10.5.1.103:5000/v3', '--bootstrap-internal-url', 'http://10.5.1.103:5000/v3', '--bootstrap-region-id', 'RegionOne')' returned non-zero exit status 1 ``` In root: ``` root@juju-39d662-zaza-86e9ebd11c76-0:/home/ubuntu# keystone-manage bootstrap --bootstrap-username _charm-keystone-admin --bootstrap-password RfGNgwLSwVtBPx6dTZ8LpWHm6F3rL9HSC8Cz38tFKFFL7FJRYfNVzjgfqPXxXjHd --bootstrap-project-name admin --bootstrap-role-name Admin --bootstrap-service-name keystone --bootstrap-admin-url http://10.5.1.103:35357/v3 --bootstrap-public-url 'http://10.5.1.103:5000/v3 --bootstrap-internal-url 'http://10.5.1.103:5000/v3 --bootstrap-region-id RegionOne /etc/keystone/fernet-keys/ does not contain keys, use keystone-manage fernet_setup to create Fernet keys. ``` The `key-setup` file didn't exist at `/etc/keystone/`. So this bug is because the keystone bootstrap fire before `key_setup()` keystone is working fine at yoga/stable & focal series == heat, neutron-api, glance, nova-cloud-controller == For these charms, deploys on jammy-zed from latest/edge were failing with config-changed hook failures running db sync commands prior to database config being rendered in config files such as heat.conf.
2022-10-05 11:55:34 OpenStack Infra charm-heat: status In Progress Fix Committed
2022-10-05 11:55:53 OpenStack Infra charm-neutron-api: status In Progress Fix Committed
2022-10-05 11:56:01 OpenStack Infra charm-nova-cloud-controller: status In Progress Fix Committed
2022-10-05 12:11:05 Felipe Reyes charm-neutron-api: assignee Corey Bryant (corey.bryant)
2022-10-05 12:11:21 Felipe Reyes charm-nova-cloud-controller: assignee Corey Bryant (corey.bryant)
2022-10-05 12:11:32 Felipe Reyes charm-heat: assignee Corey Bryant (corey.bryant)
2022-10-05 14:44:11 Corey Bryant bug task added charm-cinder
2022-10-05 14:44:18 Corey Bryant charm-cinder: status New Triaged
2022-10-05 14:44:20 Corey Bryant charm-cinder: importance Undecided Critical
2022-10-05 14:44:27 Corey Bryant charm-glance: assignee Corey Bryant (corey.bryant)
2022-10-05 14:44:29 Corey Bryant charm-cinder: assignee Corey Bryant (corey.bryant)
2022-10-05 14:46:51 OpenStack Infra charm-cinder: status Triaged In Progress
2022-10-05 16:27:45 OpenStack Infra charm-glance: status In Progress Fix Committed
2022-10-05 18:19:03 OpenStack Infra charm-cinder: status In Progress Fix Committed
2023-07-25 18:34:23 Felipe Reyes charm-cinder: status Fix Committed Fix Released
2023-07-25 18:34:26 Felipe Reyes charm-glance: status Fix Committed Fix Released
2023-07-25 18:34:29 Felipe Reyes charm-heat: status Fix Committed Fix Released
2023-07-25 18:34:32 Felipe Reyes charm-keystone: status Fix Committed Fix Released
2023-07-25 18:34:34 Felipe Reyes charm-neutron-api: status Fix Committed Fix Released
2023-07-25 18:34:37 Felipe Reyes charm-nova-cloud-controller: status Fix Committed Fix Released