subprocess.CalledProcessError: Command '['neutron-db-manage', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', 'upgrade', 'head']

[Felipe Reyes]

there have been some ci jobs failing while the db sync commands are being run, since these commands deal with SQL transactions, it should be safe for those to be re-run on failure.

2022-06-23 00:17:49.406518 | focal-medium | 2022-06-23 00:17:49 [ERROR] Juju log for neutron-api/0
2022-06-23 00:17:52.384759 | focal-medium | 2022-06-23 00:17:52 [ERROR] unit-neutron-api-0.log: 2022-06-23 00:17:46 WARNING unit.neutron-api/0.shared-db-relation-changed logger.go:60 File "/usr/lib/python3.8/subprocess.py", line 415, in check_output
2022-06-23 00:17:52.385024 | focal-medium | 2022-06-23 00:17:52 [ERROR] unit-neutron-api-0.log: 2022-06-23 00:17:46 WARNING unit.neutron-api/0.shared-db-relation-changed logger.go:60 return run(*popenargs, stdout=PIPE, timeout=timeout, check=True,
2022-06-23 00:17:52.385175 | focal-medium | 2022-06-23 00:17:52 [ERROR] unit-neutron-api-0.log: 2022-06-23 00:17:46 WARNING unit.neutron-api/0.shared-db-relation-changed logger.go:60 File "/usr/lib/python3.8/subprocess.py", line 516, in run
2022-06-23 00:17:52.385316 | focal-medium | 2022-06-23 00:17:52 [ERROR] unit-neutron-api-0.log: 2022-06-23 00:17:46 WARNING unit.neutron-api/0.shared-db-relation-changed logger.go:60 raise CalledProcessError(retcode, process.args,
2022-06-23 00:17:52.385461 | focal-medium | 2022-06-23 00:17:52 [ERROR] unit-neutron-api-0.log: 2022-06-23 00:17:46 WARNING unit.neutron-api/0.shared-db-relation-changed logger.go:60 subprocess.CalledProcessError: Command '['neutron-db-manage', '--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini', 'upgrade', 'head']' returned non-zero exit status 1.
2022-06-23 00:17:52.385687 | focal-medium | 2022-06-23 00:17:52 [ERROR] unit-neutron-api-0.log: 2022-06-23 00:17:46 ERROR juju.worker.uniter.operation runhook.go:140 hook "shared-db-relation-changed" (via explicit, bespoke hook script) failed: exit status 1
2022-06-23 00:17:52.385915 | focal-medium | 2022-06-23 00:17:52 [ERROR] unit-neutron-api-0.log: 2022-06-23 00:17:46 DEBUG juju.machinelock machinelock.go:202 created rotating log file "/var/log/juju/machine-lock.log" with max size 10 MB and max backups 5
2022-06-23 00:17:52.386132 | focal-medium | 2022-06-23 00:17:52 [ERROR] unit-neutron-api-0.log: 2022-06-23 00:17:46 DEBUG juju.machinelock machinelock.go:186 machine lock released for neutron-api/0 uniter (run relation-changed (17; unit: neutron-mysql-router/0) hook)

full log: https://openstack-ci-reports.ubuntu.com/artifacts/d5d/847191/2/check/focal-xena-ha-ovn/d5db27c/