BY taking a look at F020 error logs on compute nodes: ``` 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db Traceback (most recent call last): 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db File "/usr/lib/python3.9/site-packages/nova/servicegroup/drivers/db.py", line 92, in _report_state 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db service.service_ref.save() 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db File "/usr/lib/python3.9/site-packages/oslo_versionedobjects/base.py", line 209, in wrapper 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db updates, result = self.indirection_api.object_action( 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db File "/usr/lib/python3.9/site-packages/nova/conductor/rpcapi.py", line 247, in object_action 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db return cctxt.call(context, 'object_action', objinst=objinst, 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db File "/usr/lib/python3.9/site-packages/oslo_messaging/rpc/client.py", line 189, in call 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db result = self.transport._send( 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db File "/usr/lib/python3.9/site-packages/oslo_messaging/transport.py", line 123, in _send 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db return self._driver.send(target, ctxt, message, 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 689, in send 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db return self._send(target, ctxt, message, wait_for_reply, timeout, 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db File "/usr/lib/python3.9/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 681, in _send 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db raise result 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db oslo_messaging.rpc.client.RemoteError: Remote error: DBConnectionError (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') 2022-03-08 11:05:19.332 2 ERROR nova.servicegroup.drivers.db (Background on this error at: https://sqlalche.me/e/14/e3q8)
```
Logs: https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-1ctlr_2comp-featureset020-master/3b6a109/logs/overcloud-novacompute-1/var/log/containers/nova/nova-compute.log.txt.gz
and the same tempest tests are failing here also with above reason: https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-ovb-1ctlr_2comp-featureset020-master/3b6a109/logs/undercloud/var/log/tempest/failing_tests.log.txt.gz
BY taking a look at F020 error logs on compute nodes: up.drivers. db Traceback (most recent call last): up.drivers. db File "/usr/lib/ python3. 9/site- packages/ nova/servicegro up/drivers/ db.py", line 92, in _report_state up.drivers. db service. service_ ref.save( ) up.drivers. db File "/usr/lib/ python3. 9/site- packages/ oslo_versionedo bjects/ base.py" , line 209, in wrapper up.drivers. db updates, result = self.indirectio n_api.object_ action( up.drivers. db File "/usr/lib/ python3. 9/site- packages/ nova/conductor/ rpcapi. py", line 247, in object_action up.drivers. db return cctxt.call(context, 'object_action', objinst=objinst, up.drivers. db File "/usr/lib/ python3. 9/site- packages/ oslo_messaging/ rpc/client. py", line 189, in call up.drivers. db result = self.transport. _send( up.drivers. db File "/usr/lib/ python3. 9/site- packages/ oslo_messaging/ transport. py", line 123, in _send up.drivers. db return self._driver. send(target, ctxt, message, up.drivers. db File "/usr/lib/ python3. 9/site- packages/ oslo_messaging/ _drivers/ amqpdriver. py", line 689, in send up.drivers. db return self._send(target, ctxt, message, wait_for_reply, timeout, up.drivers. db File "/usr/lib/ python3. 9/site- packages/ oslo_messaging/ _drivers/ amqpdriver. py", line 681, in _send up.drivers. db raise result up.drivers. db oslo_messaging. rpc.client. RemoteError: Remote error: DBConnectionError (pymysql. err.Operational Error) (2013, 'Lost connection to MySQL server during query') up.drivers. db (Background on this error at: https:/ /sqlalche. me/e/14/ e3q8)
```
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
2022-03-08 11:05:19.332 2 ERROR nova.servicegro
```
Logs: https:/ /logserver. rdoproject. org/openstack- periodic- integration- main/opendev. org/openstack/ tripleo- ci/master/ periodic- tripleo- ci-centos- 9-ovb-1ctlr_ 2comp-featurese t020-master/ 3b6a109/ logs/overcloud- novacompute- 1/var/log/ containers/ nova/nova- compute. log.txt. gz
and the same tempest tests are failing here also with above reason: https:/ /logserver. rdoproject. org/openstack- periodic- integration- main/opendev. org/openstack/ tripleo- ci/master/ periodic- tripleo- ci-centos- 9-ovb-1ctlr_ 2comp-featurese t020-master/ 3b6a109/ logs/undercloud /var/log/ tempest/ failing_ tests.log. txt.gz