[swift] volume backup's status keep in 'restoring' and Lost connection to MySQL server during query.

[silphon zhang]

2021-09-24 18:22:45.037 11 INFO cinder.backup.drivers.swift [req-40402a0e-4479-41bd-b8c3-6da2659e3fe3 req-c360ad3c-ba94-49cf-940f-ca1e699ffd2a 1e6e904b469749f883c06fefaaf133c8 840055620f8446d2b298ea01fc6d8997 - - -] restoring volume_b5c7f5b9-01d0-4ae2-9e24-2355aaa0a8cf/20210918063357/az_az-stackdev_backup_8cfb3916-3f13-44ad-ac75-480e5fb6b2ca-1860328
2021-09-24 18:23:39.783 11 WARNING oslo_db.sqlalchemy.exc_filters [None req-f4eaf561-8b8f-46aa-b31b-abc5033f9b1a - - - - -] DB exception wrapped.: oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')
(Background on this error at: http://sqlalche.me/e/13/e3q8)
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 771, in _commit_impl
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters self.engine.dialect.do_commit(self.connection)
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/dialects/mysql/base.py", line 2463, in do_commit
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters dbapi_connection.commit()
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 422, in commit
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters self._read_ok_packet()
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 396, in _read_ok_packet
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters pkt = self._read_packet()
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 646, in _read_packet
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters packet_header = self._read_bytes(4)
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 698, in _read_bytes
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters raise err.OperationalError(
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters pymysql.err.OperationalError: (2013, 'Lost connection to MySQL server during query')
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters The above exception was the direct cause of the following exception:
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last):
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1301, in _execute_context
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters self._root._commit_impl(autocommit=True)
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 773, in _commit_impl
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters self._handle_dbapi_exception(e, None, None, None, None)
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 1508, in _handle_dbapi_exception
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters util.raise_(newraise, with_traceback=exc_info[2], from_=e)
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/util/compat.py", line 182, in raise_
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters raise exception
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/engine/base.py", line 771, in _commit_impl
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters self.engine.dialect.do_commit(self.connection)
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/sqlalchemy/dialects/mysql/base.py", line 2463, in do_commit
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters dbapi_connection.commit()
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 422, in commit
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters self._read_ok_packet()
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 396, in _read_ok_packet
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters pkt = self._read_packet()
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 646, in _read_packet
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters packet_header = self._read_bytes(4)
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters File "/var/lib/openstack/lib/python3.8/site-packages/pymysql/connections.py", line 698, in _read_bytes
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters raise err.OperationalError(
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters oslo_db.exception.DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters (Background on this error at: http://sqlalche.me/e/13/e3q8)
2021-09-24 18:23:39.783 11 ERROR oslo_db.sqlalchemy.exc_filters
2021-09-24 18:23:39.793 11 ERROR cinder.service [None req-f4eaf561-8b8f-46aa-b31b-abc5033f9b1a - - - - -] DBError encountered: : oslo_db.exception.DBError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query')

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/cinder/+/811085

[Sofia Enriquez (lsofia-enriquez)]

Greetings,
Please provide more information regarding this problem:
- Cinder version.
- Full steps to reproduce this.
- How are you deploying cinder?
The fix proposed upstream doesn't look related to this bug, so please feel free to explain the approach a bit more.
Thanks in advance,Sofia