Glare package upload fails when the package size is more than 170MB with the following error logs in the glare:
2018-10-08 06:15:16.533 24986 ERROR glare.db.sqlalchemy.api [req-b9265305-9857-48f1-8223-1cfc4a450e9e - CloudBandNetworkDirector - - -] Exception received during blob upload (pymysql.err.OperationalError) (2006, "MySQL server has gone away (error(104, 'Connection reset by peer'))") [SQL: u'INSERT INTO glare_blob_data (id, data) VALUES (%(id)s, %(data)s)'] [parameters: {'data': bytearray(b'PK\x03\x04\n\x00\x00\x00\x00\x00\x80fAM\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\x00\x1c\x00bin/UT\t\x00\x03p\x18\xb2[By\xb7[ux ... (772620730 characters truncated) ... \x03\x0e\xf2\xb1[ux\x0b\x00\x01\x04\x00\x00\x00\x00\x04\x00\x00\x00\x00PK\x05\x06\x00\x00\x00\x00\x10\x00\x10\x00\x08\x06\x00\x00\xb0l\r\x10\x00\x00'), 'id': '9f6d399d-e80b-4cca-9921-0dddd2cb056a'}] (Background on this error at: http://sqlalche.me/e/e3q8): DBConnectionError: (pymysql.err.OperationalError) (2006, "MySQL server has gone away (error(104, 'Connection reset by peer'))") [SQL: u'INSERT INTO glare_blob_data (id, data) VALUES (%(id)s, %(data)s)'] [parameters: {'data': bytearray(b'PK\x03\x04\n\x00\x00\x00\x00\x00\x80fAM\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\x00\x1c\x00bin/UT\t\x00\x03p\x18\xb2[By\xb7[ux ... (772620730 characters truncated) ... \x03\x0e\xf2\xb1[ux\x0b\x00\x01\x04\x00\x00\x00\x00\x04\x00\x00\x00\x00PK\x05\x06\x00\x00\x00\x00\x10\x00\x10\x00\x08\x06\x00\x00\xb0l\r\x10\x00\x00'), 'id': '9f6d399d-e80b-4cca-9921-0dddd2cb056a'}] (Background on this error at: http://sqlalche.me/e/e3q8)
2018-10-08 06:15:16.539 24986 ERROR glare.engine [req-b9265305-9857-48f1-8223-1cfc4a450e9e - CloudBandNetworkDirector - - -] Exception occured: <type 'exceptions.Exception'>: DBConnectionError: (pymysql.err.OperationalError) (2006, "MySQL server has gone away (error(104, 'Connection reset by peer'))") [SQL: u'INSERT INTO glare_blob_data (id, data) VALUES (%(id)s, %(data)s)'] [parameters: {'data': bytearray(b'PK\x03\x04\n\x00\x00\x00\x00\x00\x80fAM\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\x00\x1c\x00bin/UT\t\x00\x03p\x18\xb2[By\xb7[ux ... (772620730 characters truncated) ... \x03\x0e\xf2\xb1[ux\x0b\x00\x01\x04\x00\x00\x00\x00\x04\x00\x00\x00\x00PK\x05\x06\x00\x00\x00\x00\x10\x00\x10\x00\x08\x06\x00\x00\xb0l\r\x10\x00\x00'), 'id': '9f6d399d-e80b-4cca-9921-0dddd2cb056a'}] (Background on this error at: http://sqlalche.me/e/e3q8)
2018-10-08 06:15:16.653 24986 DEBUG glare.db.sqlalchemy.api [req-b9265305-9857-48f1-8223-1cfc4a450e9e - CloudBandNetworkDirector - - -] Response from the database was received. create_or_update /usr/lib/python2.7/site-packages/glare/db/sqlalchemy/api.py:163
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi [req-b9265305-9857-48f1-8223-1cfc4a450e9e - CloudBandNetworkDirector - - -] Caught error: (pymysql.err.OperationalError) (2006, "MySQL server has gone away (error(104, 'Connection reset by peer'))") [SQL: u'INSERT INTO glare_blob_data (id, data) VALUES (%(id)s, %(data)s)'] [parameters: {'data': bytearray(b'PK\x03\x04\n\x00\x00\x00\x00\x00\x80fAM\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\x00\x1c\x00bin/UT\t\x00\x03p\x18\xb2[By\xb7[ux ... (772620730 characters truncated) ... \x03\x0e\xf2\xb1[ux\x0b\x00\x01\x04\x00\x00\x00\x00\x04\x00\x00\x00\x00PK\x05\x06\x00\x00\x00\x00\x10\x00\x10\x00\x08\x06\x00\x00\xb0l\r\x10\x00\x00'), 'id': '9f6d399d-e80b-4cca-9921-0dddd2cb056a'}] (Background on this error at: http://sqlalche.me/e/e3q8): DBConnectionError: (pymysql.err.OperationalError) (2006, "MySQL server has gone away (error(104, 'Connection reset by peer'))") [SQL: u'INSERT INTO glare_blob_data (id, data) VALUES (%(id)s, %(data)s)'] [parameters: {'data': bytearray(b'PK\x03\x04\n\x00\x00\x00\x00\x00\x80fAM\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\x00\x1c\x00bin/UT\t\x00\x03p\x18\xb2[By\xb7[ux ... (772620730 characters truncated) ... \x03\x0e\xf2\xb1[ux\x0b\x00\x01\x04\x00\x00\x00\x00\x04\x00\x00\x00\x00PK\x05\x06\x00\x00\x00\x00\x10\x00\x10\x00\x08\x06\x00\x00\xb0l\r\x10\x00\x00'), 'id': '9f6d399d-e80b-4cca-9921-0dddd2cb056a'}] (Background on this error at: http://sqlalche.me/e/e3q8)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi Traceback (most recent call last):
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/glare/common/wsgi.py", line 772, in __call__
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi request, **action_args)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/glare/common/wsgi.py", line 815, in dispatch
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi return method(*args, **kwargs)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/glare/api/v1/resource.py", line 265, in log_decorator
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi result = f(self, req, *args, **kwargs)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/glare/api/v1/resource.py", line 425, in upload_blob
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi content_type, content_length, blob_key)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/glare/engine.py", line 645, in upload_blob
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi context, af, field_name, blob_key, blob_info)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 220, in __exit__
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi self.force_reraise()
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/oslo_utils/excutils.py", line 196, in force_reraise
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi six.reraise(self.type_, self.value, self.tb)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/glare/engine.py", line 627, in upload_blob
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi store_type=default_store)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/glare/common/utils.py", line 465, in new_function
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi return f(*args, **kwargs)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/glare/common/store_api.py", line 81, in save_blob_to_store
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi blob_id, data, context, verifier)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/glare/store/database.py", line 25, in add_to_backend
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi return db_api.save_blob_data(context, blob_id, data, session)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/retrying.py", line 68, in wrapped_f
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi return Retrying(*dargs, **dkw).call(f, *args, **kw)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/retrying.py", line 223, in call
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi return attempt.get(self._wrap_exception)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/retrying.py", line 261, in get
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi six.reraise(self.value[0], self.value[1], self.value[2])
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/retrying.py", line 217, in call
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi attempt = Attempt(fn(*args, **kwargs), attempt_number, False)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/glare/db/sqlalchemy/api.py", line 759, in save_blob_data
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi blob_data.save(session=session)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/glare/db/sqlalchemy/models.py", line 49, in save
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi super(ArtifactBase, self).save(session or db_api.get_session())
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/oslo_db/sqlalchemy/models.py", line 50, in save
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi session.flush()
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 2243, in flush
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi self._flush(objects)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 2369, in _flush
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi transaction.rollback(_capture_exception=True)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 66, in __exit__
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi compat.reraise(exc_type, exc_value, exc_tb)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 2333, in _flush
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi flush_context.execute()
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/unitofwork.py", line 391, in execute
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi rec.execute(self)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/unitofwork.py", line 556, in execute
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi uow
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 181, in save_obj
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi mapper, table, insert)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 830, in _emit_insert_statements
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi execute(statement, multiparams)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 948, in execute
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi return meth(self, multiparams, params)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 269, in _execute_on_connection
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi return connection._execute_clauseelement(self, multiparams, params)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1060, in _execute_clauseelement
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi compiled_sql, distilled_params
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1200, in _execute_context
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi context)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1409, in _handle_dbapi_exception
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi util.raise_from_cause(newraise, exc_info)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 203, in raise_from_cause
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi reraise(type(exception), exception, tb=exc_tb, cause=cause)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1193, in _execute_context
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi context)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 507, in do_execute
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi cursor.execute(statement, parameters)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 165, in execute
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi result = self._query(query)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/pymysql/cursors.py", line 321, in _query
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi conn.query(q)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 859, in query
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi self._execute_command(COMMAND.COM_QUERY, sql)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1106, in _execute_command
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi self.write_packet(sql[:packet_size])
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 982, in write_packet
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi self._write_bytes(data)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi File "/usr/lib/python2.7/site-packages/pymysql/connections.py", line 1048, in _write_bytes
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi "MySQL server has gone away (%r)" % (e,))
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi DBConnectionError: (pymysql.err.OperationalError) (2006, "MySQL server has gone away (error(104, 'Connection reset by peer'))") [SQL: u'INSERT INTO glare_blob_data (id, data) VALUES (%(id)s, %(data)s)'] [parameters: {'data': bytearray(b'PK\x03\x04\n\x00\x00\x00\x00\x00\x80fAM\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x00\x04\x00\x1c\x00bin/UT\t\x00\x03p\x18\xb2[By\xb7[ux ... (772620730 characters truncated) ... \x03\x0e\xf2\xb1[ux\x0b\x00\x01\x04\x00\x00\x00\x00\x04\x00\x00\x00\x00PK\x05\x06\x00\x00\x00\x00\x10\x00\x10\x00\x08\x06\x00\x00\xb0l\r\x10\x00\x00'), 'id': '9f6d399d-e80b-4cca-9921-0dddd2cb056a'}] (Background on this error at: http://sqlalche.me/e/e3q8)
2018-10-08 06:15:16.730 24986 ERROR glare.common.wsgi
