Is it possible to create a normal VM on the your multinode system? I notice that Nova can't connect to database in both ALL_NODES_20190620.210149.tar and ALL_NODES_20190624.161925.tar. If Nova really can't connect to database, no VM can be created.
You can find the log in the following path:
ALL_NODES_20190624.161925/controller-0_20190624.161925/var/log/containers/nova-scheduler-755c98cf54-bqhqg_openstack_nova-scheduler-e5a2a9a3b58aa25e1684c73caf9525af925e342396bd668a2c03e30f5173aac6.log
ALL_NODES_20190624.161925/controller-0_20190624.161925/var/log/containers/nova-conductor-6787ff97bc-qrklj_openstack_nova-conductor-94e02872794725b867494c9872c98a525e6bcdc196e13db2092ed138f61f7e01.log
ALL_NODES_20190620.210149/controller-1_20190620.210149/var/log/containers/nova-conductor-78c98f5d74-mbgxt_openstack_nova-conductor-9e807cb9e82a0def0ac6dcba6d19525d875290f265a500bfd6a72aa29e6714e7.log
ALL_NODES_20190620.210149/controller-1_20190620.210149/var/log/containers/nova-scheduler-8489d97b99-wls9s_openstack_nova-scheduler-bfc78d486a114c955b38fc8e8deaeb9de40fed9e5cc459ac7a4d6c5c04b05708.log
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db.sqlalchemy.engines [req-70252872-3d13-472c-bfc7-a79e30e2ae48 - - - - -] Database connection was found disconnected; reconnecting: DBConnectionError: (pymysql.err.OperationalError) (2013, 'Lost connection to MySQL server during query') [SQL: u'SELECT 1'] (Background on this error at: http://sqlalche.me/e/e3q8)\n","stream":"stdout","time":"2019-06-20T19:59:00.613656542Z"}
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db.sqlalchemy.engines Traceback (most recent call last):\n","stream":"stdout","time":"2019-06-20T19:59:00.613685821Z"}
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db.sqlalchemy.engines File \"/var/lib/openstack/lib/python2.7/site-packages/oslo_db/sqlalchemy/engines.py\", line 73, in _connect_ping_listener\n","stream":"stdout","time":"2019-06-20T19:59:00.613689557Z"}
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db.sqlalchemy.engines connection.scalar(select([1]))\n","stream":"stdout","time":"2019-06-20T19:59:00.613692685Z"}
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db.sqlalchemy.engines File \"/var/lib/openstack/lib/python2.7/site-packages/sqlalchemy/engine/base.py\", line 912, in scalar\n","stream":"stdout","time":"2019-06-20T19:59:00.613695482Z"}
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db.sqlalchemy.engines return self.execute(object_, *multiparams, **params).scalar()\n","stream":"stdout","time":"2019-06-20T19:59:00.613698414Z"}
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db.sqlalchemy.engines File \"/var/lib/openstack/lib/python2.7/site-packages/sqlalchemy/engine/base.py\", line 980, in execute\n","stream":"stdout","time":"2019-06-20T19:59:00.613701252Z"}
Hi Peng,
Is it possible to create a normal VM on the your multinode system? I notice that Nova can't connect to database in both ALL_NODES_ 20190620. 210149. tar and ALL_NODES_ 20190624. 161925. tar. If Nova really can't connect to database, no VM can be created.
You can find the log in the following path: 20190624. 161925/ controller- 0_20190624. 161925/ var/log/ containers/ nova-scheduler- 755c98cf54- bqhqg_openstack _nova-scheduler -e5a2a9a3b58aa2 5e1684c73caf952 5af925e342396bd 668a2c03e30f517 3aac6.log 20190624. 161925/ controller- 0_20190624. 161925/ var/log/ containers/ nova-conductor- 6787ff97bc- qrklj_openstack _nova-conductor -94e02872794725 b867494c9872c98 a525e6bcdc196e1 3db2092ed138f61 f7e01.log 20190620. 210149/ controller- 1_20190620. 210149/ var/log/ containers/ nova-conductor- 78c98f5d74- mbgxt_openstack _nova-conductor -9e807cb9e82a0d ef0ac6dcba6d195 25d875290f265a5 00bfd6a72aa29e6 714e7.log 20190620. 210149/ controller- 1_20190620. 210149/ var/log/ containers/ nova-scheduler- 8489d97b99- wls9s_openstack _nova-scheduler -bfc78d486a114c 955b38fc8e8deae b9de40fed9e5cc4 59ac7a4d6c5c04b 05708.log
ALL_NODES_
ALL_NODES_
ALL_NODES_
ALL_NODES_
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db. sqlalchemy. engines [req-70252872- 3d13-472c- bfc7-a79e30e2ae 48 - - - - -] Database connection was found disconnected; reconnecting: DBConnectionError: (pymysql. err.Operational Error) (2013, 'Lost connection to MySQL server during query') [SQL: u'SELECT 1'] (Background on this error at: http:// sqlalche. me/e/e3q8)\n","stream" :"stdout" ,"time" :"2019- 06-20T19: 59:00.613656542 Z"} sqlalchemy. engines Traceback (most recent call last):\ n","stream" :"stdout" ,"time" :"2019- 06-20T19: 59:00.613685821 Z"} sqlalchemy. engines File \"/var/ lib/openstack/ lib/python2. 7/site- packages/ oslo_db/ sqlalchemy/ engines. py\", line 73, in _connect_ ping_listener\ n","stream" :"stdout" ,"time" :"2019- 06-20T19: 59:00.613689557 Z"} sqlalchemy. engines connection. scalar( select( [1]))\n" ,"stream" :"stdout" ,"time" :"2019- 06-20T19: 59:00.613692685 Z"} sqlalchemy. engines File \"/var/ lib/openstack/ lib/python2. 7/site- packages/ sqlalchemy/ engine/ base.py\ ", line 912, in scalar\ n","stream" :"stdout" ,"time" :"2019- 06-20T19: 59:00.613695482 Z"} sqlalchemy. engines return self.execute( object_ , *multiparams, **params) .scalar( )\n","stream" :"stdout" ,"time" :"2019- 06-20T19: 59:00.613698414 Z"} sqlalchemy. engines File \"/var/ lib/openstack/ lib/python2. 7/site- packages/ sqlalchemy/ engine/ base.py\ ", line 980, in execute\ n","stream" :"stdout" ,"time" :"2019- 06-20T19: 59:00.613701252 Z"}
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db.
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db.
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db.
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db.
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db.
{"log":"2019-06-20 19:59:00.612 1 ERROR oslo_db.