It seems we might be missing a DB migration. After upgrade the neutron-server process keeps dying with: 2017-11-09 00:19:56.883 29705 WARNING stevedore.named [req-998ddd50-b9b9-48fd-a63c-2390687fb179 - - - - -] Could not load neutron_vpnaas.services.vpn.service_drivers.ipsec.IPsecVPNDriver 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters [req-998ddd50-b9b9-48fd-a63c-2390687fb179 - - - - -] DBAPIError exception wrapped from (pymysql.err.InternalError) (1054, u"Unknown column 'vpnservices.flavor_id' in 'field list'") [SQL: u'SELECT vpnservices.project_id AS vpnservices_project_id, vpnservices.id AS vpnservices_id, vpnservices.name AS vpnservices_name, vpnservices.description AS vpnservices_description, vpnservices.status AS vpnservices_status, vpnservices.admin_state_up AS vpnservices_admin_state_up, vpnservices.external_v4_ip AS vpnservices_external_v4_ip, vpnservices.external_v6_ip AS vpnservices_external_v6_ip, vpnservices.subnet_id AS vpnservices_subnet_id, vpnservices.router_id AS vpnservices_router_id, vpnservices.flavor_id AS vpnservices_flavor_id \nFROM vpnservices']: InternalError: (1054, u"Unknown column 'vpnservices.flavor_id' in 'field list'") 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters Traceback (most recent call last): 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1182, in _execute_context 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters context) 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 470, in do_execute 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters cursor.execute(statement, parameters) 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 166, in execute 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters result = self._query(query) 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/pymysql/cursors.py", line 322, in _query 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters conn.query(q) 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 856, in query 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters self._affected_rows = self._read_query_result(unbuffered=unbuffered) 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1057, in _read_query_result 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters result.read() 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1340, in read 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters first_packet = self.connection._read_packet() 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 1014, in _read_packet 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters packet.check_error() 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/pymysql/connections.py", line 393, in check_error 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters err.raise_mysql_exception(self._data) 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters File "/usr/lib/python2.7/dist-packages/pymysql/err.py", line 107, in raise_mysql_exception 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters raise errorclass(errno, errval) 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters InternalError: (1054, u"Unknown column 'vpnservices.flavor_id' in 'field list'") 2017-11-09 00:19:57.134 29705 ERROR oslo_db.sqlalchemy.exc_filters 2017-11-09 00:19:57.139 29705 ERROR neutron.service [req-998ddd50-b9b9-48fd-a63c-2390687fb179 - - - - -] Unrecoverable error: please check log for details.: DBError: (pymysql.err.InternalError) (1054, u"Unknown column 'vpnservices.flavor_id' in 'field list'") [SQL: u'SELECT vpnservices.project_id AS vpnservices_project_id, vpnservices.id AS vpnservices_id, vpnservices.name AS vpnservices_name, vpnservices.description AS vpnservices_description, vpnservices.status AS vpnservices_status, vpnservices.admin_state_up AS vpnservices_admin_state_up, vpnservices.external_v4_ip AS vpnservices_external_v4_ip, vpnservices.external_v6_ip AS vpnservices_external_v6_ip, vpnservices.subnet_id AS vpnservices_subnet_id, vpnservices.router_id AS vpnservices_router_id, vpnservices.flavor_id AS vpnservices_flavor_id \nFROM vpnservices'] A a secondary issue is when other compnents are upgraded but neutron-api is not yet these errors occur: 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server [req-48bde0b4-96e8-4703-b809-9313287ff727 - - - - -] Exception during message handling 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server Traceback (most recent call last): 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 155, in _process_incoming 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server LOG.exception(_LE("Can not acknowledge message. Skip processing")) 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 222, in dispatch 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 192, in _do_dispatch 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server """ 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 218, in inner 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server def expected_exceptions(*exceptions): 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/neutron/api/rpc/handlers/resources_rpc.py", line 143, in bulk_pull 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server **filter_kwargs)] 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server File "/usr/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 551, in obj_to_primitive 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server raise exception.InvalidTargetVersion(version=target_version) 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server InvalidTargetVersion: Invalid target version 1.1 2017-11-09 00:18:16.369 16980 ERROR oslo_messaging.rpc.server