The similar issue happened in [1] and [2], but with FloatingIP and cinder Volume, respectively. *Logs for [2] (Similar for [1])*: cinder-volume.log (node-6): --------------------------- 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume [req-d2f92157-adb4-4704-8205-1812a12cb884 - - - - -] Volume service rbd:volumes@RBD-backend failed to start. 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume Traceback (most recent call last): 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/cmd/volume.py", line 81, in main 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume binary='cinder-volume') 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 268, in create 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume service_name=service_name) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 139, in __init__ 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume service_ref = objects.Service.get_by_args(ctxt, host, binary) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/oslo_versionedobjects/base.py", line 181, in wrapper 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume result = fn(cls, context, *args, **kwargs) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/objects/service.py", line 81, in get_by_args 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume db_service = db.service_get_by_args(context, host, binary_key) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/db/api.py", line 127, in service_get_by_args 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume return IMPL.service_get_by_args(context, host, binary) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/db/sqlalchemy/api.py", line 175, in wrapper 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume return f(*args, **kwargs) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/cinder/db/sqlalchemy/api.py", line 450, in service_get_by_args 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume filter_by(binary=binary).\ 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2588, in all 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume return list(self) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2736, in __iter__ 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume return self._execute_and_instances(context) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/sqlalchemy/orm/query.py", line 2751, in _execute_and_instances 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume result = conn.execute(querycontext.statement, self._params) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 914, in execute 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume return meth(self, multiparams, params) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume return connection._execute_clauseelement(self, multiparams, params) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume compiled_sql, distilled_params 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume context) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1337, in _handle_dbapi_exception 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume util.raise_from_cause(newraise, exc_info) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume reraise(type(exception), exception, tb=exc_tb, cause=cause) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume context) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 450, in do_execute 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume cursor.execute(statement, parameters) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/MySQLdb/cursors.py", line 219, in execute 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume self.errorhandler(self, exc, value) 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 38, in defaulterrorhandler 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume raise errorvalue 2016-09-07 01:22:37.952 27393 ERROR cinder.cmd.volume ProgrammingError: (_mysql_exceptions.ProgrammingError) (1146, "Table 'cinder.services' doesn't exist") [SQL: u'SELECT services.created_at AS services_created_at, services.updated_at AS services_updated_at, services.deleted_at AS services_deleted_at, services.deleted AS services_deleted, services.id AS services_id, services.host AS services_host, services.`binary` AS services_binary, services.topic AS services_topic, services.report_count AS services_report_count, services.disabled AS services_disabled, services.availability_zone AS services_availability_zone, services.disabled_reason AS services_disabled_reason, services.modified_at AS services_modified_at, services.rpc_current_version AS services_rpc_current_version, services.object_current_version AS services_object_current_version, services.replication_status AS services_replication_status, services.active_backend_id AS services_active_backend_id, services.frozen AS services_frozen \nFROM services \nWHERE services.deleted = false AND services.host = %s AND services.`binary` = %s'] [parameters: ('rbd:volumes@RBD-backend', 'cinder-volume')] syslog (node-6): ---------------- <27>Sep 7 01:04:27 node-5 ocf-ns_conntrackd: ERROR: Device "conntrd" does not exist. <27>Sep 7 01:04:29 node-5 ocf-mysql-wss: ERROR: Setup problem: couldn't find command: /usr/bin/mysqld_safe <27>Sep 7 01:04:35 node-5 ocf-ns_IPaddr2: ERROR: exec of "undef" failed: No such file or directory <27>Sep 7 01:04:35 node-5 ocf-ns_IPaddr2: ERROR: Error: an inet prefix is expected rather than "undef". <27>Sep 7 01:04:35 node-5 ocf-ns_IPaddr2: ERROR: Error: an inet prefix is expected rather than "undef". <27>Sep 7 01:05:00 node-5 ocf-mysql-wss: ERROR: Setup problem: couldn't find command: /usr/bin/mysqld_safe <27>Sep 7 01:05:46 node-5 ocf-mysql-wss: ERROR: Setup problem: couldn't find command: /usr/bin/mysqld_safe <27>Sep 7 01:06:41 node-5 ocf-mysql-wss: ERROR: p_mysqld: mysql_status(): PIDFile /var/run/resource-agents/mysql-wss/mysql-wss.pid of MySQL server not found. Sleeping for 2 seconds. 0 retries left <27>Sep 7 01:06:43 node-5 ocf-mysql-wss: ERROR: p_mysqld: mysql_status(): MySQL is not running [1] https://product-ci.infra.mirantis.net/view/10.0/job/10.0.main.ubuntu.bvt_2/641 [2] https://product-ci.infra.mirantis.net/job/9.x.main.ubuntu.bvt_2/228/