"build_id": "2014-06-17_18-06-05",
"mirantis": "yes",
"build_number": "258",
"ostf_sha": "1740b5ce42ea1893f7d3e2c6cc59720bdb77c007",
"nailgun_sha": "057bb88abab1048322ed0ff48d632f8caf146e5a",
"production": "docker",
"api": "1.0",
"fuelmain_sha": "ba9e19a3822d9c1dcda2f4046f2f5e3e6ac505dd",
"astute_sha": "17b1afa5f0dc8f4fca5ed4eb03ec566fbfb5ed19",
"release": "5.1",
"fuellib_sha": "ff050d23d8a845cd097f7aa617285da0ab1894f6"
1. Create new environment (Ubuntu, HA mode)
2. Choose GRE segmentation
3. Add 3 controllers+cinder, 1 compute
4. Start deployment. It was successful
5. But there is traceback in /var/log/docker-logs/remote/node-5.domain.tld/cinder-scheduler.log on first controller:
Jun 18 11:25:23 err: 2014-06-18 10:25:23.132 31350 ERROR cinder.openstack.common.threadgroup [-] (OperationalError) (1045, "Access denied for user 'cinder'@'192.168.0.6' (using password: YES)") None None
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup Traceback (most recent call last):
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/threadgroup.py", line 125, in wait
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup x.wait()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/threadgroup.py", line 47, in wait
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup return self.thread.wait()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 168, in wait
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup return self._exit_event.wait()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/event.py", line 116, in wait
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup return hubs.get_hub().switch()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/hubs/hub.py", line 187, in switch
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup return self.greenlet.switch()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/eventlet/greenthread.py", line 194, in main
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup result = function(*args, **kwargs)
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/service.py", line 483, in run_service
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup service.start()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/cinder/service.py", line 108, in start
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup self.binary)
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/cinder/db/api.py", line 123, in service_get_by_args
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup return IMPL.service_get_by_args(context, host, binary)
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/cinder/db/sqlalchemy/api.py", line 119, in wrapper
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup return f(*args, **kwargs)
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/cinder/db/sqlalchemy/api.py", line 344, in service_get_by_args
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup result = model_query(context, models.Service).\
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/cinder/db/sqlalchemy/api.py", line 178, in model_query
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup session = kwargs.get('session') or get_session()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/db/sqlalchemy/session.py", line 376, in get_session
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup engine = get_engine(sqlite_fk=sqlite_fk)
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/db/sqlalchemy/session.py", line 498, in get_engine
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup sqlite_fk=sqlite_fk)
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/cinder/openstack/common/db/sqlalchemy/session.py", line 625, in create_engine
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup engine.connect()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1641, in connect
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup return self._connection_cls(self, **kwargs)
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 59, in __init__
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup self.__connection = connection or engine.raw_connection()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/base.py", line 1699, in raw_connection
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup return self.pool.unique_connection()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 220, in unique_connection
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup return _ConnectionFairy(self).checkout()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 425, in __init__
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup rec = self._connection_record = pool._do_get()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 778, in _do_get
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup con = self._create_connection()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 225, in _create_connection
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup return _ConnectionRecord(self)
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 318, in __init__
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup self.connection = self.__connect()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/sqlalchemy/pool.py", line 368, in __connect
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup connection = self.__pool._creator()
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/strategies.py", line 80, in connect
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup return dialect.connect(*cargs, **cparams)
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/sqlalchemy/engine/default.py", line 283, in connect
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup return self.dbapi.connect(*cargs, **cparams)
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/MySQLdb/__init__.py", line 81, in Connect
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup return Connection(*args, **kwargs)
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup File "/usr/lib/python2.7/dist-packages/MySQLdb/connections.py", line 193, in __init__
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup super(Connection, self).__init__(*args, **kwargs2)
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup OperationalError: (OperationalError) (1045, "Access denied for user 'cinder'@'192.168.0.6' (using password: YES)") None None
2014-06-18 10:25:23.132 31350 TRACE cinder.openstack.common.threadgroup
This trace is expected and isn't a problem: on Ubuntu, cinder-scheduler is started when package is installed, before it was configured (11:21:55 in the logs). Right before that, cinder.conf is updated with MySQL connection details (11:21:51), so cinder-scheduler tries to use that but can't yet, because cinder user is created in MySQL a few minutes later (11:26). As soon as cinder configuration is done, cinder-scheduler is restarted (11:33), and at that time all Cinder services are able to connect successfully.