Steps to reproduce:
1) deploy cluster:
4 nodes with controller
1 Cinder node
2) Delete primary controller.
3) Add another one controller.
4) Re-deploy cluster.
Expected Result:
Cluster ready after re-deployment
Actual:
Redeployment fail with error
2016-09-16 16:27:17 ERROR [7f1886631880] (helpers) Extracting of actor_id failed
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/nailgun/task/helpers.py", line 351, in prepare_action_log_kwargs
actor_id = action_log.actor_id
AttributeError: 'NoneType' object has no attribute 'actor_id'
2016-09-16 15:42:06 ERROR [7f1886631880] (base) Unexpected exception occured
Traceback (most recent call last):
File "/usr/lib/python2.7/site-packages/nailgun/api/v1/handlers/base.py", line 297, in handle_errors
return func(cls, *args, **kwargs)
File "<string>", line 2, in PUT
File "/usr/lib/python2.7/site-packages/nailgun/api/v1/handlers/base.py", line 355, in validate
return func(cls, *args, **kwargs)
File "<string>", line 2, in PUT
File "/usr/lib/python2.7/site-packages/nailgun/api/v1/handlers/base.py", line 381, in serialize
resp = func(cls, *args, **kwargs)
File "/usr/lib/python2.7/site-packages/nailgun/api/v1/handlers/node.py", line 207, in PUT
self.collection.single.update_by_agent(node, nd)
File "/usr/lib/python2.7/site-packages/nailgun/objects/node.py", line 928, in update_by_agent
return cls.update(instance, data)
File "/usr/lib/python2.7/site-packages/nailgun/objects/node.py", line 779, in update
super(Node, cls).update(instance, data)
File "/usr/lib/python2.7/site-packages/nailgun/objects/base.py", line 96, in update
db().flush()
File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 2019, in flush
self._flush(objects)
File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 2137, in _flush
transaction.rollback(_capture_exception=True)
File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/langhelpers.py", line 60, in __exit__
compat.reraise(exc_type, exc_value, exc_tb)
File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/session.py", line 2101, in _flush
flush_context.execute()
File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/unitofwork.py", line 373, in execute
rec.execute(self)
File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/unitofwork.py", line 532, in execute
uow
File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 170, in save_obj
mapper, table, update)
File "/usr/lib64/python2.7/site-packages/sqlalchemy/orm/persistence.py", line 706, in _emit_update_statements
execute(statement, multiparams)
File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 914, in execute
return meth(self, multiparams, params)
File "/usr/lib64/python2.7/site-packages/sqlalchemy/sql/elements.py", line 323, in _execute_on_connection
return connection._execute_clauseelement(self, multiparams, params)
File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1010, in _execute_clauseelement
compiled_sql, distilled_params
File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1146, in _execute_context
context)
File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1341, in _handle_dbapi_exception
exc_info
File "/usr/lib64/python2.7/site-packages/sqlalchemy/util/compat.py", line 200, in raise_from_cause
reraise(type(exception), exception, tb=exc_tb, cause=cause)
File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/base.py", line 1139, in _execute_context
context)
File "/usr/lib64/python2.7/site-packages/sqlalchemy/engine/default.py", line 450, in do_execute
cursor.execute(statement, parameters)
OperationalError: (psycopg2.extensions.TransactionRollbackError) deadlock detected
DETAIL: Process 8983 waits for ShareLock on transaction 2768; blocked by process 26677.
Process 26677 waits for ShareLock on transaction 2769; blocked by process 8983.
HINT: See server log for query details.
CONTEXT: SQL statement "SELECT 1 FROM ONLY "public"."clusters" x WHERE "id" OPERATOR(pg_catalog.=) $1 FOR KEY SHARE OF x"
[SQL: 'UPDATE nodes SET mac=%(mac)s, agent_checksum=%(agent_checksum)s WHERE nodes.id = %(nodes_id)s'] [parameters: {'agent_checksum': u'deeeec8fce9c1e3ed5c150684b86aa008bebc1ec', 'mac': u'64:86:C0:AD:16:15', 'nodes_id': 9}]
[pid: 7727|app: 0|req: 440/790] 10.109.10.11 () {40 vars in 559 bytes} [Fri Sep 16 15:42:05 2016] PUT /api/nodes/agent/ => generated 39 bytes in 1294 msecs (HTTP/1.1 500) 5 headers in 223 bytes (2 switches on core 0)
[pid: 7727|app: 0|req: 441/791] 10.109.10.1 () {38 vars in 554 bytes} [Fri Sep 16 15:42:07 2016] GET /api/tasks/1 => generated 276 bytes in 8 msecs (HTTP/1.1 200) 4 headers in 185 bytes (2 switches on core 0)
@Valentyn Yakovlev, please specify fuel version and return the issue back to New state.