Critical because the error leaves the congress data structure in a corrupted state, causing all further policy changes to error.
I encountered a 500 error on datasource delete.
$ openstack congress policy create policy1
$ openstack congress policy rule create policy1 'execute[nova:flavors.delete(id)] :- nova:flavors(id=id,vcpus=x),s(x), q(10,10)'
$ openstack congress datasource delete nova
Internal server error (HTTP 500) (Request-ID: req-2f8c2788-789d-4ad5-a75a-4d8ef54fa8bc)
The rule creation is required. Appears to need both the nova reference in the head and the body.
If we continue from the error and continue to create & delete the datasource, the same error occurs.
$ openstack congress datasource create --config username=admin --config tenant_name=admin --config auth_url=http://127.0.0.1:5000/v3 --config password=password --config poll_time=5 nova nova
+-------------+----------------------------------------------------------------------------------------------------------------+
| Field | Value |
+-------------+----------------------------------------------------------------------------------------------------------------+
| config | {u'username': u'admin', u'tenant_name': u'admin', u'auth_url': u'http://127.0.0.1:5000/v3', u'password': |
| | u'password', u'poll_time': u'5'} |
| description | None |
| driver | nova |
| enabled | True |
| id | 32760158-4492-471b-ac45-78897be602bf |
| name | nova |
| type | None |
+-------------+----------------------------------------------------------------------------------------------------------------+
$ openstack congress datasource delete nova
Internal server error (HTTP 500) (Request-ID: req-cedea388-b356-4126-a811-ed53cfcd652f)
But then this strange thing happens:
If I delete and create policy1, and execute the same commands that caused the error the first time, no error occurs.
$ openstack congress datasource create --config username=admin --config tenant_name=admin --config auth_url=http://127.0.0.1:5000/v3 --config password=password --config poll_time=5 nova nova
+-------------+----------------------------------------------------------------------------------------------------------------+
| Field | Value |
+-------------+----------------------------------------------------------------------------------------------------------------+
| config | {u'username': u'admin', u'tenant_name': u'admin', u'auth_url': u'http://127.0.0.1:5000/v3', u'password': |
| | u'password', u'poll_time': u'5'} |
| description | None |
| driver | nova |
| enabled | True |
| id | 8ecba93c-da6d-4e08-bf0c-210a7892a536 |
| name | nova |
| type | None |
+-------------+----------------------------------------------------------------------------------------------------------------+
$ openstack congress policy delete policy1
user@ubuntu:~$ openstack congress policy create policy1
+--------------+--------------------------------------+
| Field | Value |
+--------------+--------------------------------------+
| abbreviation | polic |
| description | |
| id | 0a2e97a7-dbc4-434a-af41-26b97d3cae8f |
| kind | nonrecursive |
| name | policy1 |
| owner_id | user |
+--------------+--------------------------------------+
$ openstack congress policy rule create policy1 'execute[nova:flavors.delete(id)] :- nova:flavors(id=id,vcpus=x),s(x), q(10,10)'
+---------+--------------------------------------+
| Field | Value |
+---------+--------------------------------------+
| comment | |
| id | 03cb7e6f-074b-4c79-8b51-c67da576ce59 |
| name | None |
| rule | execute[nova:flavors.delete(id)] :- |
| | nova:flavors(id=id, vcpus=x), |
| | s(x), |
| | q(10, 10) |
+---------+--------------------------------------+
$ openstack congress datasource delete nova
But it only seems to work AFTER the error has already occurred. Creating and deleting policy1 on a newly started instance of congress before executing the first script results in the 500 error.
Partial log:
2017-02-08 00:29:18.920 ERROR congress.api.application [^[[01;36mreq-2f8c2788-789d-4ad5-a75a-4d8ef54fa8bc ^[[00;36madmin 4fbfbf77ca1b46e289297020b994b418] ^[[01;35mTraceback (most recent call last):^M
File "/opt/stack/congress/congress/api/application.py", line 53, in __call__^M
response = handler.handle_request(request)^M
File "/opt/stack/congress/congress/api/webservice.py", line 261, in handle_request^M
return self.delete(request)^M
File "/opt/stack/congress/congress/api/webservice.py", line 351, in delete^M
id_, request.params, context=self._get_context(request))^M
File "/opt/stack/congress/congress/api/datasource_model.py", line 119, in delete_item^M
timeout=self.dse_long_timeout)^M
File "/opt/stack/congress/congress/api/base.py", line 40, in invoke_rpc^M
caller, name, kwargs, timeout=timeout, local=local)^M
File "/opt/stack/congress/congress/dse2/data_service.py", line 193, in rpc^M
service, action, kwargs, timeout=timeout, local=local, retry=retry)^M
File "/opt/stack/congress/congress/dse2/dse_node.py", line 336, in invoke_service_rpc^M
result = client.call(self.context, method, **kwargs)^M
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 465, in call^M
return self.prepare().call(ctxt, method, **kwargs)^M
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/client.py", line 169, in call^M
retry=self.retry)^M
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/transport.py", line 97, in _send^M
timeout=timeout, retry=retry)^M
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 458, in send^M
retry=retry)^M
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/_drivers/amqpdriver.py", line 449, in _send^M
raise result^M
DataServiceError_Remote: failed to synchronize_datasource after deleting datasource: cf33289d-b4a0-43ee-89c7-c1f6939df259^M
Traceback (most recent call last):^M
^M
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/server.py", line 155, in _process_incoming^M
res = self.dispatcher.dispatch(message)^M
^M
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 222, in dispatch^M
return self._do_dispatch(endpoint, method, ctxt, args)^M
^M
File "/usr/local/lib/python2.7/dist-packages/oslo_messaging/rpc/dispatcher.py", line 192, in _do_dispatch^M
result = func(ctxt, **new_args)^M
^M
File "/opt/stack/congress/congress/dse2/datasource_manager.py", line 134, in delete_datasource^M
return self.ds_manager.delete_datasource(datasource)^M
^M
File "/opt/stack/congress/congress/dse2/datasource_manager.py", line 122, in delete_datasource^M
raise exception.DataServiceError(msg)^M
^M
DataServiceError: failed to synchronize_datasource after deleting datasource: cf33289d-b4a0-43ee-89c7-c1f6939df259^M
Full log attached.
Encountered on commit eff5618aac492b33f37edea7dcd6bf20036ac222.
Subsequent delete requests encountered the same error.