Murano

invalid arg 'x-expires' error during the connection to Rabbit MQ

Bug #1255042 reported by Timur Nurlygayanov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Murano
Fix Released
Critical
Serg Melikyan
Murano 0.4

Bug Description

Steps To Reproduce:
1. Install and run all Murano components from release-0.4.
2. Run Murano API and Murano Conductor
3. Create simple environment with any service and start to deploy it

Observed Result:
Deploy finished after 1 seccond without detailed logs and we can see in Murano Conductor log the following errors:

Errors in logs:

 log_http_response /usr/local/lib/python2.7/dist-packages/metadataclient/common/http.py:151
2013-11-26 09:38:12.824 17826 DEBUG muranoconductor.metadata [-] Archive '/tmp/tmpLYMQeZ' has hash-sum fdd83bb48195ec38c6ea061963e81246d24e090e _get_hash /usr/local/lib/python2.7/dist-packages/muranoconductor/metadata.py:144
2013-11-26 09:38:12.860 17826 INFO urllib3.connectionpool [-] Starting new HTTP connection (1): 172.18.124.203
2013-11-26 09:38:13.080 17826 DEBUG urllib3.connectionpool [-] "POST /v2.0/tokens HTTP/1.1" 200 7099 _make_request /usr/lib/python2.7/dist-packages/urllib3/connectionpool.py:283
2013-11-26 09:38:13.090 17826 DEBUG iso8601.iso8601 [-] Parsed 2013-11-27T09:37:16Z into {'tz_sign': None, 'second_fraction': None, 'hour': u'09', 'tz_hour': None, 'month': u'11', 'timezone': u'Z', 'second': u'16', 'tz_minute': None, 'year': u'2013', 'separator': u'T', 'day': u'27', 'minute': u'37'} with default timezone <iso8601.iso8601.Utc object at 0x196d950> parse_date /usr/local/lib/python2.7/dist-packages/iso8601/iso8601.py:166
2013-11-26 09:38:13.091 17826 DEBUG iso8601.iso8601 [-] Got u'2013' for 'year' with default None to_int /usr/local/lib/python2.7/dist-packages/iso8601/iso8601.py:124
2013-11-26 09:38:13.091 17826 DEBUG iso8601.iso8601 [-] Got u'11' for 'month' with default None to_int /usr/local/lib/python2.7/dist-packages/iso8601/iso8601.py:124
2013-11-26 09:38:13.091 17826 DEBUG iso8601.iso8601 [-] Got u'27' for 'day' with default None to_int /usr/local/lib/python2.7/dist-packages/iso8601/iso8601.py:124
2013-11-26 09:38:13.091 17826 DEBUG iso8601.iso8601 [-] Got u'09' for 'hour' with default None to_int /usr/local/lib/python2.7/dist-packages/iso8601/iso8601.py:124
2013-11-26 09:38:13.091 17826 DEBUG iso8601.iso8601 [-] Got u'37' for 'minute' with default None to_int /usr/local/lib/python2.7/dist-packages/iso8601/iso8601.py:124
2013-11-26 09:38:13.092 17826 DEBUG iso8601.iso8601 [-] Got u'16' for 'second' with default None to_int /usr/local/lib/python2.7/dist-packages/iso8601/iso8601.py:124
2013-11-26 09:38:13.095 17826 ERROR muranoconductor.app [-] {'class_id': 50, 'method_id': 10, 'reply_code': 406, 'reply_text': "PRECONDITION_FAILED - invalid arg 'x-expires' for queue '-execution-results-ed2877df0ed59406eb6a942e4b77a7534' in vhost 'Condoncommit': {unacceptable_type,longstr}"}
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app Traceback (most recent call last):
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app File "/usr/local/lib/python2.7/dist-packages/muranoconductor/app.py", line 97, in _task_received
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app reporter)
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app File "/usr/local/lib/python2.7/dist-packages/muranoconductor/commands/dispatcher.py", line 28, in __init__
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app environment, rmqclient, reporter),
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app File "/usr/local/lib/python2.7/dist-packages/muranoconductor/commands/vm_agent.py", line 22, in __init__
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app rmqclient.declare(self._results_queue, enable_ha=True, ttl=86400000)
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app File "/usr/local/lib/python2.7/dist-packages/muranocommon/messaging/mqclient.py", line 78, in declare
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app self._client.wait(promise)
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app File "/usr/local/lib/python2.7/dist-packages/puka/connection.py", line 283, in wait
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app raise_errors=raise_errors)
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app File "/usr/local/lib/python2.7/dist-packages/puka/promise.py", line 35, in run_callback
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app return self._promises[number].run_callback(**kwargs)
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app File "/usr/local/lib/python2.7/dist-packages/puka/promise.py", line 135, in run_callback
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app raise result.exception
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app PreconditionFailed: {'class_id': 50, 'method_id': 10, 'reply_code': 406, 'reply_text': "PRECONDITION_FAILED - invalid arg 'x-expires' for queue '-execution-results-ed2877df0ed59406eb6a942e4b77a7534' in vhost 'Condoncommit': {unacceptable_type,longstr}"}
2013-11-26 09:38:13.095 17826 TRACE muranoconductor.app
2013-11-26 09:38:13.096 17826 DEBUG muranoconductor.app [-] Non-processable message detected, will ack message _task_received /usr/local/lib/python2.7/dist-packages/muranoconductor/app.py:143
2013-11-26 09:38:13.100 17826 INFO muranoconductor.app [-] Finished processing task . Result = {"updated": "2013-11-26T09:37:29.767501", "name": "test", "created": "2013-11-26T09:37:29.771941", "tenant_id": "72239681556748a3b9b74b44d081b84b", "version": 0, "services": [{"updated": "2013-11-26 09:38:09.240613", "availabilityZone": "nova", "name": "iis", "created": "2013-11-26 09:38:09.240604", "adminPassword": "*** SANITIZED ***", "domain": "", "unitNamingPattern": "iis", "osImage": {"type": "windows.2012", "name": "ws-2012-std", "title": "Windows Server 2012 Standard"}, "units": [{"id": "c57986fb7d2c451484de1ee3c2794d8a", "name": "iis_instance_0"}], "flavor": "m1.medium", "type": "webServer", "id": "9452984b2b014a25871cb852a7d8ab4a"}], "id": "d2877df0ed59406eb6a942e4b77a7534"}

Timur Nurlygayanov (tnurlygayanov)
Changed in murano:
importance: Undecided → Critical
assignee: nobody → Serg Melikyan (smelikyan)
Revision history for this message
Timur Nurlygayanov (tnurlygayanov) wrote :

reproduced with the last pip tarball for murano-common component:

http://paste.openstack.org/show/53970/

Changed in murano:
status: New → Confirmed
Revision history for this message
Timur Nurlygayanov (tnurlygayanov) wrote :

ubuntu@murano-devbox-04-cond:~$ sudo pip freeze | grep murano
Warning: cannot find svn location for distribute==0.6.24dev-r0
murano-api==0.2.dev170.g494bcc5
murano-conductor==0.2.dev205.gc1ef104
murano-dashboard==0.2.dev387.gf3afb58
murano-metadataclient==0.4.dev28.g6d64a2b
murano-repository==0.4.dev104.g2011079
python-muranoclient==0.3
ubuntu@murano-devbox-04-cond:~$ sudo pip install -U http://tarballs.openstack.org/murano-common/murano-common-master.tar.gz
Downloading/unpacking http://tarballs.openstack.org/murano-common/murano-common-master.tar.gz
  Downloading murano-common-master.tar.gz
  Running setup.py egg_info for package from http://tarballs.openstack.org/murano-common/murano-common-master.tar.gz
    [pbr] Processing SOURCES.txt
    warning: LocalManifestMaker: standard file '-c' not found

    warning: no previously-included files found matching '.gitignore'
    warning: no previously-included files found matching '.gitreview'
    warning: no previously-included files matching '*.pyc' found anywhere in distribution
    warning: no previously-included files found matching '.gitignore'
    warning: no previously-included files found matching '.gitreview'
Requirement already up-to-date: pbr>=0.5.21,<1.0 in /usr/local/lib/python2.7/dist-packages (from murano-common==0.2.1.5.gd633884)
Requirement already up-to-date: anyjson>=0.3.3 in /usr/local/lib/python2.7/dist-packages (from murano-common==0.2.1.5.gd633884)
Requirement already up-to-date: eventlet>=0.13.0 in /usr/local/lib/python2.7/dist-packages (from murano-common==0.2.1.5.gd633884)
Requirement already up-to-date: puka>=1.0.7c in /usr/local/lib/python2.7/dist-packages (from murano-common==0.2.1.5.gd633884)
Requirement already up-to-date: pip>=1.0 in /usr/local/lib/python2.7/dist-packages (from pbr>=0.5.21,<1.0->murano-common==0.2.1.5.gd633884)
Requirement already up-to-date: greenlet>=0.3 in /usr/local/lib/python2.7/dist-packages (from eventlet>=0.13.0->murano-common==0.2.1.5.gd633884)
Installing collected packages: murano-common
  Running setup.py install for murano-common
    [pbr] Reusing existing SOURCES.txt
Successfully installed murano-common
Cleaning up...
ubuntu@murano-devbox-04-cond:~$ sudo pip freeze | grep murano
Warning: cannot find svn location for distribute==0.6.24dev-r0
murano-api==0.2.dev170.g494bcc5
murano-common==0.2.1.5.gd633884
murano-conductor==0.2.dev205.gc1ef104
murano-dashboard==0.2.dev387.gf3afb58
murano-metadataclient==0.4.dev28.g6d64a2b
murano-repository==0.4.dev104.g2011079
python-muranoclient==0.3
ubuntu@murano-devbox-04-cond:~$

Revision history for this message
Serg Melikyan (smelikyan) wrote :

Fixed in https://review.openstack.org/58501

Changed in murano:
status: Confirmed → Fix Committed
Ekaterina Chernova (efedorova)
Changed in murano:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.