Murano failed to deploy environment with a lot of reconnect to RabbitMQ and with error Please set external gateway for the router murano-default-router

Bug #1493105 reported by Viktoria Efimova
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Mirantis OpenStack
Fix Released
High
Nikolay Starodubtsev
7.0.x
Fix Released
High
Nikolay Starodubtsev
8.0.x
Fix Released
High
Nikolay Starodubtsev

Bug Description

Under rally tests which deploy 8 environments with ActiveDirectory in parallel Murano failed to deploy two of them with error: Please set external gateway for the router murano-default-router

logs:
http://paste.openstack.org/show/450231/

Deployment:
Build 182, 3 Controllers, 47 Computes, VLAN+DVR

Log snapshot at http://mos-scale-share.mirantis.com/fuel-snapshot-2015-09-04_11-53-02.tar.xz

murano upstream bug: https://bugs.launchpad.net/murano/+bug/1493883

Tags: murano scale
description: updated
Changed in mos:
assignee: nobody → MOS Murano (mos-murano)
Alexey Khivin (akhivin)
description: updated
summary: - Murano failed to deploy environment with error Please set external
- gateway for the router murano-default-router
+ Murano failed to deploy environment with a lot of reconnect to RabbitMQ
+ and with error Please set external gateway for the router murano-
+ default-router
description: updated
Revision history for this message
Serg Melikyan (smelikyan) wrote :
Revision history for this message
Vitaly Sedelnik (vsedelnik) wrote :

Murano team, please review the fix and backport to 7.0 if applicable. If not, please update the status accordingly (Won't Fix or Invalid).

Revision history for this message
Vitaly Sedelnik (vsedelnik) wrote :

Added 70mu1-confirmed tag per email update from Serg Melikyan

tags: added: 70mu1-confirmed
Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix proposed to openstack/murano (openstack-ci/fuel-7.0/2015.1.0)

Fix proposed to branch: openstack-ci/fuel-7.0/2015.1.0
Change author: Nikolay Starodubtsev <email address hidden>
Review: https://review.fuel-infra.org/12862

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix proposed to openstack/murano (openstack-ci/fuel-7.0/2015.1.0)

Related fix proposed to branch: openstack-ci/fuel-7.0/2015.1.0
Change author: Nikolay Starodubtsev <email address hidden>
Review: https://review.fuel-infra.org/12863

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Related fix merged to openstack/murano (openstack-ci/fuel-7.0/2015.1.0)

Reviewed: https://review.fuel-infra.org/12863
Submitter: Vitaly Sedelnik <email address hidden>
Branch: openstack-ci/fuel-7.0/2015.1.0

Commit: c3de85a8413bd5e2696435a7a62b26055f07baa5
Author: Nikolay Starodubtsev <email address hidden>
Date: Tue Oct 27 14:19:08 2015

Fix an error with wrong argument

Fix using of malformed argument in retry decorator. It should use
check which will return True\False instead of exception types.

Related-Bug: #1493105
Change-Id: I10bc8db1db1fd0791012de85def7ed92e9f05076

Revision history for this message
Fuel Devops McRobotson (fuel-devops-robot) wrote : Fix merged to openstack/murano (openstack-ci/fuel-7.0/2015.1.0)

Reviewed: https://review.fuel-infra.org/12862
Submitter: Vitaly Sedelnik <email address hidden>
Branch: openstack-ci/fuel-7.0/2015.1.0

Commit: d389612397bd607ab015339976bdb5490e2ec57a
Author: Nikolay Starodubtsev <email address hidden>
Date: Tue Oct 27 14:19:08 2015

Fix race condition with router creation

Previously when murano deployed a bunch of environments from scratch
it was possible to have an error during router creation. Router was
created by env_1 and before it was fully configure it was accessed by
env_2 and then the error occurred.

Closes-Bug: #1493105
Change-Id: I6dcd281a24825bb9c2ae09f45009faa6eca5a451

tags: removed: 70mu1-confirmed
Revision history for this message
Anastasia Kuznetsova (akuznetsova) wrote :

Bug verification in 7.0-mu1 blocked by https://bugs.launchpad.net/mos/+bug/1513497

Revision history for this message
Mikhail Chernik (mchernik) wrote :

Passed.
Verified 11/11/2015 on 200 nodes environment, 7.0-mu1
Test scenario and results: http://paste.openstack.org/show/478518/

Revision history for this message
Anastasia Kuznetsova (akuznetsova) wrote :

As far as fix for this bug was merged in liberty (that means that fix will be in 8.0 by default) and fix was backported to kilo and 7.0-mu1, where it was successfully tested, I guess that this bug can be closed in 8.0 too.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.