Task based deployment openstack-controller and heat tasks are racy.

Bug #1544927 reported by Vladimir Kuklin
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Critical
Vladimir Kuklin
8.0.x
Confirmed
High
Vladimir Kuklin

Bug Description

There is a set of races for openstack-controller and heat tasks that make task-based deployment racy as they operate on the same keystone and rabbitmq instances in parallel

1. Openstack-controller task is buggy due to rabbitmq providers
2. Heat task creates keystone domain

Tags: area-library
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/279481

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/8.0)

Fix proposed to branch: stable/8.0
Review: https://review.openstack.org/279482

no longer affects: fuel/8.0.x
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-library (stable/8.0)

Change abandoned by Vladimir Kuklin (<email address hidden>) on branch: stable/8.0
Review: https://review.openstack.org/279482

Revision history for this message
Vladimir Kuklin (vkuklin) wrote :

The difference between importance for 9.0 and 8.0 is because for 8.0 task based deployment is experimental and for 9.0 it was switched on by default.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/279481
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=af747c3024e6ba5d6c52b476e64cbe7f06af930b
Submitter: Jenkins
Branch: master

commit af747c3024e6ba5d6c52b476e64cbe7f06af930b
Author: Vladimir Kuklin <email address hidden>
Date: Fri Feb 12 14:10:48 2016 +0300

    Fix race condition for nova and heat tasks

    This fix splits execution of tasks on controller
    nodes to avoid race conditions as puppet providers
    cannot handle conflicts properly during parallel
    application.

    Change-Id: I54099eb37051af12b1108ebca398d42b5c63d1f6
    Closes-bug: #1544927

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
Nastya Urlapova (aurlapova) wrote :

Verified on:
cat /etc/fuel_build_id:
 90
cat /etc/fuel_build_number:
 90
cat /etc/fuel_release:
 9.0
cat /etc/fuel_openstack_version:
 liberty-9.0
rpm -qa | egrep 'fuel|astute|network-checker|shotgun':
 fuel-library9.0-9.0.0-1.mos8133.noarch
 fuel-agent-9.0.0-1.mos261.noarch
 fuel-nailgun-9.0.0-1.mos8553.noarch
 fuel-misc-9.0.0-1.mos8133.noarch
 fuel-mirror-9.0.0-1.mos128.noarch
 fuel-bootstrap-cli-9.0.0-1.mos261.noarch
 fuel_plugin_example_v4_hotpluggable-4.0-4.0.0-1.noarch
 fuel-provisioning-scripts-9.0.0-1.mos8553.noarch
 network-checker-9.0.0-1.mos72.x86_64
 shotgun-9.0.0-1.mos84.noarch
 fuel-openstack-metadata-9.0.0-1.mos8553.noarch
 fuel-notify-9.0.0-1.mos8133.noarch
 fuel-setup-9.0.0-1.mos6316.noarch
 python-fuelclient-9.0.0-1.mos291.noarch
 fuelmenu-9.0.0-1.mos261.noarch
 fuel-9.0.0-1.mos6316.noarch
 fuel-utils-9.0.0-1.mos8133.noarch
 fuel-ostf-9.0.0-1.mos918.noarch
 fuel-release-9.0.0-1.mos6316.noarch
 rubygem-astute-9.0.0-1.mos724.noarch
 fuel-ui-9.0.0-1.mos2600.noarch
 fuel-migrate-9.0.0-1.mos8133.noarch

Changed in fuel:
status: Fix Committed → Won't Fix
status: Won't Fix → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.