the heat engine works slow compared with the direct provisioning engine

Bug #1277501 reported by Sergey Kolekonov
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Sahara
Fix Released
High
Alexander Ignatov

Bug Description

This bug was detected during integration tests execution. If we provision two equal clusters with direct engine and heat engine, the 'heat' cluster's state changes to "Active" 10-20 minutes later compared with the 'direct' cluster.

When we use the direct engine, we use Nova client to associate a floating IP address with an instance. But when we use the heat engine, Heat uses Neutron client to associate a floating IP address. Then we poll Nova to get the floating IP address and use it to configure a cluster. The problem is that Nova gets information about the floating IP address associated with the instance after 10-20 minutes if the IP was associated using the Neutron client.

For example, this is the console log of integration tests, and the only difference between them is the provisioning engine:
https://savanna.mirantis.com/logs/93/71793/1/check/gate-savanna-integration-vanilla/15463c1/console.html
https://savanna.mirantis.com/logs/93/71793/1/check/gate-savanna-integration-heat-vanilla/9657af6/console.html

Revision history for this message
Alexander Ignatov (aignatov) wrote :

 Thanks Sergey! Bad to know that...
I just wanted to mention that this bug is found in other projects as well https://bugs.launchpad.net/tempest/+bug/1262529.

Also we can crate a workaround in the code, to poll not nova VMs directly, but port list and grep floating ip in instance by its private ip, but we shoudl change the polling part in way to use neutron client instead of nova

Changed in savanna:
status: New → Confirmed
importance: Undecided → High
milestone: none → icehouse-3
Changed in savanna:
assignee: nobody → Alexander Ignatov (aignatov)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to savanna (master)

Fix proposed to branch: master
Review: https://review.openstack.org/73321

Changed in savanna:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to savanna (master)

Reviewed: https://review.openstack.org/73321
Committed: https://git.openstack.org/cgit/openstack/savanna/commit/?id=2e6f8e3d1ccf61677786f3426e3953b1238f6103
Submitter: Jenkins
Branch: master

commit 2e6f8e3d1ccf61677786f3426e3953b1238f6103
Author: Alexander Ignatov <email address hidden>
Date: Thu Feb 13 19:12:06 2014 +0400

    Speed up of Heat provisioning via Neutron

    * This fix adding one more attempt for checking of assigned floatingIP
      via neutron.
    * If nova returned instance id w/o floating ip assigned savanna tries to
      find it in floating IPs assosiated with port assigned to this
      instance.
    * This patch speed up Heat engine when neutron used up to 20 mins

    Change-Id: Id2213d45051d7b065b1938c6d96d60b2ac28153b
    Closes-Bug: #1277501

Changed in savanna:
status: In Progress → Fix Committed
Thierry Carrez (ttx)
Changed in savanna:
status: Fix Committed → Fix Released
Thierry Carrez (ttx)
Changed in sahara:
milestone: icehouse-3 → 2014.1
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.