Fuel for OpenStack

Wrong nova-manage service list response after upgrade 6.0 -> 8.0

Bug #1598240 reported by Sergey Abramov on 2016-07-01

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	Fuel for OpenStack	Fix Committed	High	Sergey Abramov	Fuel for OpenStack 8.0-updates

Bug Description

Detailed bug description:
After upgrade 6.0 to 8.0 nova-manage service list return wrong list
Steps to reproduce:
Upgrade env from 6.0 to 8.0 cluster
Actual result:
Binary Host Zone Status State Updated_At
nova-consoleauth node-1 internal enabled XXX 2016-06-03 16:04:55
nova-scheduler node-1 internal enabled XXX 2016-06-03 16:04:58
nova-conductor node-1 internal enabled XXX 2016-06-03 16:04:58
nova-cert node-1 internal enabled XXX 2016-06-03 16:04:55
nova-scheduler node-3 internal enabled XXX 2016-06-24 14:33:04
nova-consoleauth node-3 internal enabled XXX 2016-06-24 14:33:04
nova-conductor node-3 internal enabled XXX 2016-06-24 14:33:06
nova-consoleauth node-2 internal enabled XXX 2016-06-24 14:33:10
nova-scheduler node-2 internal enabled XXX 2016-06-24 14:33:10
nova-conductor node-2 internal enabled XXX 2016-06-24 14:33:02
nova-cert node-3 internal enabled XXX 2016-06-24 14:33:04
nova-cert node-2 internal enabled XXX 2016-06-24 14:33:07
nova-compute node-4 nova enabled XXX 2016-06-26 14:12:06
nova-compute node-6 nova enabled XXX 2016-06-26 14:12:03
nova-compute node-5 nova enabled XXX 2016-06-26 14:12:11
nova-cert node-1.domain.tld internal enabled :-) 2016-07-01 13:51:06
nova-consoleauth node-1.domain.tld internal enabled :-) 2016-07-01 13:51:06
nova-scheduler node-1.domain.tld internal enabled :-) 2016-07-01 13:51:08
nova-conductor node-1.domain.tld internal enabled :-) 2016-07-01 13:51:07
nova-consoleauth node-3.domain.tld internal enabled :-) 2016-07-01 13:51:06
nova-scheduler node-3.domain.tld internal enabled :-) 2016-07-01 13:51:08
nova-conductor node-3.domain.tld internal enabled :-) 2016-07-01 13:51:08
nova-cert node-3.domain.tld internal enabled :-) 2016-07-01 13:51:08
nova-scheduler node-2.domain.tld internal enabled :-) 2016-07-01 13:50:55
nova-consoleauth node-2.domain.tld internal enabled :-) 2016-07-01 13:50:52
nova-conductor node-2.domain.tld internal enabled :-) 2016-07-01 13:50:55
nova-cert node-2.domain.tld internal enabled :-) 2016-07-01 13:50:51
nova-compute node-4.domain.tld nova enabled :-) 2016-07-01 13:50:34
nova-compute node-6.domain.tld nova enabled :-) 2016-07-01 13:50:25
nova-compute node-5.domain.tld nova enabled :-) 2016-07-01 13:50:27

Expected results:
Binary Host Zone Status State Updated_At
nova-cert node-1.domain.tld internal enabled :-) 2016-07-01 13:51:06
nova-consoleauth node-1.domain.tld internal enabled :-) 2016-07-01 13:51:06
nova-scheduler node-1.domain.tld internal enabled :-) 2016-07-01 13:51:08
nova-conductor node-1.domain.tld internal enabled :-) 2016-07-01 13:51:07
nova-consoleauth node-3.domain.tld internal enabled :-) 2016-07-01 13:51:06
nova-scheduler node-3.domain.tld internal enabled :-) 2016-07-01 13:51:08
nova-conductor node-3.domain.tld internal enabled :-) 2016-07-01 13:51:08
nova-cert node-3.domain.tld internal enabled :-) 2016-07-01 13:51:08
nova-scheduler node-2.domain.tld internal enabled :-) 2016-07-01 13:50:55
nova-consoleauth node-2.domain.tld internal enabled :-) 2016-07-01 13:50:52
nova-conductor node-2.domain.tld internal enabled :-) 2016-07-01 13:50:55
nova-cert node-2.domain.tld internal enabled :-) 2016-07-01 13:50:51
nova-compute node-4.domain.tld nova enabled :-) 2016-07-01 13:50:34
nova-compute node-6.domain.tld nova enabled :-) 2016-07-01 13:50:25
nova-compute node-5.domain.tld nova enabled :-) 2016-07-01 13:50:27

Tags:

Dmitry Klenov (dklenov) on 2016-07-01

Changed in fuel:
milestone:	none → 8.0-updates
assignee:	nobody → Fuel Octane (fuel-octane-team)
importance:	Undecided → High
status:	New → Confirmed
tags:	added: area-python

OpenStack Infra (hudson-openstack) on 2016-07-27

Changed in fuel:
assignee:	Fuel Octane (fuel-octane-team) → Sergey Abramov (sabramov)
status:	Confirmed → In Progress

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-08-19: Fix merged to fuel-octane (master)

Reviewed: https://review.openstack.org/345908
Committed: https://git.openstack.org/cgit/openstack/fuel-octane/commit/?id=5af63290c1beded9b8c599d4139f95408521e370
Submitter: Jenkins
Branch: master

commit 5af63290c1beded9b8c599d4139f95408521e370
Author: Sergey Abramov <email address hidden>
Date: Thu Aug 4 11:19:35 2016 +0300

Clear old nova services

After upgrade from 6.x to 8.0 nova services host was renamed
from hostname to fqdn name.

Add clean part to cleanup cmd.

Closes-Bug: 1598240

Change-Id: Ie54c41cb3b8f6f9dcfb3a54bbeb75eb6a0eccb93

Changed in fuel:
status:	In Progress → Fix Committed

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-08-24: Fix proposed to fuel-octane (master)

Fix proposed to branch: master
Review: https://review.openstack.org/360083

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-08-24: Change abandoned on fuel-octane (master)

Change abandoned by Yuriy Taraday (<email address hidden>) on branch: master
Review: https://review.openstack.org/360083

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-08-24: Fix proposed to fuel-octane (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/360085

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2016-08-24: Fix merged to fuel-octane (stable/mitaka)

Download full text (7.9 KiB)

Reviewed: https://review.openstack.org/360085
Committed: https://git.openstack.org/cgit/openstack/fuel-octane/commit/?id=3543a79b0b25a9178ed2d25d482fa44bc2e62a35
Submitter: Jenkins
Branch: stable/mitaka

commit 6532feb5cfd030c7c373c7ff53e81de5504e50f2
Author: Sergey Abramov <email address hidden>
Date: Wed Aug 24 19:02:01 2016 +0300

Add the fuel2 release clone command

This command creates a clone of the given release that is suitable to
perform upgrade on it.

Depends-On: Ib2387b9c2b74902c7289ee8f69a5f5d323ec82ca
Change-Id: If7ca2b2dfa8b133d8c6575aa403826b98215c61d

commit ea198532b1d25dfd20a1638dc60eaf39a0a25505
Author: Ilya Kharin <email address hidden>
Date: Wed Aug 24 20:49:38 2016 +0300

Perform flavor_data_migration before to backup DB

    Migration of flavors data have to be performed in Kilo before to upgrade
    to Liberty and Mitaka releases. Also, Nova commands to perform schema
    migrations were modified to correlated with the Mitaka release.

Change-Id: I092435951644d816933fbd1d00b6fa16903cdd8c

commit 3c2bb12df33d87852494c310631259e0ecd9ba2c
Author: Nikita Zubkov <email address hidden>
Date: Wed Aug 3 19:42:16 2016 +0300

Move partition info transformation to extension

remove from octane `update_node_partition_info.py` and replace it with
extension api call

Depends-On: I422bb368916f3a319e286edcc6103a2834097a87
Change-Id: Ifdd6bcd22304db9cd3092f2b6562296741faa7fd

commit 2ebcb25eedb621bb33eb2ae8679dc2eef0e279ef
Author: Anastasiya <email address hidden>
Date: Thu Aug 18 14:13:34 2016 +0300

Add preupgrade compute

* preuepgrade_compute command was added
* util functions for change_repositories was added

Change-Id: I745b691fb701960c5cc8a384643e5fa72553978e

commit 12611efbc8581ecbbda060debf1a082c62e28446
Author: Alexis Rivera De La Torre (gardlt) <email address hidden>
Date: Wed Aug 17 11:37:29 2016 -0500

adding-apt-update-functionality

* adding apt tool to update package

    Closes-bug: #1614600
    Co-Authored-By: Anastasiya Tolochkova <email address hidden>
    Co-Authored-By: Ilya Kharin <email address hidden>
    Change-Id: I6651055e798c01e22b9ba2b6fe573bb2abf7231c

commit 0459cc0bb98fd4986e9ea86191fef11405a77a7b
Author: Sergey Abramov <email address hidden>
Date: Mon Aug 22 17:47:59 2016 +0300

Change osd settings on osd-upgrade

Change-Id: I4f1e41b803a03e6e6ef345dce8b82cc1b71cde22

commit bf77a7a9474bb5c199f5ab794fd0715bd69a411d
Author: Sergey Abramov <email address hidden>
Date: Tue Aug 23 12:34:06 2016 +0300

Move get_ceph_conf_filename to util

required for reusing this functions in other commands

Change-Id: If53610e5b47eeb8364b5c6c74c80ad32f329c708

commit 45a145d4a43271c4a24abf7d3c3cfe80b0cb84de
Author: Anastasiya <email address hidden>
Date: Tue Aug 23 14:57:17 2016 +0300

Change calculations of upgrade_levels

upgrade_levels = seed env version - 1

Change-Id: Ie9e8d4defcb41adf26f5efe90edd90092fdddbce

commit 4e0722e11ef1589cf3784bec0aa01bea3483756a
Author: Ilya Kharin <email address hidden>
Date: Tue Aug 23 01:05:49 2...

Reviewed:  https://review.openstack.org/360085
Committed: https://git.openstack.org/cgit/openstack/fuel-octane/commit/?id=3543a79b0b25a9178ed2d25d482fa44bc2e62a35
Submitter: Jenkins
Branch:    stable/mitaka

commit 6532feb5cfd030c7c373c7ff53e81de5504e50f2
Author: Sergey Abramov <sabramov@mirantis.com>
Date:   Wed Aug 24 19:02:01 2016 +0300

Add the fuel2 release clone command
    
    This command creates a clone of the given release that is suitable to
    perform upgrade on it.
    
    Depends-On: Ib2387b9c2b74902c7289ee8f69a5f5d323ec82ca
    Change-Id: If7ca2b2dfa8b133d8c6575aa403826b98215c61d

commit ea198532b1d25dfd20a1638dc60eaf39a0a25505
Author: Ilya Kharin <akscram@gmail.com>
Date:   Wed Aug 24 20:49:38 2016 +0300

Perform flavor_data_migration before to backup DB
    
    Migration of flavors data have to be performed in Kilo before to upgrade
    to Liberty and Mitaka releases. Also, Nova commands to perform schema
    migrations were modified to correlated with the Mitaka release.
    
    Change-Id: I092435951644d816933fbd1d00b6fa16903cdd8c

commit 3c2bb12df33d87852494c310631259e0ecd9ba2c
Author: Nikita Zubkov <nzubkov@mirantis.com>
Date:   Wed Aug 3 19:42:16 2016 +0300

Move partition info transformation to extension
    
    remove from octane `update_node_partition_info.py` and replace it with
    extension api call
    
    Depends-On: I422bb368916f3a319e286edcc6103a2834097a87
    Change-Id: Ifdd6bcd22304db9cd3092f2b6562296741faa7fd

commit 2ebcb25eedb621bb33eb2ae8679dc2eef0e279ef
Author: Anastasiya <atolochkova@mirantis.com>
Date:   Thu Aug 18 14:13:34 2016 +0300

Add preupgrade compute
    
    * preuepgrade_compute command was added
    * util functions for change_repositories was added
    
    Change-Id: I745b691fb701960c5cc8a384643e5fa72553978e

commit 12611efbc8581ecbbda060debf1a082c62e28446
Author: Alexis Rivera De La Torre (gardlt) <garivera89@gmail.com>
Date:   Wed Aug 17 11:37:29 2016 -0500

adding-apt-update-functionality
    
    * adding apt tool to update package
    
    Closes-bug: #1614600
    Co-Authored-By: Anastasiya Tolochkova <atolochkova@mirantis.com>
    Co-Authored-By: Ilya Kharin <akscram@gmail.com>
    Change-Id: I6651055e798c01e22b9ba2b6fe573bb2abf7231c

commit 0459cc0bb98fd4986e9ea86191fef11405a77a7b
Author: Sergey Abramov <sabramov@mirantis.com>
Date:   Mon Aug 22 17:47:59 2016 +0300

Change osd settings on osd-upgrade
    
    Change-Id: I4f1e41b803a03e6e6ef345dce8b82cc1b71cde22

commit bf77a7a9474bb5c199f5ab794fd0715bd69a411d
Author: Sergey Abramov <sabramov@mirantis.com>
Date:   Tue Aug 23 12:34:06 2016 +0300

Move get_ceph_conf_filename to util
    
    required for reusing this functions in other commands
    
    Change-Id: If53610e5b47eeb8364b5c6c74c80ad32f329c708

commit 45a145d4a43271c4a24abf7d3c3cfe80b0cb84de
Author: Anastasiya <atolochkova@mirantis.com>
Date:   Tue Aug 23 14:57:17 2016 +0300

Change calculations of upgrade_levels
    
    upgrade_levels = seed env version - 1
    
    Change-Id: Ie9e8d4defcb41adf26f5efe90edd90092fdddbce

commit 4e0722e11ef1589cf3784bec0aa01bea3483756a
Author: Ilya Kharin <akscram@gmail.com>
Date:   Tue Aug 23 01:05:49 2016 +0300

Release is a required parameter for upgrade-env
    
    The upgrade-env no longer tries to guess a suitable release for the new
    environment because it's now a required parameter for this command.
    
    Some obsolet vaerifications of a release were removed too because they
    are checked in the cluster_upgrade extension.
    
    Change-Id: Id47229b943e1698c0336a45b1f1481df8a583eed

commit ce538dca84ac272b3c1d40e88ff5daaedc366625
Author: Nikita Zubkov <nzubkov@mirantis.com>
Date:   Mon Aug 22 19:19:49 2016 +0300

Fix mysql calls
    
    Pass --user param to mysql and mysqldump comands
    
    Closes-Bug: #1606504
    Change-Id: I881b6912320d1c38b7d87503020c6650bcf137b7

commit dab67b9922055283c69a49e38468309f9116af34
Author: Pavel Chechetin <pchechetin@mirantis.com>
Date:   Fri Aug 19 11:17:50 2016 +0300

Graph-based upgrade-db. Ironic support.
    
    It hasn't been tested in a lab with Ironic
    
    Change-Id: I65f5bef8277d9786053b3447800c278b04cf62a7

commit eb28c36bbda61da0595e210fd3aea9971a61b0f0
Author: Pavel Chechetin <pchechetin@mirantis.com>
Date:   Mon Aug 22 11:04:07 2016 +0300

Add encryption for DB transportation
    
    Add `bash` provider for resource `exec` in order to handle errors more reliably
    
    Proper ownership attributes are set for octane_data directory
    
    Copy & paste error in seed/upgrade-db.yaml is fixed
    
    Change-Id: I715701a079f06e11480738427305d8b1389f6566

commit 32fd88faa109fc10768855853091a70773c873d2
Author: Ilya Kharin <akscram@gmail.com>
Date:   Mon Aug 22 00:05:42 2016 +0300

Raise NotImplementedError in the base archivator
    
    Use an exception for not implemented methods which is suitable to be
    used in such cases.
    
    Change-Id: Ibd3126d55ef8986ee431d61e76bfe89453891f67

commit 9696c5b84e29314eef9ccd1a59a9863c8114f305
Author: Anastasiya <atolochkova@mirantis.com>
Date:   Mon Aug 8 15:21:59 2016 +0300

Change skipping of tasks
    
    because since Fuel 9.0 approach to deployment was changed
    
    * function deploy_nodes_without_tasks was added
    * using skip_tasks function was removed from node upgrade
    
    Change-Id: I37177b90a2404d4ec41296fd726f368d90e30851
    Closes-bug: 1603960

commit 3db5c7ab719a9d58e0ed093ab3942d4812b911aa
Author: Anastasiya <atolochkova@mirantis.com>
Date:   Fri Aug 5 10:23:16 2016 +0300

Refactoring writing deployment info
    
    * function write_facts_to_dir was added
    * function get_dir_deployment_info was added
    * appropriate tests were added
    
    Change-Id: Ic06d5b0a220c77e2fe1551f129651627a1ef9785

commit e36b2ead843e5b3d00baf88d9ebead428e2eec0a
Author: Roman Sokolkov <rsokolkov@mirantis.com>
Date:   Wed Aug 17 16:07:50 2016 +0300

Added new step to upgrade-db required for Kilo
    
      - Added new puppet manifest to execute db migrations
      - Added tasks to original graph
    
    Change-Id: Id6b1b9db3291551ca6b9aa4890871dd353d5f655

commit aabaa3c8c051a68aa1aee1c12ccc563705519d74
Author: Anastasiya <atolochkova@mirantis.com>
Date:   Wed Aug 17 13:39:06 2016 +0300

Add stoping apache2 service during maintenance mode
    
    because function stop_upstart_services stops only upstart services
    
    Change-Id: Ic25a5aab98dfb39708eb19d62c72ab212421be61

commit 9ef15eb9b52f20b4a9c4221ceccd009284f4321a
Author: Pavel Chechetin <pchechetin@mirantis.com>
Date:   Wed Aug 17 18:47:24 2016 +0300

Rename graphs's names to reduce repetition
    
    Change-Id: If3908b90e973ec0e14143c6987cb7dcd0bbcffce

commit 7fbc2e57ef49e6f33801ef9671f4de596b10d4a2
Author: Ilya Kharin <akscram@gmail.com>
Date:   Tue Jul 26 23:52:56 2016 +0300

Remove admin_token_auth from keystone pipelines
    
    The presence of the admin_token_auth middleware is needed only to apply
    the keystone puppet task during the restore phase. This middleware
    allows to authorize with admin_token and configure things in Keystone.
    After the successful re-initialization of Keystone this middleware
    should be removed from pipelines alongside with restarting the keystone
    service because of security reasons.
    
    Change-Id: Id98d8f25270538ab850af936eff749f0277e0c58

commit 3f72a80f14dae1eab7665608a73f7f61678d2a5b
Author: Pavel Chechetin <pchechetin@mirantis.com>
Date:   Wed Aug 17 13:34:46 2016 +0300

Add Gemfile.lock and README.md to octane_tasks module
    
    Change-Id: I1b2ba74e9c51b49c37f80375dff3647da8edd1d9

commit 5af63290c1beded9b8c599d4139f95408521e370
Author: Sergey Abramov <sabramov@mirantis.com>
Date:   Thu Aug 4 11:19:35 2016 +0300

Clear old nova services
    
    After upgrade from 6.x to 8.0 nova services host was renamed
    from hostname to fqdn name.
    
    Add clean part to cleanup cmd.
    
    Closes-Bug: 1598240
    
    Change-Id: Ie54c41cb3b8f6f9dcfb3a54bbeb75eb6a0eccb93

tags:

added: in-stable-mitaka

Revision history for this message

OpenStack Infra (hudson-openstack) wrote on 2021-09-06: Fix included in openstack/fuel-octane ocata-eol

This issue was fixed in the openstack/fuel-octane ocata-eol release.