cluster_upgrade extension does not support multi-rack installations

[Ilya Kharin]

The cluster_upgrade extension does not support multi-rack installations and does not properly handle resources from different node groups.

Steps to reproduce:
 1. Install 8.0 environment with nodes assigned to multiple node groups:
      default: 3 x compute nodes
               3 x ceph-osd nodes
      r10: 3 x controller nodes
 2. Upgrade master node to 9.0
 3. Create upgrade environment:
      upgrade-env
 4. Upgrade primary controller:
      upgrade-node

Expected results:
 3. The new environment has the same set of node groups (default and r10) and the same set of networks per each node group.
 4. The primary controller after upgrade is assigned in the respective node group (r10) and all interfaces are assigned in respective networks for the r10 node group, a set of VIPs are the same in respective networks for the r10 node group.

Actual result:
 3. The new environment contains only the default node group with appropriate networks.
 4. The primary controller is assigned in the default node group not r10 and its interfaces are assigned in networks that are belong to the default node group. VIps are assigned to networks of the default node group not the r10 node group.

Reproducibility:
 Constantly.

Workaround:
 3. After the upgrade-env command create appropriate set of node groups and their networks via UI/CLI.
 4. Run upgrade-node with --no-provision flag, change a node group and an assignment of interfaces via UI/CLI, create VIPs vis CLI.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/362087

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/362135

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/362721

[OpenStack Infra (hudson-openstack)]

Change abandoned by Anastasia Balobashina (<email address hidden>) on branch: master
Review: https://review.openstack.org/362135

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/369463

[Bulat Gaifullin (bulat.gaifullin)]

there is workaround so this bug is not critical.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/362087
Committed: https://git.openstack.org/cgit/openstack/fuel-web/commit/?id=4a698e8f65addd0a46a105e374979cdb1d3d372e
Submitter: Jenkins
Branch: stable/mitaka

commit 4a698e8f65addd0a46a105e374979cdb1d3d372e
Author: Anastasiya <email address hidden>
Date: Mon Aug 29 15:39:16 2016 +0300

    Add initial support of multi-rack for upgrades

    * get_assigned_vips function returns assigned VIPs
      mapped to IDs (but not names) of network groups,
      because different node groups may have the same
      name of network groups
    * assign_given_vips_for_net_groups function tekes
      a dict of VIPs mapped to IDs of network groups
    * assigning group to node was changed for support
      several node groups

    Depends-On: I93e43be60dacc9ba5546cb50ba04a98bd35d276c
    Partial-bug: #1612297

    Change-Id: I2638279371e91f15090c782fc5fdbb434a2e85f8
    Co-Authored-By: Ryan Moe <email address hidden>
    Co-Authored-By: Andrew Woodward <email address hidden>
    Co-Authored-By: Ilya Kharin <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/362721
Committed: https://git.openstack.org/cgit/openstack/fuel-nailgun-extension-cluster-upgrade/commit/?id=263f8caff909cbc5b8be6bc52e4b05bd0ebe9a4b
Submitter: Jenkins
Branch: stable/mitaka

commit 263f8caff909cbc5b8be6bc52e4b05bd0ebe9a4b
Author: Anastasiya <email address hidden>
Date: Mon Aug 29 16:46:20 2016 +0300

    Add initial support of multi-rack for upgrades

    * netgroups mapping was changed (additional argument
      for the mapping was added - name of node group)
    * copying of node group during cluster cloning was added

    Partial-bug: #1612297

    Change-Id: Ib1689d7b6d673c0d78434dd047a7ebc520c232e7
    Co-Authored-By: Ryan Moe <email address hidden>
    Co-Authored-By: Andrew Woodward <email address hidden>
    Co-Authored-By: Ilya Kharin <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/369463
Committed: https://git.openstack.org/cgit/openstack/fuel-web/commit/?id=b435f58e7e491b4aca6d7268fbce43e4d44c75f5
Submitter: Jenkins
Branch: master

commit b435f58e7e491b4aca6d7268fbce43e4d44c75f5
Author: Anastasiya <email address hidden>
Date: Mon Aug 29 15:39:16 2016 +0300

    Add initial support of multi-rack for upgrades

    * get_assigned_vips function returns assigned VIPs
      mapped to IDs (but not names) of network groups,
      because different node groups may have the same
      name of network groups
    * assign_given_vips_for_net_groups function tekes
      a dict of VIPs mapped to IDs of network groups
    * assigning group to node was changed for support
      several node groups

    Depends-On: I93e43be60dacc9ba5546cb50ba04a98bd35d276c
    Partial-bug: #1612297

    Change-Id: I2638279371e91f15090c782fc5fdbb434a2e85f8
    Co-Authored-By: Ryan Moe <email address hidden>
    Co-Authored-By: Andrew Woodward <email address hidden>
    Co-Authored-By: Ilya Kharin <email address hidden>
    (cherry picked from commit 4d6ea865aa408ec913b6c8cde9af5426a1d99f6d)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/362135
Committed: https://git.openstack.org/cgit/openstack/fuel-nailgun-extension-cluster-upgrade/commit/?id=e2b9dbf1ca61b92c457722108eaf6dba95ac4f4b
Submitter: Jenkins
Branch: master

commit e2b9dbf1ca61b92c457722108eaf6dba95ac4f4b
Author: Anastasiya <email address hidden>
Date: Mon Aug 29 16:46:20 2016 +0300

    Add initial support of multi-rack for upgrades

    * netgroups mapping was changed (additional argument
      for the mapping was added - name of node group)
    * copying of node group during cluster cloning was added

    Depends-On: I2638279371e91f15090c782fc5fdbb434a2e85f8
    Partial-bug: #1612297

    Change-Id: Ib1689d7b6d673c0d78434dd047a7ebc520c232e7
    Co-Authored-By: Ryan Moe <email address hidden>
    Co-Authored-By: Andrew Woodward <email address hidden>
    Co-Authored-By: Ilya Kharin <email address hidden>