resize rootfs and docker_lv for non-openstack worker nodes

[Brent Rowsell]

The rootfs and docker_lv need to be resized for non-openstack worker nodes.
After reserving the overhead fs (/var/log, scratch) the remaining space needs to be divided evenly between the rootfs and docker_lv

[Frank Miller (sensfan22)]

Changing assignee to Kristine who will implement a solution for this LP.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/668011

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/668011
Committed: https://git.openstack.org/cgit/starlingx/config/commit/?id=10a595f22da80959ffb73241bcd26b997545f00b
Submitter: Zuul
Branch: master

commit 10a595f22da80959ffb73241bcd26b997545f00b
Author: Kristine Bujold <email address hidden>
Date: Thu Jun 27 14:07:51 2019 -0400

    Create new host_fs postgres table

    Create a new host-fs postgres table to store information about a
    host’s filesystem. Replicated filesystem will continue to be stored
    in the controller_fs table.

    This commit creates the table. The sysinv agent creates the docker,
    backup and scratch filesystem for each supported host. If the
    filesystems have changed the audit triggers an update.

    These changes were testing with AIO-SX and Standard lab installs.

    Change-Id: I8167dfe74688c05fd8b747caac3d418d2749a740
    Partial-Bug: 1830142
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/669726

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/669880

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/669726
Committed: https://git.openstack.org/cgit/starlingx/config/commit/?id=aa8b5637f3f6f1434a3491bd085be6cdb7daab14
Submitter: Zuul
Branch: master

commit aa8b5637f3f6f1434a3491bd085be6cdb7daab14
Author: Kristine Bujold <email address hidden>
Date: Mon Jul 8 13:38:01 2019 -0400

    Create new host_fs CLI and API

    Create the new host_fs CLI commands and the APIs.
      system host-fs-list
      system host-fs-modify
      system host-fs-show

    Remove the backup, scratch and the docker filesystems from the
    controllerfs CLI as these are being managed by host-fs.

    Changed the host’s boot_device and rootfs_device default values
    to the full path name “/dev/sda”. Having “sda” only was causing
    get_disk_capacity_mib() to fail to locate the disk.

    The documentation for the API changes will be in another submit.

    These changes were tested in Standard VBOX, Hardware AIO-DX,
    Hardware with worker and also storage nodes. Installs and
    configration of the labs were done.

    Partial-Bug: 1830142

    Change-Id: I2ca6adf9c5e9debaf0f4a23e67fadf47f2eaf670
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/669880
Committed: https://git.openstack.org/cgit/starlingx/config/commit/?id=904b3e0070aceb42429710041bef26c2b154d627
Submitter: Zuul
Branch: master

commit 904b3e0070aceb42429710041bef26c2b154d627
Author: Kristine Bujold <email address hidden>
Date: Tue Jul 9 10:16:06 2019 -0400

    New host_fs APIs documentation

    Add documentation for the new host_fs APIs.

    Backup, scratch and the docker filesystems are no longer part of the
    controller_fs API. Updated the APIs accordingly.

    Partial-Bug: 1830142
    Depends-On: https://review.opendev.org/#/c/669726

    Change-Id: I0c3398fb4fdbde4e14d13133843059235ba2748c
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/669936

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/669936
Committed: https://git.openstack.org/cgit/starlingx/gui/commit/?id=87e7db406fb6e6e178cb2a9b55ee2832f2f52b90
Submitter: Zuul
Branch: master

commit 87e7db406fb6e6e178cb2a9b55ee2832f2f52b90
Author: Kristine Bujold <email address hidden>
Date: Tue Jul 9 15:58:38 2019 -0400

    Update Controller Filesystem

    The backup, scratch and the docker filesystems have been removed from the
    controller_fs CLI. This submit removes them from the GUI as well.

    Partial-Bug: 1830142

    Change-Id: Ibd30e942d443df991b2bca8de60af9d92d6498fa
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/671120

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/671305

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/671120
Committed: https://git.openstack.org/cgit/starlingx/metal/commit/?id=3aea82253e3c9ce53409ab34cc968c21f7c85ad0
Submitter: Zuul
Branch: master

commit 3aea82253e3c9ce53409ab34cc968c21f7c85ad0
Author: Kristine Bujold <email address hidden>
Date: Tue Jul 16 13:20:16 2019 -0400

    Increase cgts-vg size to accommodate new kubelet fs

    A new filesystem called "kubelet" is being added to all nodes with a
    default size of 10G. This commit increases the cgts-vg size to
    accommodate new kubelet fs on worker nodes.

    Tested with install of hardware Standard and AIO-DX labs. Also
    tested install of a vbox AIO-SX lab.

    Partial-Bug: 1830142

    Change-Id: I124a977e4c7ea9239a2d7cb04d0d42c4093bf4bb
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/671305
Committed: https://git.openstack.org/cgit/starlingx/config/commit/?id=e74ef5f7c4c71464347142932615e1545884133c
Submitter: Zuul
Branch: master

commit e74ef5f7c4c71464347142932615e1545884133c
Author: Kristine Bujold <email address hidden>
Date: Wed Jul 17 10:16:05 2019 -0400

    Add new kubelet filesystem to host_fs

    Add a new filesystem called "kubelet" to all hosts with a default
    size of 10G. This new fs will be managed by the host_fs API.

    Also made the scratch filesystem resizable on all hosts.

    Tested with install of hardware Standard and AIO-DX labs. Also
    tested install of a vbox AIO-SX lab.

    Partial-Bug: 1830142
    Depends-On: https://review.opendev.org/671120

    Change-Id: I968f84b8ba7a069ec3d7027d4eb4a7355a06d9d3
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/674360

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/674362

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/674365

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/674367

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/674370

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/674371

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/674399

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/674360
Committed: https://git.openstack.org/cgit/starlingx/config/commit/?id=c0d0a0360c88c1787d5139a8dd4b2e6205a1a7e9
Submitter: Zuul
Branch: master

commit c0d0a0360c88c1787d5139a8dd4b2e6205a1a7e9
Author: Kristine Bujold <email address hidden>
Date: Fri Aug 2 13:12:25 2019 -0400

    Collapse glance into platform in ControllerFS API

    The existing "platform" filesystem is now resizable and added to
    the ControllerFS API. The “glance” filesystem is merged into
    "platform" and therefore removed from the ControllerFS API. The
    "--force" flag is removed from the controllerfs-modify API as
    it was only used for glance fs resizing.

    The folder /opt/cgcs is removed and the “helm_charts” and “keystone”
    folders now resides under /opt/platform.

      ls /opt/platform/
      armada config helm nfv puppet sysinv

      ls /opt/cgcs/
      helm_charts keystone

    Resources related to drbd-cgcs and /opt/cgcs are removed from puppet
    or updated to use drbd-platform and /opt/platform.

    SM is no longer monitoring resources related to drbd-cgcs.

    Tested in AIO-SX, AIO-DX and Standard hardware labs.

    Partial-Bug: 1830142

    Change-Id: I0a80c95a057e9d6d2acec5f33cc4da31cd20955e
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/674399
Committed: https://git.openstack.org/cgit/starlingx/ansible-playbooks/commit/?id=256c40751ac94bcd3e6763a6c1a40187dbc8b7cc
Submitter: Zuul
Branch: master

commit 256c40751ac94bcd3e6763a6c1a40187dbc8b7cc
Author: Kristine Bujold <email address hidden>
Date: Fri Aug 2 13:54:27 2019 -0400

    Collapse the glance filesystem into platform

    The filesystem /opt/cgcs is removed and its content moved under
    /opt/platform.

    Resources related to drbd-cgcs and /opt/cgcs are updated to
    drbd-plaform and /opt/plaform or removed.

    Tested in AIO-SX, AIO-DX and Standard hardware labs.

    Depends-On: https://review.opendev.org/674360
    Partial-Bug: 1830142

    Change-Id: Id5bda3e8772cba1a8cd9f6d6d1fac221985dffc7
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/674367
Committed: https://git.openstack.org/cgit/starlingx/integ/commit/?id=daf33b135d802e137ee1d0ed8abcc313d4b4f22c
Submitter: Zuul
Branch: master

commit daf33b135d802e137ee1d0ed8abcc313d4b4f22c
Author: Kristine Bujold <email address hidden>
Date: Fri Aug 2 13:37:53 2019 -0400

    Collapse the glance filesystem into platform

    The filesystem /opt/cgcs is removed and its content moved under
    /opt/platform.

    Resources related to drbd-cgcs and /opt/cgcs are updated to
    drbd-plaform and /opt/plaform.

    Tested in AIO-SX, AIO-DX and Standard hardware labs.

    Depends-On: https://review.opendev.org/674360
    Partial-Bug: 1830142

    Change-Id: I6d0555f00ab269f7d9567fff365180b66adce8b3
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/674371
Committed: https://git.openstack.org/cgit/starlingx/update/commit/?id=9c9be7ff38f6252bb0e99586ff34f5571a45d31e
Submitter: Zuul
Branch: master

commit 9c9be7ff38f6252bb0e99586ff34f5571a45d31e
Author: Kristine Bujold <email address hidden>
Date: Fri Aug 2 13:51:33 2019 -0400

    Collapse the glance filesystem into platform

    The filesystem /opt/cgcs is removed and its content moved under
    /opt/platform.

    Tested in AIO-SX, AIO-DX and Standard hardware labs.

    Depends-On: https://review.opendev.org/674360
    Partial-Bug: 1830142

    Change-Id: I96392f293883d5583e51abfca8cac8e4c3d187a1
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/674370
Committed: https://git.openstack.org/cgit/starlingx/metal/commit/?id=c25d088367301e5002e4770374886796be656f52
Submitter: Zuul
Branch: master

commit c25d088367301e5002e4770374886796be656f52
Author: Kristine Bujold <email address hidden>
Date: Fri Aug 2 13:49:56 2019 -0400

    Collapse the glance filesystem into platform

    The filesystem /opt/cgcs is removed and its content moved under
    /opt/platform.

    Resources related to drbd-cgcs and /opt/cgcs are updated to
    drbd-platform and /opt/platform.

    Removed references of tis-extensions-controller as this RPM
    is no longer being built.

    Tested in AIO-SX, AIO-DX and Standard hardware labs.

    Depends-On: https://review.opendev.org/674360
    Partial-Bug: 1830142

    Change-Id: I49ee6023817b1ca14868b1bd5ab246f5a8c5d80b
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/674362
Committed: https://git.openstack.org/cgit/starlingx/gui/commit/?id=efc7fad093aed71b3c79ebf497eb1a487d3a03e9
Submitter: Zuul
Branch: master

commit efc7fad093aed71b3c79ebf497eb1a487d3a03e9
Author: Kristine Bujold <email address hidden>
Date: Fri Aug 2 13:25:12 2019 -0400

    Collapse glance into platform in ControllerFS API

    The existing “platform” filesystem is now resizable and added to
    the ControllerFS API. The “glance” filesystem is merged into
    platform and therefore removed from the ControllerFS API.

    This commits updates the GUI.

    Tested in AIO-DX hardware lab.

    Depends-On: https://review.opendev.org/674360
    Partial-Bug: 1830142

    Change-Id: I8ac6df7ccb3d393c00e4ff362f5a713ee7029ddc
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/674365
Committed: https://git.openstack.org/cgit/starlingx/ha/commit/?id=4ef138fcf18345344efd79f7f783a4358faf3705
Submitter: Zuul
Branch: master

commit 4ef138fcf18345344efd79f7f783a4358faf3705
Author: Kristine Bujold <email address hidden>
Date: Fri Aug 2 13:32:39 2019 -0400

    Collapse the glance filesystem into platform

    The filesystem /opt/cgcs is removed and the “helm_charts” and “keystone”
    folders now resides under /opt/platform.

      ls /opt/platform/
      armada config helm nfv puppet sysinv

      ls /opt/cgcs/
      helm_charts keystone

    Resources related to cgcs-drbd and /opt/cgcs are removed from puppet.
    SMS is no longer monitoring these resources.

    Tested in AIO-SX, AIO-DX and Standard hardware labs.

    Depends-On: https://review.opendev.org/674360
    Partial-Bug: 1830142

    Change-Id: I4be7a877efb89bb9e5c2b067bdc7e4259f2b0c0c
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/676002

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/676019

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/676019
Committed: https://git.openstack.org/cgit/starlingx/config/commit/?id=4f4d5dc5776ebb19b75a9fa17a054db6f93143cc
Submitter: Zuul
Branch: master

commit 4f4d5dc5776ebb19b75a9fa17a054db6f93143cc
Author: Kristine Bujold <email address hidden>
Date: Mon Aug 12 16:29:25 2019 -0400

    Add new kubelet filesystem to doc

    Add the new "kubelet" to documentation.

    Partial-Bug: 1830142

    Change-Id: I714f1312527491bece157dd1073160047d730eb8
    Signed-off-by: Kristine Bujold <email address hidden>

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/676002
Committed: https://git.openstack.org/cgit/starlingx/gui/commit/?id=0e983d72330438bb8522898ab3d000431af7d5dc
Submitter: Zuul
Branch: master

commit 0e983d72330438bb8522898ab3d000431af7d5dc
Author: Kristine Bujold <email address hidden>
Date: Mon Aug 12 14:07:38 2019 -0400

    Create a new Filesystems tab for hosts

    Create a new Filesystems tab for the new host-fs API under
    "Admin/Platform/Host Inventory/Host Detail".

    Partial-Bug: 1830142

    Change-Id: I4c964e00877fe99ed33ccd07cdaa4304a7f782c8
    Signed-off-by: Kristine Bujold <email address hidden>

[Ghada Khalil (gkhalil)]

As per discussion with Frank, we agreed to re-gate this to stx.3.0 and not have the changes cherry-picked to the stx.2.0 release branch due to the large # of commits related to this LP.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/680204

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/680204
Committed: https://git.openstack.org/cgit/starlingx/config/commit/?id=adce62065516414d5b5dd2f39fe4a0b5554eb78f
Submitter: Zuul
Branch: master

commit adce62065516414d5b5dd2f39fe4a0b5554eb78f
Author: Kristine Bujold <email address hidden>
Date: Fri Aug 2 13:51:33 2019 -0400

    Collapse the glance filesystem into platform

    The filesystem /opt/cgcs is removed and its content moved under
    /opt/platform.

    Tested in AIO-SX, AIO-DX and Standard hardware labs.

    Depends-On: https://review.opendev.org/674360
    Partial-Bug: 1830142
    Depends-On: I4c55186f939675cc2c3dc871ad03699d95c6091b
    Change-Id: I96392f293883d5583e51abfca8cac8e4c3d187a1
    Signed-off-by: Kristine Bujold <email address hidden>