Host entries for large scale deployments are stored in heat in a suboptimal fashion

[Bogdan Dobrelya]

When there are many nodes, networks and VIPs, the string-based representation of /etc/hosts entries for those become inefficient. It may be also limited by max string size, when being passed to ansible or bash scripts.

Those should be stored and processed as lists and also deduplicated.

[OpenStack Infra (hudson-openstack)]

Related fix proposed to branch: master
Review: https://review.opendev.org/715431

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/715178
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=3b8e6f78e19e776c087dc5c3ff225703b5c487bc
Submitter: Zuul
Branch: master

commit 3b8e6f78e19e776c087dc5c3ff225703b5c487bc
Author: Bogdan Dobrelya <email address hidden>
Date: Thu Mar 26 12:26:53 2020 +0100

    Use lists for storing host entries in Heat

    This simplifies all the split/join transformations and improves the
    memory footprint to a reduced list of unique entries for
    HostsEntryValue (originally required for storing the ultimate data for
    hosts entries in a form of a quite long single-line string value).

    That improves the hosts entries processing for large scale deployments
    and removes possible limitations to the sizes of strings.

    Closes-bug: #1869375
    Change-Id: I5ac498621e9e3c49def565744a7b521cb2cc5c25
    Signed-off-by: Bogdan Dobrelya <email address hidden>

[OpenStack Infra (hudson-openstack)]

Change abandoned by Bogdan Dobrelya (bogdando) (<email address hidden>) on branch: master
Review: https://review.opendev.org/715431
Reason: https://review.opendev.org/#/c/716236

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/train
Review: https://review.opendev.org/716497

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/716497
Committed: https://git.openstack.org/cgit/openstack/tripleo-heat-templates/commit/?id=ba719349509727a29dc780857948393bce11aba1
Submitter: Zuul
Branch: stable/train

commit ba719349509727a29dc780857948393bce11aba1
Author: Bogdan Dobrelya <email address hidden>
Date: Thu Mar 26 12:26:53 2020 +0100

    Use lists for storing host entries in Heat

    This simplifies all the split/join transformations and improves the
    memory footprint to a reduced list of unique entries for
    HostsEntryValue (originally required for storing the ultimate data for
    hosts entries in a form of a quite long single-line string value).

    That improves the hosts entries processing for large scale deployments
    and removes possible limitations to the sizes of strings.

    Closes-bug: #1869375
    Change-Id: I5ac498621e9e3c49def565744a7b521cb2cc5c25
    Signed-off-by: Bogdan Dobrelya <email address hidden>
    (cherry picked from commit 3b8e6f78e19e776c087dc5c3ff225703b5c487bc)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-heat-templates 12.2.0 release.

[Emilien Macchi (emilienm)]

FYI https://review.opendev.org/739249 and https://bugs.launchpad.net/tripleo/+bug/1886203

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/tripleo-heat-templates 11.4.0 release.