Same failure was seen again in another of the Wind River lab: (yow-cgcs-wildcat-99-103):

Info below as requested Austin (comment #35):
(Fresh set of logs are attached - as generated by collect all)
(In this system compute-0 experienced the issue described above)


Contents of /opt/platform/puppet/19.01/hieradata/* attached as opt_platform_puppet_19.01_hieradata.tar.gz

[sysadmin@controller-0 ~(keystone_admin)]$ system host-memory-list compute-0
+-----------+---------+------------+---------+----------------+--------+--------+--------+-------+----------+--------+--------+----------+--------+----------+-------------------+---------------+
| processor | mem_tot | mem_platfo | mem_ava | hugepages(hp)_ | vs_hp_ | vs_hp_ | vs_hp_ | vs_hp | app_tota | app_hp | app_hp | app_hp_p | app_hp | app_hp_a | app_hp_pending_1G | app_hp_use_1G |
|           | al(MiB) | rm(MiB)    | il(MiB) | configured     | size(M | total  | avail  | _reqd | l_4K     | _total | _avail | ending_2 | _total | vail_1G  |                   |               |
|           |         |            |         |                | iB)    |        |        |       |          | _2M    | _2M    | M        | _1G    |          |                   |               |
+-----------+---------+------------+---------+----------------+--------+--------+--------+-------+----------+--------+--------+----------+--------+----------+-------------------+---------------+
| 0         | 5390    | 8000       | 5390    | True           | 1024   | 0      | 0      | None  | 1379840  | 0      | 0      | None     | 0      | 0        | None              | True          |
| 1         | 6023    | 2000       | 6023    | True           | 1024   | 0      | 0      | None  | 1541888  | 0      | 0      | None     | 0      | 0        | None              | True          |
+-----------+---------+------------+---------+----------------+--------+--------+--------+-------+----------+--------+--------+----------+--------+----------+-------------------+---------------+


[sysadmin@controller-0 ~(keystone_admin)]$ ssh compute-0 cat /etc/platform/worker_reserved.conf
sysadmin@compute-0's password: 
################################################################################
# Copyright (c) 2018 Wind River Systems, Inc.
#
# SPDX-License-Identifier: Apache-2.0
#
# - This file is managed by Puppet. DO NOT EDIT.
################################################################################
# WORKER Node configuration parameters for reserved memory and physical cores
# used by Base software and VSWITCH. These are resources that libvirt cannot use.
#

################################################################################
#
# List of logical CPU instances available in the system.  This value is used
# for auditing purposes so that the current configuration can be checked for
# validity against the actual number of logical CPU instances in the system.
#
################################################################################
WORKER_CPU_LIST="0-27"

################################################################################
#
# List of logical CPU instances that reserved for platform applications.
#
################################################################################
PLATFORM_CPU_LIST="0"

################################################################################
#
# List of Base software resources reserved per numa node. Each array element
# consists of a 3-tuple formatted as: <node>:<memory>:<cores>.
#
# Example: To reserve 1500MB and 1 core on NUMA node0, and 1500MB and 1 core
# on NUMA node1, the variable must be specified as follows.
#   WORKER_BASE_MEMORY=("node0:1500MB:1" "node1:1500MB:1")
#
################################################################################
WORKER_BASE_RESERVED=("node0:8000MB:1" "node1:2000MB:1")

################################################################################
#
# List of HugeTLB memory descriptors to configure.  Each array element
# consists of a 3-tuple descriptor formatted as: <node>:<pgsize>:<pgcount>.
# The NUMA node specified must exist and the HugeTLB pagesize must be a valid
# value such as 2048kB or 1048576kB.
#
# For example, to request 256 x 2MB HugeTLB pages on NUMA node0 and node1 the
# variable must be specified as follows.
#   COMPUTE_VSWITCH_MEMORY=("node0:2048kB:256" "node1:2048kB:256")
#
################################################################################
COMPUTE_VSWITCH_MEMORY=("node0:1048576kB:0" "node1:1048576kB:0")

################################################################################
#
# List of VSWITCH physical cores reserved for VSWITCH applications.
#
# Example: To reserve 2 cores on NUMA node0, and 2 cores on NUMA node1, the
# variable must be specified as follows.
#   COMPUTE_VSWITCH_CORES=("node0:2" "node1:2")
#
################################################################################
COMPUTE_VSWITCH_CORES=("node0:2")

################################################################################
#
# List of platform physical cores reserved for platform applications.
#
# Example: To reserve 1 core on NUMA node0, the variable must be specified
# as follows.
#   WORKER_PLATFORM_CORES=("node0:0")
#
################################################################################