STX: compute services failure, failed to enable guest services

[Peng Peng]

Brief Description
-----------------
After lab_setup, alarm "compute services failure, failed to enable guest services" shows and system is not able to boot up VM.

Severity
--------
Critical

Steps to Reproduce
------------------
Install Load: 2018-11-22_20-18-01

Expected Behaviour
------------------
install done without 270.001 alarm and system could boot up VMs

Actual Behaviour
----------------
There is 270.001 alarm after installation. No VM boot up successfully

Reproducibility
---------------
Reproducible
100%

System Configuration
--------------------
One node system
Dedicated storage

Branch/Pull Time/Commit
-----------------------
master as of 2018-11-22_20-18-01

Timestamp/Logs
--------------
(2018-11-23 06:41:34) [INFO] [MainThread] source /etc/nova/openrc; fm alarm-list --nowrap
(2018-11-23 06:41:37) [INFO] [MainThread] echo [$?]
(2018-11-23 06:41:37) [INFO] [MainThread] Match: [0]
(2018-11-23 06:41:37) [INFO] [MainThread] Output:
+----------+-----------------------------------------------------------------------------+------------------------------------+----------+----------------------------+
| Alarm ID | Reason Text | Entity ID | Severity | Time Stamp |
+----------+-----------------------------------------------------------------------------+------------------------------------+----------+----------------------------+
| 100.114 | NTP configuration does not contain any valid or reachable NTP servers. | host=controller-0.ntp | major | 2018-11-23T06:36:59.981305 |
| 270.001 | Host controller-0 compute services failure, failed to enable guest services | host=controller-0.services=compute | critical | 2018-11-23T06:27:16.367093 |
+----------+-----------------------------------------------------------------------------+------------------------------------+----------+----------------------------+
(2018-11-23 06:41:37) [INFO] [MainThread] Return code: 0

[2018-11-23 06:46:40,356] 263 DEBUG MainThread ssh.send :: Send 'nova --os-username 'tenant2' --os-password 'Li69nux*' --os-project-name tenant2 --os-auth-url http://127.168.204.2:5000/v3 --os-user-domain-name Default --os-project-domain-name Default --os-endpoint-type internalURL --os-region-name RegionOne boot --flavor d6870575-d111-4178-8629-a7f4ad80db2c --user-data /home/wrsroot//userdataubuntu_3nic_cloud_init_if_conf.sh --boot-volume d0ea1ad4-73e9-4bdc-bbfb-c39091748223 --key-name keypair-tenant2 --nic vif-model=virtio,net-id=e3febeeb-99b9-4461-878b-e46385605525 --nic vif-model=virtio,net-id=55deebb2-4068-4704-8530-e313e42306a3 --nic vif-model=virtio,net-id=027bafa1-42d3-4110-9480-c1276c767ce1 tenant2-ubuntu_14_vifs-1 --poll'
[2018-11-23 06:46:50,890] 389 DEBUG MainThread ssh.expect :: Output:
+--------------------------------------+-------------------------------------------------+
| Property | Value |
+--------------------------------------+-------------------------------------------------+
| OS-DCF:diskConfig | MANUAL |
| OS-EXT-AZ:availability_zone | |
| OS-EXT-STS:power_state | 0 |
| OS-EXT-STS:task_state | scheduling |
| OS-EXT-STS:vm_state | building |
| OS-SRV-USG:launched_at | - |
| OS-SRV-USG:terminated_at | - |
| accessIPv4 | |
| accessIPv6 | |
| adminPass | krooY5fxL3eH |
| config_drive | |
| created | 2018-11-23T06:46:45Z |
| description | - |
| flavor:disk | 3 |
| flavor:ephemeral | 0 |
| flavor:extra_specs | {"hw:cpu_policy": "dedicated"} |
| flavor:original_name | dedicated |
| flavor:ram | 1024 |
| flavor:swap | 0 |
| flavor:vcpus | 1 |
| hostId | |
| id | 0fb326aa-1d1f-4f46-a677-94cd4e5dac19 |
| image | Attempt to boot from volume - no image supplied |
| key_name | keypair-tenant2 |
| locked | False |
| metadata | {} |
| name | tenant2-ubuntu_14_vifs-1 |
| os-extended-volumes:volumes_attached | [] |
| progress | 0 |
| security_groups | default |
| status | BUILD |
| tags | [] |
| tenant_id | 3446b610d0dd4cb7aa09df7b1b7f1f66 |
| updated | 2018-11-23T06:46:45Z |
| user_id | f96f2237cb9043aaae8e2a6295c38382 |
| wrs-if:nics | |
| wrs-res:pci_devices | |
| wrs-res:topology | node:-, 1024MB, pgsize:4K, vcpus:1 |
| wrs-res:vcpus | [1, 1, 1] |
| wrs-sg:server_group | |
+--------------------------------------+-------------------------------------------------+

Server building... 0% complete
Error building server
ERROR (ResourceInErrorState): `Server` resource is in the error state due to 'No valid host was found. There are not enough hosts available.No filter information'.
[wrsroot@controller-0 ~(keystone_admin)]$

[Eric MacDonald (rocksolidmtce)]

The following update introduced this bug

https://review.openstack.org/#/c/617835

The issue is understood and a fix is implemented and being tested.

Update will be delivered today.

[Eric MacDonald (rocksolidmtce)]

A fix for this issue is up for review.

[Ghada Khalil (gkhalil)]

Fixed by: https://review.openstack.org/#/c/619785/
merged on Nov 23/2018