Neutron server container failed to start when enabling VMware dvs

[Jamil Ahmed]

Hi,

I am using following environment and getting jason file error when I run deploy command. No special characters in any server name, esxi, vcenter, datacenter and DVS names.

I have tried both binary and source install and getting same issue.

----------------------------------------------------------------
OpenStack Release: Wallaby

Deployment node:
Ubuntu 20.04.2 LTS
Linux deployment 5.4.0-80-generic #90-Ubuntu SMP Fri Jul 9 22:49:44 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux
Docker version: 20.10.2 (apt installation)
Ansible version: 2.9.6 (apt installation)

Controller node:
Ubuntu 20.04.2 LTS
Linux controller 5.4.0-80-generic #90-Ubuntu SMP Fri Jul 9 22:49:44 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

Compute node:
Ubuntu 20.04.2 LTS
Linux compute 5.4.0-80-generic #90-Ubuntu SMP Fri Jul 9 22:49:44 UTC 2021 x86_64 x86_64 x86_64 GNU/Linux

Inventory: multinode
Kolla version: 12.1.0

VMware Environment:

Configured with DRS and a distributed switch.
vCenter: 6.5 17994927
ESXi: 6.5 8294253
DRS: Fully Automated

----------------------------------------------------------------
globals.yml file:

kolla_base_distro: "ubuntu"
kolla_install_type: "source"
openstack_release: "wallaby"
kolla_internal_vip_address: "10.116.10.66"
network_interface: "ens160"
neutron_external_interface: "ens192"
neutron_plugin_agent: "vmware_dvs"
nova_compute_virt_type: "vmware"
glance_backend_vmware: "yes"
vmware_vcenter_host_ip: "10.116.10.67"
vmware_vcenter_host_username: "<email address hidden>"
vmware_vcenter_host_password: "PASSWORD"
vmware_datastore_name: "vmsdatastore"
vmware_vcenter_name: "OpenStack"
vmware_vcenter_cluster_name: "selfservice"
vmware_vcenter_insecure: "True"
vmware_vcenter_datastore_regex: ".*"
vmware_dvs_host_ip: "10.116.10.67"
vmware_dvs_host_port: "443"
vmware_dvs_host_username: "<email address hidden>"
vmware_dvs_dvs_name: "openstackdvs"
vmware_dvs_dhcp_override_mac: ""

----------------------------------------------------------------

multinode file:

[control]
10.116.10.64 ansible_user=ansadmin ansible_password=PASSWORD ansible_become=true

[network:children]
control
[compute]
10.116.10.65 ansible_user=ansadmin ansible_password=PASSWORD ansible_become=true

[monitoring:children]
control

[deployment]
localhost ansible_connection=local become=true

----------------------------------------------------------------

passwords.yml file:

Generated using kolla-genpwd
updated passwords vmware passwords.

vmware_dvs_host_password:
vmware_vcenter_host_password:

----------------------------------------------------------------

Error:

kolla-ansible -i ./multinode deploy
.....

TASK [neutron : Creating Neutron database] *************************************************************************************************************
changed: [10.116.10.64 -> 10.116.10.64]

TASK [neutron : Creating Neutron database user and setting permissions] ********************************************************************************
changed: [10.116.10.64 -> 10.116.10.64]

TASK [neutron : Running Neutron bootstrap container] ***************************************************************************************************
fatal: [10.116.10.64 -> 10.116.10.64]: FAILED! => {"changed": true, "msg": "Container exited with non-zero return code 1", "rc": 1, "stderr": "+ sudo -E kolla_set_configs\nINFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json\nERROR:__main__:InvalidConfig: Invalid json file found at /var/lib/kolla/config_files/config.json\n", "stderr_lines": ["+ sudo -E kolla_set_configs", "INFO:__main__:Loading config file at /var/lib/kolla/config_files/config.json", "ERROR:__main__:InvalidConfig: Invalid json file found at /var/lib/kolla/config_files/config.json"], "stdout": "", "stdout_lines": []}

NO MORE HOSTS LEFT *************************************************************************************************************************************

PLAY RECAP *********************************************************************************************************************************************
10.116.10.64 : ok=239 changed=166 unreachable=0 failed=1 skipped=155 rescued=0 ignored=1
10.116.10.65 : ok=51 changed=32 unreachable=0 failed=0 skipped=53 rescued=0 ignored=0
localhost : ok=4 changed=0 unreachable=0 failed=0 skipped=0 rescued=0 ignored=0

[Radosław Piliszek (yoctozepto)]

Could you also include the config.json that was created? It is on the target host in /etc/kolla/neutron-server

[Mark Goddard (mgoddard)]

No need for config.json, I can see the issue in the template - missing comma.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/803883

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/803883
Committed: https://opendev.org/openstack/kolla-ansible/commit/2c786a0faf3895e917305cdfc3885134b220daed
Submitter: "Zuul (22348)"
Branch: master

commit 2c786a0faf3895e917305cdfc3885134b220daed
Author: Mark Goddard <email address hidden>
Date: Mon Aug 9 09:21:46 2021 +0100

    neutron: fix neutron-server config.json with VMware

    Missing comma in config.json template rendered invalid JSON with VMware
    plugin agent.

    Closes-Bug: #1939080

    Change-Id: I3d0c6421e3da7e1e753b99cf87c32fc238a21523

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/wallaby
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/803845

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/victoria
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/803846

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/ussuri
Review: https://review.opendev.org/c/openstack/kolla-ansible/+/803847

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/803845
Committed: https://opendev.org/openstack/kolla-ansible/commit/0e5f0b004a0c8e8c675cc996085a870b518f6c1c
Submitter: "Zuul (22348)"
Branch: stable/wallaby

commit 0e5f0b004a0c8e8c675cc996085a870b518f6c1c
Author: Mark Goddard <email address hidden>
Date: Mon Aug 9 09:21:46 2021 +0100

    neutron: fix neutron-server config.json with VMware

    Missing comma in config.json template rendered invalid JSON with VMware
    plugin agent.

    Closes-Bug: #1939080

    Change-Id: I3d0c6421e3da7e1e753b99cf87c32fc238a21523
    (cherry picked from commit 2c786a0faf3895e917305cdfc3885134b220daed)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/803847
Committed: https://opendev.org/openstack/kolla-ansible/commit/90c3cdc0ab58313d2f21bf768e9dcb32a1af0362
Submitter: "Zuul (22348)"
Branch: stable/ussuri

commit 90c3cdc0ab58313d2f21bf768e9dcb32a1af0362
Author: Mark Goddard <email address hidden>
Date: Mon Aug 9 09:21:46 2021 +0100

    neutron: fix neutron-server config.json with VMware

    Missing comma in config.json template rendered invalid JSON with VMware
    plugin agent.

    Closes-Bug: #1939080

    Change-Id: I3d0c6421e3da7e1e753b99cf87c32fc238a21523
    (cherry picked from commit 2c786a0faf3895e917305cdfc3885134b220daed)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/c/openstack/kolla-ansible/+/803846
Committed: https://opendev.org/openstack/kolla-ansible/commit/75c8f4383e86d6aceb82950685dfd135e240f96c
Submitter: "Zuul (22348)"
Branch: stable/victoria

commit 75c8f4383e86d6aceb82950685dfd135e240f96c
Author: Mark Goddard <email address hidden>
Date: Mon Aug 9 09:21:46 2021 +0100

    neutron: fix neutron-server config.json with VMware

    Missing comma in config.json template rendered invalid JSON with VMware
    plugin agent.

    Closes-Bug: #1939080

    Change-Id: I3d0c6421e3da7e1e753b99cf87c32fc238a21523
    (cherry picked from commit 2c786a0faf3895e917305cdfc3885134b220daed)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 12.2.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 13.0.0.0rc1 release candidate.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 10.4.0 release.

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/kolla-ansible 11.2.0 release.