SM provison fails with fatal error in provision_vrouter.py

[wenqing liang]

In SM provision of 4.1.0.0-53~newton

+----------+---------------------+------------+-------------------+
| id | status | ip_address | mac_address |
+----------+---------------------+------------+-------------------+
| server6 | provision_failed | 10.0.0.9 | 02:1C:EE:59:B1:EC |
| server4 | provision_failed | 10.0.0.7 | 02:FD:76:9E:AF:F7 |
| server1 | provision_completed | 10.0.0.4 | 02:F7:2B:AC:FC:DE |
| server9 | provision_failed | 10.0.0.12 | 02:37:3C:AA:3F:78 |
| server3 | provision_completed | 10.0.0.6 | 02:60:CA:E6:20:50 |
| server7 | provision_failed | 10.0.0.10 | 02:30:03:13:8E:99 |
| server8 | provision_failed | 10.0.0.11 | 02:F9:7A:30:CE:94 |
| server2 | provision_completed | 10.0.0.5 | 02:95:BC:98:CF:ED |
| server5 | provision_failed | 10.0.0.8 | 02:3D:C2:0F:E4:BE |
| server10 | provision_failed | 10.0.0.13 | 02:AA:05:5C:F9:FE |
+----------+---------------------+------------+-------------------+

            "provision_role_sequence": "{'completed': [(u'server2', 'keepalived', '2017_09_15__01_21_49'), (u'server1', 'keepalived', '2017_09_15__01_21_50'), (u'server3', 'keepalived', '2017_09_15__01_21_51'), (u'server2', 'haproxy', '2017_09_15__01_22_21'), (u'server1', 'haproxy', '2017_09_15__01_22_22'), (u'server3', 'haproxy', '2017_09_15__01_22_23'), (u'server3', 'openstack', '2017_09_15__01_32_55'), (u'server2', 'openstack', '2017_09_15__01_33_05'), (u'server1', 'openstack', '2017_09_15__01_36_32'), (u'server1', 'pre_exec_vnc_galera', '2017_09_15__01_38_00'), (u'server3', 'pre_exec_vnc_galera', '2017_09_15__01_39_11'), (u'server2', 'pre_exec_vnc_galera', '2017_09_15__01_40_24'), (u'server1', 'post_exec_vnc_galera', '2017_09_15__01_41_00'), (u'server3', 'post_exec_vnc_galera', '2017_09_15__01_41_18'), (u'server2', 'post_exec_vnc_galera', '2017_09_15__01_41_42'), (u'server3', 'post_provision', '2017_09_15__01_41_59'), (u'server1', 'post_provision', '2017_09_15__01_42_19'), (u'server2', 'post_provision', '2017_09_15__01_42_20')], 'steps': []}",

"2017-09-15 01:53:53,453-INFO-sm_ansible_callback.py:46-append(): fatal: [10.0.0.7]Traceback (most recent call last):
  File "/usr/share/contrail-utils/provision_vrouter.py", line 248, in <module>
    main()
  File "/usr/share/contrail-utils/provision_vrouter.py", line 244, in main
    VrouterProvisioner(args_str)
  File "/usr/share/contrail-utils/provision_vrouter.py", line 54, in __init__
    self.add_vhost0_vmi()
  File "/usr/share/contrail-utils/provision_vrouter.py", line 217, in add_vhost0_vmi
    self._vnc_lib.virtual_machine_interface_create(vhost0_vmi)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 42, in wrapper
    return func(self, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 479, in _object_create
    rest.OP_POST, obj_cls.create_uri, data=json_body)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 855, in _request_server
    retry_after_authn=retry_after_authn, retry_count=retry_count)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 933, in _request
    % (op, url, data, content))
cfgm_common.exceptions.NoIdError: Unknown id: Error: oper 1 url /virtual-machine-interfaces body {"virtual-machine-interface":{"parent_type": "virtual-router", "fq_name": ["default-global-system-config", "server8", "vhost0"], "uuid": null, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "fe625f23-666a-495c-8374-2a7064958064"}]}} response virtual_router ['default-global-system-config', 'server8'] not present"
"2017-09-15 01:53:53,470-INFO-sm_ansible_callback.py:46-append(): fatal: [10.0.0.9]Traceback (most recent call last):
  File "/usr/share/contrail-utils/provision_vrouter.py", line 248, in <module>
    main()
  File "/usr/share/contrail-utils/provision_vrouter.py", line 244, in main
    VrouterProvisioner(args_str)
  File "/usr/share/contrail-utils/provision_vrouter.py", line 54, in __init__
    self.add_vhost0_vmi()
  File "/usr/share/contrail-utils/provision_vrouter.py", line 217, in add_vhost0_vmi
    self._vnc_lib.virtual_machine_interface_create(vhost0_vmi)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 42, in wrapper
    return func(self, *args, **kwargs)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 479, in _object_create
    rest.OP_POST, obj_cls.create_uri, data=json_body)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 855, in _request_server
    retry_after_authn=retry_after_authn, retry_count=retry_count)
  File "/usr/lib/python2.7/dist-packages/vnc_api/vnc_api.py", line 933, in _request
    % (op, url, data, content))
cfgm_common.exceptions.NoIdError: Unknown id: Error: oper 1 url /virtual-machine-interfaces body {"virtual-machine-interface":{"parent_type": "virtual-router", "fq_name": ["default-global-system-config", "server8", "vhost0"], "uuid": null, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "fe625f23-666a-495c-8374-2a7064958064"}]}} response virtual_router ['default-global-system-config', 'server8'] not present"

[Abhay Joshi (abhayj)]

Wenqing,

Did this work with earlier build and issue seen with latest?

Thanks,

Abhay

[Abhay Joshi (abhayj)]

Also the issue seems to have been reported in 4.1.0, but instance created for 4.0.1 too. Is this really seen with 4.0.x also?

[Nitish Krishna Kaveri (nitishk)]

SM to use:

10.87.118.51

[Hari Prasad Killi (haripk)]

The issue was because https://review.opencontrail.org/#/c/35524/ merged while it depended on https://review.opencontrail.org/#/c/35476/, which is fixed later. You can either patch the later as a workaround or check with the next build.