Error when launching instance with a PCI on it

[p.cipriano]

Hi All,

After launching an instance with GPU in Kolla openstack queens

im using KVM.

2018-06-05 10:43:49.592 7 ERROR nova.compute.manager [instance: 1ec82ee4-833d-47b0-abc7-a4a2ea848e9a] File "/usr/lib64/python2.7/site-packages/libvirt.py", line 1099, in createWithFlags
2018-06-05 10:43:49.592 7 ERROR nova.compute.manager [instance: 1ec82ee4-833d-47b0-abc7-a4a2ea848e9a] if ret == -1: raise libvirtError ('virDomainCreateWithFlags() failed', dom=self)
2018-06-05 10:43:49.592 7 ERROR nova.compute.manager [instance: 1ec82ee4-833d-47b0-abc7-a4a2ea848e9a] libvirtError: internal error: qemu unexpectedly closed the monitor: 2018-06-05T02:43:47.447602Z qemu-kvm: -device vfio-pci,host=01:00.0,id=hostdev0,bus=pci.0,addr=0x5: vfio error: 0000:01:00.0: group 1 is not viable
2018-06-05 10:43:49.592 7 ERROR nova.compute.manager [instance: 1ec82ee4-833d-47b0-abc7-a4a2ea848e9a] Please ensure all devices within the iommu_group are bound to their vfio bus driver.

[Sylvain Bauza (sylvain-bauza)]

Are you doing PCI passthrough for a GPU or trying to ask for a virtual GPU ?
ie.
https://docs.openstack.org/nova/latest/admin/pci-passthrough.html
or
https://docs.openstack.org/nova/latest/admin/virtual-gpu.html

If the former, see https://www.redhat.com/archives/vfio-users/2015-September/msg00179.html

[Launchpad Janitor (janitor)]

[Expired for OpenStack Compute (nova) because there has been no activity for 60 days.]

[lixiaolong (kong62)]

we have same problem：

Ubuntu 16.04
queens

2018-09-06 18:54:36.268 5875 INFO nova.virt.libvirt.driver [req-90daa5e8-0c20-4b60-a912-27a021dde456 73b9898328424b4e872e00c915272a05 4eabd351c53743a4bbfeb842b1d11f25 - default default] [instance: 1d8a6eb0-3292-49af-ac41-b9b82b9df916] Creating image
2018-09-06 18:54:39.041 5875 INFO os_vif [req-68f2f71b-5ce1-4f4b-9879-90b2088a98ae 5b645e611f544b98b7a774981c587d70 9e060f6d16d84cc2a0e97cca95f8f33c - default default] Successfully plugged vif VIFBridge(active=False,address=fa:16:3e:01:1c:d0,bridge_name='brqdd3a4f20-b9',has_traffic_filtering=True,id=85d6cb25-e53f-4f7d-a349-80910a017467,network=Network(dd3a4f20-b9e9-4c74-970e-9f241de9c445),plugin='linux_bridge',port_profile=<?>,preserve_on_delete=False,vif_name='tap85d6cb25-e5')
2018-09-06 18:54:39.714 5875 ERROR nova.virt.libvirt.guest [req-68f2f71b-5ce1-4f4b-9879-90b2088a98ae 5b645e611f544b98b7a774981c587d70 9e060f6d16d84cc2a0e97cca95f8f33c - default default] Error launching a defined domain with XML: <domain type='kvm'>
  <name>instance-00000041</name>
  <uuid>1d8a6eb0-3292-49af-ac41-b9b82b9df916</uuid>
  <metadata>
    <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.0">
      <nova:package version="17.0.4"/>
      <nova:name>t1</nova:name>
      <nova:creationTime>2018-09-06 10:54:39</nova:creationTime>
      <nova:flavor name="m1.test">
        <nova:memory>16384</nova:memory>
        <nova:disk>10</nova:disk>
        <nova:swap>0</nova:swap>
        <nova:ephemeral>0</nova:ephemeral>
        <nova:vcpus>4</nova:vcpus>
      </nova:flavor>
      <nova:owner>
        <nova:user uuid="73b9898328424b4e872e00c915272a05">admin</nova:user>
        <nova:project uuid="4eabd351c53743a4bbfeb842b1d11f25">admin</nova:project>
      </nova:owner>
      <nova:root type="image" uuid="36cfef18-5c52-411c-a7cb-a7849a46fab8"/>
    </nova:instance>
  </metadata>
  <memory unit='KiB'>16777216</memory>
  <currentMemory unit='KiB'>16777216</currentMemory>
  <vcpu placement='static'>4</vcpu>
  <cputune>
    <shares>4096</shares>
  </cputune>
  <sysinfo type='smbios'>
    <system>
      <entry name='manufacturer'>OpenStack Foundation</entry>
      <entry name='product'>OpenStack Nova</entry>
      <entry name='version'>17.0.4</entry>
      <entry name='serial'>cf1b0210-232e-42d9-b712-57d9459e5c23</entry>
      <entry name='uuid'>1d8a6eb0-3292-49af-ac41-b9b82b9df916</entry>
      <entry name='family'>Virtual Machine</entry>
    </system>
  </sysinfo>
  <os>
    <type arch='x86_64' machine='pc-i440fx-bionic'>hvm</type>
    <boot dev='cdrom'/>
    <smbios mode='sysinfo'/>
  </os>
  <features>
    <acpi/>
    <apic/>
  </features>
  <cpu mode='host-passthrough' check='none'>
    <topology sockets='2' cores='2' threads='1'/>
  </cpu>
  <clock offset='utc'>
    <timer name='pit' tickpolicy='delay'/>
    <timer name='rtc' tickpolicy='catchup'/>
    <timer name='hpet' present='no'/>
  </clock>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>destroy</on_crash>
  <devices>
    <emulator>/usr/bin/kvm-spice</emulator>
    <disk type='file' device='cdrom'>
      <driver name='qemu' type='qcow2' cache='none' discard='unmap'/>
     ...