ISST-SAN:Post installation of Ubuntu 15.04 with Flash Storage 840 as bootdisk is not detecting while rebooting

[bugproxy]

== Comment: #0 ==
I installed zap06 which is KVM guest with 15.04 .Bootdisk is from Flash Storage 840 and Installation went fine.

After Installaing while booting its not detecting the bootable disk. The issue is seeing if we are reinstalling and not a first time fresh installation.

I cleared the disk using dd command from KVM host and tried again installation Then also its failing to deetct bootable disk after reboot

Trying to load: from: /vdevice/v-scsi@2000/disk@8100000000000000 ...
E3404: Not a bootable device!
Trying to load: from: HALT ...
E3405: No such device

E3407: Load failed

        ..`. .. ....... .. ...... .......
    ..`...`''.`'. .''``````..''. .`''```''`. `''``````
       .`` .:' ': `''..... .''. ''` .''..''.......
         ``.':.';. ``````''`.''. .''. ''``''`````'`
         ``.':':` .....`''.`'`...... `'`.....`''.`'`
        .`.`'`` .'`'`````. ``'''''' ``''`'''`. `'`
  Type 'boot' and press return to continue booting the system.
  Type 'reset-all' and press return to reboot the system.

Ready!
0 >

Bootable disk is 47Gb disk.and this is 2nd time I am seeing the issue

Last time,I deleted the disk from SAN and allocated freshly.

== Comment: #2 - == More Info ====

[root@zapkvm ~]# uname -r
3.10.53-2025.1.pkvm2_1_1.54.ppc64
[root@zapkvm ~]#
[root@zapkvm ~]#
[root@zapkvm ~]# cat /etc/issue
IBM_PowerKVM release 2.1.1 build 42 service (pkvm2_1_1)
Kernel \r on a \m (\l)

[root@zapkvm ~]#
[root@zapkvm ~]# virsh destroy zap06
Domain zap06 destroyed

[root@zapkvm ~]#
[root@zapkvm ~]#
[root@zapkvm ~]# virsh list --all
 Id Name State
----------------------------------------------------
 3 zap02 running
 4 zap03 running
 12 zap01 running
 13 zap07 running
 19 zap08 running
 20 zap05 running
 - zap06 shut off

[root@zapkvm ~]#
[root@zapkvm ~]#
[root@zapkvm ~]# virsh start zap06 ; virsh console zap06
Domain zap06 started

Connected to domain zap06
Escape character is ^]

SLOF **********************************************************************
QEMU Starting
 Build Date = Mar 17 2015 15:44:58
 FW Version = mockbuild@ release 20150317
 Press "s" to enter Open Firmware.

Populating /vdevice methods
Populating /vdevice/v-scsi@2000
       SCSI: Looking for devices
          8100000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          8200000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          8300000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          8400000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          8500000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          8600000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          8700000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
Populating /vdevice/vty@20000000
Populating /vdevice/nvram@71000000
Populating /pci@800000020000000
 Adapters on 0800000020000000
                     00 0800 (D) : 1af4 1000 virtio [ net ]
                     00 1000 (D) : 1af4 1004 virtio [ scsi ]
Populating /pci@800000020000000/scsi@2
       SCSI: Looking for devices
          100000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          110000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          111000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          112000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          113000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          114000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          115000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          116000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          117000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          118000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          119000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          11a000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          11b000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          11c000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          11d000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
          11e000000000000 DISK : "QEMU QEMU HARDDISK 2.0."
                     00 1800 (D) : 1af4 1001 virtio [ block ]
                     00 2000 (D) : 1af4 1001 virtio [ block ]
                     00 2800 (D) : 1af4 1001 virtio [ block ]
                     00 3000 (D) : 1af4 1001 virtio [ block ]
                     00 3800 (D) : 1af4 1001 virtio [ block ]
                     00 4000 (D) : 1af4 1001 virtio [ block ]
                     00 4800 (D) : 1af4 1001 virtio [ block ]
                     00 5000 (D) : 1af4 1001 virtio [ block ]
                     00 5800 (D) : 1af4 1001 virtio [ block ]
                     00 6000 (D) : 1af4 1001 virtio [ block ]
                     00 6800 (D) : 1af4 1001 virtio [ block ]
                     00 7000 (D) : 1af4 1001 virtio [ block ]
                     00 7800 (D) : 1af4 1001 virtio [ block ]
                     00 8000 (D) : 1af4 1001 virtio [ block ]
                     00 8800 (D) : 1af4 1001 virtio [ block ]
No NVRAM common partition, re-initializing...
Scanning USB
Using default console: /vdevice/vty@20000000

  Welcome to Open Firmware

  Copyright (c) 2004, 2011 IBM Corporation All rights reserved.
  This program and the accompanying materials are made available
  under the terms of the BSD License available at
  http://www.opensource.org/licenses/bsd-license.php

Trying to load: from: /vdevice/v-scsi@2000/disk@8100000000000000 ...
E3404: Not a bootable device!
Trying to load: from: HALT ...
E3405: No such device

E3407: Load failed

        ..`. .. ....... .. ...... .......
    ..`...`''.`'. .''``````..''. .`''```''`. `''``````
       .`` .:' ': `''..... .''. ''` .''..''.......
         ``.':.';. ``````''`.''. .''. ''``''`````'`
         ``.':':` .....`''.`'`...... `'`.....`''.`'`
        .`.`'`` .'`'`````. ``'''''' ``''`'''`. `'`
  Type 'boot' and press return to continue booting the system.
  Type 'reset-all' and press return to reboot the system.

Ready!
0 > boot
Trying to load: from: /vdevice/v-scsi@2000/disk@8100000000000000 ...
E3404: Not a bootable device!
Trying to load: from: HALT ...
E3405: No such device

E3407: Load failed
 ok
0 > ok
0 > ok
0 >
[root@zapkvm ~]#

[root@zapkvm ~]#
[root@zapkvm ~]# virsh list --all
 Id Name State
----------------------------------------------------
 3 zap02 running
 4 zap03 running
 12 zap01 running
 13 zap07 running
 19 zap08 running
 20 zap05 running
 26 zap06 running

[root@zapkvm ~]#

===================================
<domain type='kvm'>
  <name>zap06</name>
  <uuid>2f623efc-8184-4aff-8094-83bf5aeae10c</uuid>
  <memory unit='KiB'>8388608</memory>
  <currentMemory unit='KiB'>8388608</currentMemory>
  <vcpu placement='static'>8</vcpu>
  <os>
    <type arch='ppc64' machine='pseries-2.2'>hvm</type>
    <boot dev='hd'/>
  </os>
  <features>
    <acpi/>
    <apic/>
  </features>
  <clock offset='utc'/>
  <on_poweroff>destroy</on_poweroff>
  <on_reboot>restart</on_reboot>
  <on_crash>coredump-restart</on_crash>
  <devices>
    <emulator>/usr/bin/qemu-kvm</emulator>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgo'/>
      <target dev='sda' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='1' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgn'/>
      <target dev='sdb' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='2' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhf'/>
      <target dev='sdc' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='3' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgm'/>
      <target dev='sdd' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='4' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgl'/>
      <target dev='sde' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='5' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhq'/>
      <target dev='sdf' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='6' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgk'/>
      <target dev='sdg' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='7' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgj'/>
      <target dev='sdh' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='8' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgi'/>
      <target dev='sdi' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='9' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgu'/>
      <target dev='sdj' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='10' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhz'/>
      <target dev='sdk' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='11' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathid'/>
      <target dev='sdl' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='12' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathic'/>
      <target dev='sdm' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='13' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathib'/>
      <target dev='sdn' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='14' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathia'/>
      <target dev='sdo' bus='scsi'/>
      <address type='drive' controller='0' bus='0' target='15' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgp'/>
      <target dev='vdp' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='16' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathht'/>
      <target dev='vdq' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='17' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhg'/>
      <target dev='vdr' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='18' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhs'/>
      <target dev='vds' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='19' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgz'/>
      <target dev='vdt' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='20' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhr'/>
      <target dev='vdu' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='21' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhe'/>
      <target dev='vdv' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='22' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgy'/>
      <target dev='vdw' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='23' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhd'/>
      <target dev='vdx' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='24' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgx'/>
      <target dev='vdy' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='25' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhp'/>
      <target dev='vdz' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='26' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhc'/>
      <target dev='vdaa' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='27' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgw'/>
      <target dev='vdab' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='28' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathho'/>
      <target dev='vdac' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='29' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhb'/>
      <target dev='vdad' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='30' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhy'/>
      <target dev='vdla' bus='scsi'/>
      <address type='drive' controller='1' bus='0' target='0' unit='0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgv'/>
      <target dev='vdae' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhn'/>
      <target dev='vdaf' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathha'/>
      <target dev='vdag' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhm'/>
      <target dev='vdah' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgt'/>
      <target dev='vdai' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhl'/>
      <target dev='vdaj' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x08' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgs'/>
      <target dev='vdak' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x09' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhk'/>
      <target dev='vdal' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x0a' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhw'/>
      <target dev='vdam' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x0b' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathgr'/>
      <target dev='vdan' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x0c' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhj'/>
      <target dev='vdao' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x0d' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhv'/>
      <target dev='vdap' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x0e' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhi'/>
      <target dev='vdaq' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x0f' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhu'/>
      <target dev='vdar' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x10' function='0x0'/>
    </disk>
    <disk type='block' device='disk'>
      <driver name='qemu' type='raw'/>
      <source dev='/dev/mapper/mpathhh'/>
      <target dev='vdas' bus='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x11' function='0x0'/>
    </disk>
    <controller type='scsi' index='0' model='ibmvscsi'>
      <address type='spapr-vio' reg='0x2000'/>
    </controller>
    <controller type='scsi' index='1' model='virtio-scsi'>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
    </controller>
    <controller type='usb' index='0' model='none'/>
    <controller type='pci' index='0' model='pci-root'/>
    <interface type='bridge'>
      <mac address='52:54:00:45:1b:12'/>
      <source bridge='br0'/>
      <model type='virtio'/>
      <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x0'/>
    </interface>
    <serial type='pty'>
      <target type='isa-serial' port='0'/>
      <address type='spapr-vio' reg='0x20000000'/>
    </serial>
    <console type='pty'>
      <target type='serial' port='0'/>
      <address type='spapr-vio' reg='0x20000000'/>
    </console>
    <memballoon model='none'/>
  </devices>
  <seclabel type='none' model='selinux'/>
</domain>

~
~
~
~
==============================

== Comment: #10 ==
Hi

Today I updated zap06 to latest Ubuntu build and found that with only bootdisk its detecting and machine is coming up.

I added around 40 more disks and destroyed and started zap06. That time its hanging at same

Here is /var/log/messages that time

Apr 2 14:54:45 zapkvm avahi-daemon[69626]: Withdrawing address record for fe80::fc54:ff:fe85:dc07 on vnet4.
Apr 2 14:54:45 zapkvm avahi-daemon[69626]: Withdrawing workstation service for vnet4.
Apr 2 14:54:45 zapkvm kernel: [24223.304971] br0: port 6(vnet4) entered disabled state
Apr 2 14:54:45 zapkvm kernel: [24223.305307] device vnet4 left promiscuous mode
Apr 2 14:54:45 zapkvm kernel: [24223.305318] br0: port 6(vnet4) entered disabled state
Apr 2 14:54:45 zapkvm kernel: [24223.314415] bio: create slab <bio-0> at 0
Apr 2 14:54:45 zapkvm kernel: [24223.315308] bio: create slab <bio-0> at 0
Apr 2 14:54:45 zapkvm kernel: [24223.318151] bio: create slab <bio-0> at 0
Apr 2 14:54:45 zapkvm libvirtd[71775]: stream aborted at client request
Apr 2 14:54:50 zapkvm kernel: [24228.677800] device vnet4 entered promiscuous mode
Apr 2 14:54:50 zapkvm kernel: [24228.760098] br0: port 6(vnet4) entered forwarding state
Apr 2 14:54:50 zapkvm kernel: [24228.760107] br0: port 6(vnet4) entered forwarding state
Apr 2 14:54:51 zapkvm avahi-daemon[69626]: Withdrawing workstation service for vnet4.
Apr 2 14:54:51 zapkvm kernel: [24228.876328] br0: port 6(vnet4) entered disabled state
Apr 2 14:54:51 zapkvm kernel: [24228.876465] device vnet4 left promiscuous mode
Apr 2 14:54:51 zapkvm kernel: [24228.876472] br0: port 6(vnet4) entered disabled state
Apr 2 14:54:51 zapkvm libvirtd[71775]: failed to connect to monitor socket: No such process
Apr 2 14:55:13 zapkvm kernel: [24251.288323] device vnet4 entered promiscuous mode
Apr 2 14:55:13 zapkvm kernel: [24251.368894] br0: port 6(vnet4) entered forwarding state
Apr 2 14:55:13 zapkvm kernel: [24251.368903] br0: port 6(vnet4) entered forwarding state
Apr 2 14:55:14 zapkvm kernel: [24252.682122] KVM guest htab at c000003e00000000 (order 26), LPID 5
Apr 2 14:55:15 zapkvm avahi-daemon[69626]: Registering new address record for fe80::fc54:ff:fe85:dc07 on vnet4.*.
Apr 2 14:55:28 zapkvm kernel: [24266.397588] br0: port 6(vnet4) entered forwarding state
Apr 2 14:55:41 zapkvm libvirtd[71775]: stream aborted at client request
Apr 2 14:55:41 zapkvm avahi-daemon[69626]: Withdrawing address record for fe80::fc54:ff:fed1:6f43 on vnet5.
Apr 2 14:55:41 zapkvm avahi-daemon[69626]: Withdrawing workstation service for vnet5.
Apr 2 14:55:41 zapkvm kernel: [24279.618387] br0: port 7(vnet5) entered disabled state
Apr 2 14:55:41 zapkvm kernel: [24279.618538] device vnet5 left promiscuous mode
Apr 2 14:55:41 zapkvm kernel: [24279.618550] br0: port 7(vnet5) entered disabled state
Apr 2 14:55:41 zapkvm kernel: [24279.625980] bio: create slab <bio-0> at 0
Apr 2 14:55:41 zapkvm kernel: [24279.628363] bio: create slab <bio-0> at 0
Apr 2 14:55:41 zapkvm kernel: [24279.630147] bio: create slab <bio-0> at 0
Apr 2 14:55:41 zapkvm kernel: [24279.632635] bio: create slab <bio-0> at 0
Apr 2 14:55:41 zapkvm libvirtd[71775]: internal error: End of file from monitor
Apr 2 14:55:41 zapkvm kernel: [24279.733699] bio: create slab <bio-0> at 0
Apr 2 14:55:41 zapkvm kernel: [24279.736359] bio: create slab <bio-0> at 0
Apr 2 14:55:41 zapkvm kernel: [24279.739193] bio: create slab <bio-0> at 0
Apr 2 14:55:41 zapkvm kernel: [24279.740930] bio: create slab <bio-0> at 0
Apr 2 14:56:12 zapkvm systemd-udevd[17067]: worker [71372] /devices/virtual/block/dm-70 timeout; kill it
Apr 2 14:56:12 zapkvm systemd-udevd[17067]: seq 80290 '/devices/virtual/block/dm-70' killed
Apr 2 14:56:12 zapkvm systemd-udevd[17067]: worker [71372] terminated by signal 9 (Killed)
Apr 2 14:58:48 zapkvm kernel: [24465.827803] device vnet5 entered promiscuous mode
Apr 2 14:58:48 zapkvm kernel: [24465.909791] br0: port 7(vnet5) entered forwarding state
Apr 2 14:58:48 zapkvm kernel: [24465.909800] br0: port 7(vnet5) entered forwarding state
Apr 2 14:58:48 zapkvm kernel: [24466.028328] qemu-system-ppc: sending ioctl 5326 to a partition!
Apr 2 14:58:48 zapkvm kernel: [24466.028338] qemu-system-ppc: sending ioctl 40200204 to a partition!
Apr 2 14:58:49 zapkvm kernel: [24467.483417] KVM guest htab at c000003e04000000 (order 26), LPID 6
Apr 2 14:58:49 zapkvm avahi-daemon[69626]: Registering new address record for fe80::fc54:ff:fed1:6f43 on vnet5.*.
Apr 2 14:59:03 zapkvm kernel: [24480.957597] br0: port 7(vnet5) entered forwarding state
Apr 2 15:03:19 zapkvm kernel: [24737.437665] pci 0004:01 : [PE# 001] Reset DMA windows

== Comment: #11 ==
2 times I started zap06

Here is the log from /var/log/messages
-----------------------------------

Apr 2 15:15:43 zapkvm avahi-daemon[69626]: Withdrawing address record for fe80::fc54:ff:fe85:dc07 on vnet4.
Apr 2 15:15:43 zapkvm kernel: [25481.254229] br0: port 6(vnet4) entered disabled state
Apr 2 15:15:43 zapkvm kernel: [25481.254519] device vnet4 left promiscuous mode
Apr 2 15:15:43 zapkvm kernel: [25481.254530] br0: port 6(vnet4) entered disabled state
Apr 2 15:15:43 zapkvm avahi-daemon[69626]: Withdrawing workstation service for vnet4.
Apr 2 15:15:43 zapkvm libvirtd[71775]: nl_recv returned with error: No buffer space available
Apr 2 15:15:43 zapkvm libvirtd[71775]: udev_monitor_receive_device returned NULL
Apr 2 15:15:43 zapkvm libvirtd[71775]: stream aborted at client request
Apr 2 15:15:57 zapkvm kernel: [25494.877790] device vnet4 entered promiscuous mode
Apr 2 15:15:57 zapkvm kernel: [25494.920122] br0: port 6(vnet4) entered forwarding state
Apr 2 15:15:57 zapkvm kernel: [25494.920132] br0: port 6(vnet4) entered forwarding state
Apr 2 15:15:58 zapkvm avahi-daemon[69626]: Registering new address record for fe80::fc54:ff:fe85:dc07 on vnet4.*.
Apr 2 15:15:58 zapkvm kernel: [25496.169586] KVM guest htab at c000003e00000000 (order 26), LPID 5
Apr 2 15:16:12 zapkvm kernel: [25509.957592] br0: port 6(vnet4) entered forwarding state

2nd times when started
--------------------------------------------

Apr 2 15:17:03 zapkvm avahi-daemon[69626]: Withdrawing address record for fe80::fc54:ff:fe85:dc07 on vnet4.
Apr 2 15:17:03 zapkvm kernel: [25560.888079] br0: port 6(vnet4) entered disabled state
Apr 2 15:17:03 zapkvm kernel: [25560.893281] device vnet4 left promiscuous mode
Apr 2 15:17:03 zapkvm kernel: [25560.893296] br0: port 6(vnet4) entered disabled state
Apr 2 15:17:03 zapkvm avahi-daemon[69626]: Withdrawing workstation service for vnet4.
Apr 2 15:17:03 zapkvm libvirtd[71775]: nl_recv returned with error: No buffer space available
Apr 2 15:17:03 zapkvm libvirtd[71775]: udev_monitor_receive_device returned NULL
Apr 2 15:17:03 zapkvm libvirtd[71775]: stream aborted at client request
Apr 2 15:17:19 zapkvm kernel: [25576.997801] device vnet4 entered promiscuous mode
Apr 2 15:17:19 zapkvm kernel: [25577.050229] br0: port 6(vnet4) entered forwarding state
Apr 2 15:17:19 zapkvm kernel: [25577.050238] br0: port 6(vnet4) entered forwarding state
Apr 2 15:17:20 zapkvm kernel: [25578.330749] KVM guest htab at c000003e00000000 (order 26), LPID 5
Apr 2 15:17:20 zapkvm avahi-daemon[69626]: Registering new address record for fe80::fc54:ff:fe85:dc07 on vnet4.*.
Apr 2 15:17:34 zapkvm kernel: [25592.077612] br0: port 6(vnet4) entered forwarding state
Apr 2 15:17:59 zapkvm libvirtd[71775]: stream aborted at client request
Apr 2 15:17:59 zapkvm systemd-logind[69619]: Removed session 54.
Apr 2 15:18:00 zapkvm systemd-logind[69619]: New session 76 of user root.
[root@zapkvm work]#

[bugproxy (bugproxy)]

Default Comment by Bridge

[bugproxy (bugproxy)]

Default Comment by Bridge

[bugproxy (bugproxy)]

Default Comment by Bridge

[Ubuntu Foundations Team Bug Bot (crichton)]

Thank you for taking the time to report this bug and helping to make Ubuntu better. It seems that your bug report is not filed about a specific source package though, rather it is just filed against Ubuntu in general. It is important that bug reports be filed about source packages so that people interested in the package can find the bugs about it. You can find some hints about determining what package your bug might be about at https://wiki.ubuntu.com/Bugs/FindRightPackage. You might also ask for help in the #ubuntu-bugs irc channel on Freenode.

To change the source package that this bug is filed about visit https://bugs.launchpad.net/ubuntu/+bug/1441047/+editstatus and add the package name in the text box next to the word Package.

[This is an automated message. I apologize if it reached you inappropriately; please just reply to this message indicating so.]

[bugproxy (bugproxy)]

Default Comment by Bridge

[bugproxy (bugproxy)]

Default Comment by Bridge

[bugproxy (bugproxy)]

Default Comment by Bridge

[bugproxy (bugproxy)]

Default Comment by Bridge

[bugproxy (bugproxy)]

Default Comment by Bridge

[bugproxy (bugproxy)]

Default Comment by Bridge

[Mathieu Trudel-Lapierre (cyphermox)]

Without much information, this looks to me like it might be I/O issues with the fc controller itself; or perhaps with how much memory is required to support the VMs as they are defined (I see some memory allocation errors for vfio, but it's not clear which test relates to which actual entry in Qemu logs).

If the same test is tried with fewer disks, does the VM behave the same way? I've run some tests here which seemed to indicate multipathed systems with up to around 52 disks (the extent of my test), on amd64 and using virtio disks did work (even if multipath was disabled, and thus showing the 52 or so disks), but that's hardly reproducing the setup you have here.

I would suggest if possible to test with fewer disks (perhaps starting with 20 instead of 40?), so that we can identify whether there is a cutoff point at which the VM works or doesn't, since it reportedly works fine with just the boot disk.

[bugproxy (bugproxy)]

------- Comment From <email address hidden> 2015-06-01 17:26 EDT-------
Externalizing comment:

LEKSHMI C. PILLAI 2015-05-20 06:43:30 EDT
Hi
I am trying with 20 disks.Issue i found is if the disk is exported to guest as SCSI its not working,But as Virtioblock its working

Thanks
Lekshmi

[bugproxy (bugproxy)]

------- Comment From <email address hidden> 2015-06-22 16:39 EDT-------
mathieu-tl - Any updates based on previous comment? I am trying with 20 disks.Issue i found is if the disk is exported to guest as SCSI its not working,But as Virtioblock its working

[bugproxy (bugproxy)]

------- Comment (attachment only) From <email address hidden> 2015-07-15 08:47 EDT-------