Activity log for bug #861656

Date Who What changed Old value New value Message
2011-09-28 18:11:11 Serge Hallyn bug added bug
2011-09-28 18:15:47 Brad Figg linux (Ubuntu): status New Incomplete
2011-09-28 18:43:20 Serge Hallyn tags apport-collected oneiric running-unity
2011-09-28 18:43:23 Serge Hallyn description My host has xfs rootfs. It runs openstack with lxc, which creates the container root filesystems on qemu-nbd block devices with ext4fs by default. For probably 1 in 8 containers, when the host is working hard, I end up with ext4 errors which in the end prevent the host from cleanly rebooting. http://people.canonical.com/~serge/20110927_001.jpg is one example. Here is another one: [ 178.736380] JBD2: I/O error detected when updating journal superblock for nbd13-8. [ 178.736567] journal commit I/O error [ 182.374588] br100: port 4(veth2) entering forwarding state [ 182.376240] device veth2 left promiscuous mode [ 182.376245] br100: port 4(veth2) entering disabled state [ 182.983726] nbd14: NBD_DISCONNECT [ 182.983979] nbd14: Receive control failed (result -32) [ 182.984075] nbd14: queue cleared [ 182.984525] nbd14: Attempted send on closed socket [ 182.984530] end_request: I/O error, dev nbd14, sector 328280 [ 182.984533] Buffer I/O error on device nbd14, logical block 41035 [ 182.984538] EXT4-fs warning (device nbd14): ext4_end_bio:242: I/O error writing to inode 32327 (offset 0 size 4096 starting block 41036) [ 182.984597] nbd14: Attempted send on closed socket [ 182.984600] end_request: I/O error, dev nbd14, sector 328256 [ 182.984602] Buffer I/O error on device nbd14, logical block 41032 [ 182.984605] EXT4-fs warning (device nbd14): ext4_end_bio:242: I/O error writing to inode 32342 (offset 0 size 4096 starting block 41033) [ 182.984770] JBD2: Detected IO errors while flushing file data on nbd14-8 [ 182.984776] nbd14: Attempted send on closed socket [ 182.984779] end_request: I/O error, dev nbd14, sector 1049856 [ 182.984794] Aborting journal on device nbd14-8. [ 182.984802] nbd14: Attempted send on closed socket [ 182.984804] end_request: I/O error, dev nbd14, sector 1048576 [ 182.984807] Buffer I/O error on device nbd14, logical block 131072 [ 182.984809] lost page write due to I/O error on nbd14 [ 182.984812] JBD2: I/O error detected when updating journal superblock for nbd14-8. [ 182.984825] journal commit I/O error [ 184.789984] br100: port 3(veth1) entering forwarding state [ 184.791634] device veth1 left promiscuous mode [ 184.791639] br100: port 3(veth1) entering disabled state [ 185.236242] nbd12: NBD_DISCONNECT [ 185.236362] nbd12: Receive control failed (result -32) [ 185.236418] nbd12: queue cleared [ 185.236734] nbd12: Attempted send on closed socket [ 185.236737] end_request: I/O error, dev nbd12, sector 328280 [ 185.236740] Buffer I/O error on device nbd12, logical block 41035 [ 185.236745] EXT4-fs warning (device nbd12): ext4_end_bio:242: I/O error writing to inode 32327 (offset 0 size 4096 starting block 41036) [ 185.236804] nbd12: Attempted send on closed socket [ 185.236806] end_request: I/O error, dev nbd12, sector 328256 [ 185.236809] Buffer I/O error on device nbd12, logical block 41032 [ 185.236812] EXT4-fs warning (device nbd12): ext4_end_bio:242: I/O error writing to inode 32342 (offset 0 size 4096 starting block 41033) [ 185.236998] JBD2: Detected IO errors while flushing file data on nbd12-8 [ 185.237005] nbd12: Attempted send on closed socket [ 185.237007] end_request: I/O error, dev nbd12, sector 1049856 [ 185.237025] Aborting journal on device nbd12-8. [ 185.237034] nbd12: Attempted send on closed socket [ 185.237036] end_request: I/O error, dev nbd12, sector 1048576 [ 185.237039] Buffer I/O error on device nbd12, logical block 131072 [ 185.237041] lost page write due to I/O error on nbd12 [ 185.237044] JBD2: I/O error detected when updating journal superblock for nbd12-8. [ 185.237059] journal commit I/O error [ 185.342363] nbd14: Attempted send on closed socket [ 185.342369] end_request: I/O error, dev nbd14, sector 0 [ 185.342374] Buffer I/O error on device nbd14, logical block 0 [ 185.342375] lost page write due to I/O error on nbd14 [ 185.342388] EXT4-fs error (device nbd14): ext4_put_super:771: Couldn't clean up the journal [ 185.342392] EXT4-fs (nbd14): Remounting filesystem read-only [ 185.342394] EXT4-fs (nbd14): previous I/O error to superblock detected [ 185.342399] nbd14: Attempted send on closed socket [ 185.342401] end_request: I/O error, dev nbd14, sector 0 [ 185.342404] Buffer I/O error on device nbd14, logical block 0 [ 185.342405] lost page write due to I/O error on nbd14 [ 185.352231] nbd12: Attempted send on closed socket [ 185.352236] end_request: I/O error, dev nbd12, sector 0 [ 185.352239] Buffer I/O error on device nbd12, logical block 0 [ 185.352241] lost page write due to I/O error on nbd12 [ 185.352252] EXT4-fs error (device nbd12): ext4_put_super:771: Couldn't clean up the journal [ 185.352256] EXT4-fs (nbd12): Remounting filesystem read-only [ 185.352258] EXT4-fs (nbd12): previous I/O error to superblock detected [ 178.733767] nbd13: NBD_DISCONNECT [ 178.733865] nbd13: Receive control failed (result -32) [ 178.733911] nbd13: shutting down socket [ 178.733914] nbd13: queue cleared [ 178.734250] nbd13: Attempted send on closed socket [ 178.734254] end_request: I/O error, dev nbd13, sector 328280 [ 178.734257] Buffer I/O error on device nbd13, logical block 41035 [ 178.734262] EXT4-fs warning (device nbd13): ext4_end_bio:242: I/O error writing to inode 32327 (offset 0 size 4096 starting block 41036) [ 178.734334] nbd13: Attempted send on closed socket [ 178.734336] end_request: I/O error, dev nbd13, sector 328256 [ 178.734338] Buffer I/O error on device nbd13, logical block 41032 [ 178.734342] EXT4-fs warning (device nbd13): ext4_end_bio:242: I/O error writing to inode 32342 (offset 0 size 4096 starting block 41033) [ 178.736325] JBD2: Detected IO errors while flushing file data on nbd13-8 [ 178.736339] nbd13: Attempted send on closed socket [ 178.736343] end_request: I/O error, dev nbd13, sector 1049856 [ 178.736361] Aborting journal on device nbd13-8. [ 178.736370] nbd13: Attempted send on closed socket [ 178.736372] end_request: I/O error, dev nbd13, sector 1048576 [ 178.736375] Buffer I/O error on device nbd13, logical block 131072 [ 178.736377] lost page write due to I/O error on nbd13 My host has xfs rootfs. It runs openstack with lxc, which creates the container root filesystems on qemu-nbd block devices with ext4fs by default. For probably 1 in 8 containers, when the host is working hard, I end up with ext4 errors which in the end prevent the host from cleanly rebooting. http://people.canonical.com/~serge/20110927_001.jpg is one example. Here is another one: [ 178.736380] JBD2: I/O error detected when updating journal superblock for nbd13-8. [ 178.736567] journal commit I/O error [ 182.374588] br100: port 4(veth2) entering forwarding state [ 182.376240] device veth2 left promiscuous mode [ 182.376245] br100: port 4(veth2) entering disabled state [ 182.983726] nbd14: NBD_DISCONNECT [ 182.983979] nbd14: Receive control failed (result -32) [ 182.984075] nbd14: queue cleared [ 182.984525] nbd14: Attempted send on closed socket [ 182.984530] end_request: I/O error, dev nbd14, sector 328280 [ 182.984533] Buffer I/O error on device nbd14, logical block 41035 [ 182.984538] EXT4-fs warning (device nbd14): ext4_end_bio:242: I/O error writing to inode 32327 (offset 0 size 4096 starting block 41036) [ 182.984597] nbd14: Attempted send on closed socket [ 182.984600] end_request: I/O error, dev nbd14, sector 328256 [ 182.984602] Buffer I/O error on device nbd14, logical block 41032 [ 182.984605] EXT4-fs warning (device nbd14): ext4_end_bio:242: I/O error writing to inode 32342 (offset 0 size 4096 starting block 41033) [ 182.984770] JBD2: Detected IO errors while flushing file data on nbd14-8 [ 182.984776] nbd14: Attempted send on closed socket [ 182.984779] end_request: I/O error, dev nbd14, sector 1049856 [ 182.984794] Aborting journal on device nbd14-8. [ 182.984802] nbd14: Attempted send on closed socket [ 182.984804] end_request: I/O error, dev nbd14, sector 1048576 [ 182.984807] Buffer I/O error on device nbd14, logical block 131072 [ 182.984809] lost page write due to I/O error on nbd14 [ 182.984812] JBD2: I/O error detected when updating journal superblock for nbd14-8. [ 182.984825] journal commit I/O error [ 184.789984] br100: port 3(veth1) entering forwarding state [ 184.791634] device veth1 left promiscuous mode [ 184.791639] br100: port 3(veth1) entering disabled state [ 185.236242] nbd12: NBD_DISCONNECT [ 185.236362] nbd12: Receive control failed (result -32) [ 185.236418] nbd12: queue cleared [ 185.236734] nbd12: Attempted send on closed socket [ 185.236737] end_request: I/O error, dev nbd12, sector 328280 [ 185.236740] Buffer I/O error on device nbd12, logical block 41035 [ 185.236745] EXT4-fs warning (device nbd12): ext4_end_bio:242: I/O error writing to inode 32327 (offset 0 size 4096 starting block 41036) [ 185.236804] nbd12: Attempted send on closed socket [ 185.236806] end_request: I/O error, dev nbd12, sector 328256 [ 185.236809] Buffer I/O error on device nbd12, logical block 41032 [ 185.236812] EXT4-fs warning (device nbd12): ext4_end_bio:242: I/O error writing to inode 32342 (offset 0 size 4096 starting block 41033) [ 185.236998] JBD2: Detected IO errors while flushing file data on nbd12-8 [ 185.237005] nbd12: Attempted send on closed socket [ 185.237007] end_request: I/O error, dev nbd12, sector 1049856 [ 185.237025] Aborting journal on device nbd12-8. [ 185.237034] nbd12: Attempted send on closed socket [ 185.237036] end_request: I/O error, dev nbd12, sector 1048576 [ 185.237039] Buffer I/O error on device nbd12, logical block 131072 [ 185.237041] lost page write due to I/O error on nbd12 [ 185.237044] JBD2: I/O error detected when updating journal superblock for nbd12-8. [ 185.237059] journal commit I/O error [ 185.342363] nbd14: Attempted send on closed socket [ 185.342369] end_request: I/O error, dev nbd14, sector 0 [ 185.342374] Buffer I/O error on device nbd14, logical block 0 [ 185.342375] lost page write due to I/O error on nbd14 [ 185.342388] EXT4-fs error (device nbd14): ext4_put_super:771: Couldn't clean up the journal [ 185.342392] EXT4-fs (nbd14): Remounting filesystem read-only [ 185.342394] EXT4-fs (nbd14): previous I/O error to superblock detected [ 185.342399] nbd14: Attempted send on closed socket [ 185.342401] end_request: I/O error, dev nbd14, sector 0 [ 185.342404] Buffer I/O error on device nbd14, logical block 0 [ 185.342405] lost page write due to I/O error on nbd14 [ 185.352231] nbd12: Attempted send on closed socket [ 185.352236] end_request: I/O error, dev nbd12, sector 0 [ 185.352239] Buffer I/O error on device nbd12, logical block 0 [ 185.352241] lost page write due to I/O error on nbd12 [ 185.352252] EXT4-fs error (device nbd12): ext4_put_super:771: Couldn't clean up the journal [ 185.352256] EXT4-fs (nbd12): Remounting filesystem read-only [ 185.352258] EXT4-fs (nbd12): previous I/O error to superblock detected [ 178.733767] nbd13: NBD_DISCONNECT [ 178.733865] nbd13: Receive control failed (result -32) [ 178.733911] nbd13: shutting down socket [ 178.733914] nbd13: queue cleared [ 178.734250] nbd13: Attempted send on closed socket [ 178.734254] end_request: I/O error, dev nbd13, sector 328280 [ 178.734257] Buffer I/O error on device nbd13, logical block 41035 [ 178.734262] EXT4-fs warning (device nbd13): ext4_end_bio:242: I/O error writing to inode 32327 (offset 0 size 4096 starting block 41036) [ 178.734334] nbd13: Attempted send on closed socket [ 178.734336] end_request: I/O error, dev nbd13, sector 328256 [ 178.734338] Buffer I/O error on device nbd13, logical block 41032 [ 178.734342] EXT4-fs warning (device nbd13): ext4_end_bio:242: I/O error writing to inode 32342 (offset 0 size 4096 starting block 41033) [ 178.736325] JBD2: Detected IO errors while flushing file data on nbd13-8 [ 178.736339] nbd13: Attempted send on closed socket [ 178.736343] end_request: I/O error, dev nbd13, sector 1049856 [ 178.736361] Aborting journal on device nbd13-8. [ 178.736370] nbd13: Attempted send on closed socket [ 178.736372] end_request: I/O error, dev nbd13, sector 1048576 [ 178.736375] Buffer I/O error on device nbd13, logical block 131072 [ 178.736377] lost page write due to I/O error on nbd13 --- AlsaVersion: Advanced Linux Sound Architecture Driver Version 1.0.24. AplayDevices: **** List of PLAYBACK Hardware Devices **** card 0: Intel [HDA Intel], device 0: CONEXANT Analog [CONEXANT Analog] Subdevices: 1/1 Subdevice #0: subdevice #0 ApportVersion: 1.23-0ubuntu2 Architecture: amd64 ArecordDevices: **** List of CAPTURE Hardware Devices **** card 0: Intel [HDA Intel], device 0: CONEXANT Analog [CONEXANT Analog] Subdevices: 1/1 Subdevice #0: subdevice #0 AudioDevicesInUse: USER PID ACCESS COMMAND /dev/snd/controlC0: serge 18231 F.... pulseaudio CRDA: Error: [Errno 2] No such file or directory Card0.Amixer.info: Card hw:0 'Intel'/'HDA Intel at 0xf6afc000 irq 47' Mixer name : 'Conexant CX20583 (Pebble HSF)' Components : 'HDA:14f15067,102802d8,00100300' Controls : 9 Simple ctrls : 6 DistroRelease: Ubuntu 11.10 HibernationDevice: RESUME=UUID=6dd34b33-9e9e-46ef-9cd8-3ce1c68b7da3 InstallationMedia: Ubuntu 11.10 "Oneiric Ocelot" - Beta amd64 (20110921.2) MachineType: Dell Inc. Vostro 1220 NonfreeKernelModules: wl Package: linux (not installed) ProcEnviron: PATH=(custom, user) LANG=en_US.UTF-8 SHELL=/bin/bash ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.0.0-12-generic root=UUID=d31d979b-16d0-4522-9043-23b4f85aeb89 ro quiet splash vt.handoff=7 ProcVersionSignature: Ubuntu 3.0.0-12.19-generic 3.0.4 RelatedPackageVersions: linux-restricted-modules-3.0.0-12-generic N/A linux-backports-modules-3.0.0-12-generic N/A linux-firmware 1.60 Tags: oneiric running-unity Uname: Linux 3.0.0-12-generic x86_64 UpgradeStatus: No upgrade log present (probably fresh install) UserGroups: adm admin cdrom dialout kvm libvirtd lpadmin plugdev sambashare dmi.bios.date: 10/15/2009 dmi.bios.vendor: Dell Inc. dmi.bios.version: 1.3.0 dmi.board.name: 0X482M dmi.board.vendor: Dell Inc. dmi.chassis.type: 8 dmi.chassis.vendor: Dell Inc. dmi.modalias: dmi:bvnDellInc.:bvr1.3.0:bd10/15/2009:svnDellInc.:pnVostro1220:pvr:rvnDellInc.:rn0X482M:rvr:cvnDellInc.:ct8:cvr: dmi.product.name: Vostro 1220 dmi.sys.vendor: Dell Inc.
2011-09-28 18:43:26 Serge Hallyn attachment added AcpiTables.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475952/+files/AcpiTables.txt
2011-09-28 18:43:28 Serge Hallyn attachment added AlsaDevices.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475953/+files/AlsaDevices.txt
2011-09-28 18:43:31 Serge Hallyn attachment added BootDmesg.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475954/+files/BootDmesg.txt
2011-09-28 18:43:33 Serge Hallyn attachment added Card0.Amixer.values.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475955/+files/Card0.Amixer.values.txt
2011-09-28 18:43:36 Serge Hallyn attachment added Card0.Codecs.codec.0.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475956/+files/Card0.Codecs.codec.0.txt
2011-09-28 18:43:37 Serge Hallyn attachment added CurrentDmesg.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475957/+files/CurrentDmesg.txt
2011-09-28 18:43:39 Serge Hallyn attachment added IwConfig.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475973/+files/IwConfig.txt
2011-09-28 18:43:40 Serge Hallyn attachment added Lspci.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475974/+files/Lspci.txt
2011-09-28 18:43:43 Serge Hallyn attachment added Lsusb.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475975/+files/Lsusb.txt
2011-09-28 18:43:45 Serge Hallyn attachment added PciMultimedia.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475976/+files/PciMultimedia.txt
2011-09-28 18:43:47 Serge Hallyn attachment added ProcCpuinfo.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475977/+files/ProcCpuinfo.txt
2011-09-28 18:43:48 Serge Hallyn attachment added ProcInterrupts.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475978/+files/ProcInterrupts.txt
2011-09-28 18:43:51 Serge Hallyn attachment added ProcModules.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475979/+files/ProcModules.txt
2011-09-28 18:43:53 Serge Hallyn attachment added PulseSinks.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475980/+files/PulseSinks.txt
2011-09-28 18:43:55 Serge Hallyn attachment added PulseSources.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475981/+files/PulseSources.txt
2011-09-28 18:43:58 Serge Hallyn attachment added RfKill.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475982/+files/RfKill.txt
2011-09-28 18:44:00 Serge Hallyn attachment added UdevDb.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475983/+files/UdevDb.txt
2011-09-28 18:44:03 Serge Hallyn attachment added UdevLog.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475984/+files/UdevLog.txt
2011-09-28 18:44:06 Serge Hallyn attachment added WifiSyslog.txt https://bugs.launchpad.net/bugs/861656/+attachment/2475985/+files/WifiSyslog.txt
2011-09-28 18:44:26 Serge Hallyn linux (Ubuntu): status Incomplete Confirmed
2011-09-30 19:25:00 Serge Hallyn description My host has xfs rootfs. It runs openstack with lxc, which creates the container root filesystems on qemu-nbd block devices with ext4fs by default. For probably 1 in 8 containers, when the host is working hard, I end up with ext4 errors which in the end prevent the host from cleanly rebooting. http://people.canonical.com/~serge/20110927_001.jpg is one example. Here is another one: [ 178.736380] JBD2: I/O error detected when updating journal superblock for nbd13-8. [ 178.736567] journal commit I/O error [ 182.374588] br100: port 4(veth2) entering forwarding state [ 182.376240] device veth2 left promiscuous mode [ 182.376245] br100: port 4(veth2) entering disabled state [ 182.983726] nbd14: NBD_DISCONNECT [ 182.983979] nbd14: Receive control failed (result -32) [ 182.984075] nbd14: queue cleared [ 182.984525] nbd14: Attempted send on closed socket [ 182.984530] end_request: I/O error, dev nbd14, sector 328280 [ 182.984533] Buffer I/O error on device nbd14, logical block 41035 [ 182.984538] EXT4-fs warning (device nbd14): ext4_end_bio:242: I/O error writing to inode 32327 (offset 0 size 4096 starting block 41036) [ 182.984597] nbd14: Attempted send on closed socket [ 182.984600] end_request: I/O error, dev nbd14, sector 328256 [ 182.984602] Buffer I/O error on device nbd14, logical block 41032 [ 182.984605] EXT4-fs warning (device nbd14): ext4_end_bio:242: I/O error writing to inode 32342 (offset 0 size 4096 starting block 41033) [ 182.984770] JBD2: Detected IO errors while flushing file data on nbd14-8 [ 182.984776] nbd14: Attempted send on closed socket [ 182.984779] end_request: I/O error, dev nbd14, sector 1049856 [ 182.984794] Aborting journal on device nbd14-8. [ 182.984802] nbd14: Attempted send on closed socket [ 182.984804] end_request: I/O error, dev nbd14, sector 1048576 [ 182.984807] Buffer I/O error on device nbd14, logical block 131072 [ 182.984809] lost page write due to I/O error on nbd14 [ 182.984812] JBD2: I/O error detected when updating journal superblock for nbd14-8. [ 182.984825] journal commit I/O error [ 184.789984] br100: port 3(veth1) entering forwarding state [ 184.791634] device veth1 left promiscuous mode [ 184.791639] br100: port 3(veth1) entering disabled state [ 185.236242] nbd12: NBD_DISCONNECT [ 185.236362] nbd12: Receive control failed (result -32) [ 185.236418] nbd12: queue cleared [ 185.236734] nbd12: Attempted send on closed socket [ 185.236737] end_request: I/O error, dev nbd12, sector 328280 [ 185.236740] Buffer I/O error on device nbd12, logical block 41035 [ 185.236745] EXT4-fs warning (device nbd12): ext4_end_bio:242: I/O error writing to inode 32327 (offset 0 size 4096 starting block 41036) [ 185.236804] nbd12: Attempted send on closed socket [ 185.236806] end_request: I/O error, dev nbd12, sector 328256 [ 185.236809] Buffer I/O error on device nbd12, logical block 41032 [ 185.236812] EXT4-fs warning (device nbd12): ext4_end_bio:242: I/O error writing to inode 32342 (offset 0 size 4096 starting block 41033) [ 185.236998] JBD2: Detected IO errors while flushing file data on nbd12-8 [ 185.237005] nbd12: Attempted send on closed socket [ 185.237007] end_request: I/O error, dev nbd12, sector 1049856 [ 185.237025] Aborting journal on device nbd12-8. [ 185.237034] nbd12: Attempted send on closed socket [ 185.237036] end_request: I/O error, dev nbd12, sector 1048576 [ 185.237039] Buffer I/O error on device nbd12, logical block 131072 [ 185.237041] lost page write due to I/O error on nbd12 [ 185.237044] JBD2: I/O error detected when updating journal superblock for nbd12-8. [ 185.237059] journal commit I/O error [ 185.342363] nbd14: Attempted send on closed socket [ 185.342369] end_request: I/O error, dev nbd14, sector 0 [ 185.342374] Buffer I/O error on device nbd14, logical block 0 [ 185.342375] lost page write due to I/O error on nbd14 [ 185.342388] EXT4-fs error (device nbd14): ext4_put_super:771: Couldn't clean up the journal [ 185.342392] EXT4-fs (nbd14): Remounting filesystem read-only [ 185.342394] EXT4-fs (nbd14): previous I/O error to superblock detected [ 185.342399] nbd14: Attempted send on closed socket [ 185.342401] end_request: I/O error, dev nbd14, sector 0 [ 185.342404] Buffer I/O error on device nbd14, logical block 0 [ 185.342405] lost page write due to I/O error on nbd14 [ 185.352231] nbd12: Attempted send on closed socket [ 185.352236] end_request: I/O error, dev nbd12, sector 0 [ 185.352239] Buffer I/O error on device nbd12, logical block 0 [ 185.352241] lost page write due to I/O error on nbd12 [ 185.352252] EXT4-fs error (device nbd12): ext4_put_super:771: Couldn't clean up the journal [ 185.352256] EXT4-fs (nbd12): Remounting filesystem read-only [ 185.352258] EXT4-fs (nbd12): previous I/O error to superblock detected [ 178.733767] nbd13: NBD_DISCONNECT [ 178.733865] nbd13: Receive control failed (result -32) [ 178.733911] nbd13: shutting down socket [ 178.733914] nbd13: queue cleared [ 178.734250] nbd13: Attempted send on closed socket [ 178.734254] end_request: I/O error, dev nbd13, sector 328280 [ 178.734257] Buffer I/O error on device nbd13, logical block 41035 [ 178.734262] EXT4-fs warning (device nbd13): ext4_end_bio:242: I/O error writing to inode 32327 (offset 0 size 4096 starting block 41036) [ 178.734334] nbd13: Attempted send on closed socket [ 178.734336] end_request: I/O error, dev nbd13, sector 328256 [ 178.734338] Buffer I/O error on device nbd13, logical block 41032 [ 178.734342] EXT4-fs warning (device nbd13): ext4_end_bio:242: I/O error writing to inode 32342 (offset 0 size 4096 starting block 41033) [ 178.736325] JBD2: Detected IO errors while flushing file data on nbd13-8 [ 178.736339] nbd13: Attempted send on closed socket [ 178.736343] end_request: I/O error, dev nbd13, sector 1049856 [ 178.736361] Aborting journal on device nbd13-8. [ 178.736370] nbd13: Attempted send on closed socket [ 178.736372] end_request: I/O error, dev nbd13, sector 1048576 [ 178.736375] Buffer I/O error on device nbd13, logical block 131072 [ 178.736377] lost page write due to I/O error on nbd13 --- AlsaVersion: Advanced Linux Sound Architecture Driver Version 1.0.24. AplayDevices: **** List of PLAYBACK Hardware Devices **** card 0: Intel [HDA Intel], device 0: CONEXANT Analog [CONEXANT Analog] Subdevices: 1/1 Subdevice #0: subdevice #0 ApportVersion: 1.23-0ubuntu2 Architecture: amd64 ArecordDevices: **** List of CAPTURE Hardware Devices **** card 0: Intel [HDA Intel], device 0: CONEXANT Analog [CONEXANT Analog] Subdevices: 1/1 Subdevice #0: subdevice #0 AudioDevicesInUse: USER PID ACCESS COMMAND /dev/snd/controlC0: serge 18231 F.... pulseaudio CRDA: Error: [Errno 2] No such file or directory Card0.Amixer.info: Card hw:0 'Intel'/'HDA Intel at 0xf6afc000 irq 47' Mixer name : 'Conexant CX20583 (Pebble HSF)' Components : 'HDA:14f15067,102802d8,00100300' Controls : 9 Simple ctrls : 6 DistroRelease: Ubuntu 11.10 HibernationDevice: RESUME=UUID=6dd34b33-9e9e-46ef-9cd8-3ce1c68b7da3 InstallationMedia: Ubuntu 11.10 "Oneiric Ocelot" - Beta amd64 (20110921.2) MachineType: Dell Inc. Vostro 1220 NonfreeKernelModules: wl Package: linux (not installed) ProcEnviron: PATH=(custom, user) LANG=en_US.UTF-8 SHELL=/bin/bash ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.0.0-12-generic root=UUID=d31d979b-16d0-4522-9043-23b4f85aeb89 ro quiet splash vt.handoff=7 ProcVersionSignature: Ubuntu 3.0.0-12.19-generic 3.0.4 RelatedPackageVersions: linux-restricted-modules-3.0.0-12-generic N/A linux-backports-modules-3.0.0-12-generic N/A linux-firmware 1.60 Tags: oneiric running-unity Uname: Linux 3.0.0-12-generic x86_64 UpgradeStatus: No upgrade log present (probably fresh install) UserGroups: adm admin cdrom dialout kvm libvirtd lpadmin plugdev sambashare dmi.bios.date: 10/15/2009 dmi.bios.vendor: Dell Inc. dmi.bios.version: 1.3.0 dmi.board.name: 0X482M dmi.board.vendor: Dell Inc. dmi.chassis.type: 8 dmi.chassis.vendor: Dell Inc. dmi.modalias: dmi:bvnDellInc.:bvr1.3.0:bd10/15/2009:svnDellInc.:pnVostro1220:pvr:rvnDellInc.:rn0X482M:rvr:cvnDellInc.:ct8:cvr: dmi.product.name: Vostro 1220 dmi.sys.vendor: Dell Inc. My host has xfs rootfs. It runs openstack with lxc, which creates the container root filesystems on qemu-nbd block devices with ext4fs by default. For probably 1 in 8 containers, when the host is working hard, I end up with ext4 errors which in the end prevent the host from cleanly rebooting. http://people.canonical.com/~serge/20110927_001.jpg is one example. Here is another one: [ 178.736380] JBD2: I/O error detected when updating journal superblock for nbd13-8. [ 178.736567] journal commit I/O error [ 182.374588] br100: port 4(veth2) entering forwarding state [ 182.376240] device veth2 left promiscuous mode [ 182.376245] br100: port 4(veth2) entering disabled state [ 182.983726] nbd14: NBD_DISCONNECT [ 182.983979] nbd14: Receive control failed (result -32) [ 182.984075] nbd14: queue cleared [ 182.984525] nbd14: Attempted send on closed socket [ 182.984530] end_request: I/O error, dev nbd14, sector 328280 [ 182.984533] Buffer I/O error on device nbd14, logical block 41035 [ 182.984538] EXT4-fs warning (device nbd14): ext4_end_bio:242: I/O error writing to inode 32327 (offset 0 size 4096 starting block 41036) [ 182.984597] nbd14: Attempted send on closed socket [ 182.984600] end_request: I/O error, dev nbd14, sector 328256 [ 182.984602] Buffer I/O error on device nbd14, logical block 41032 [ 182.984605] EXT4-fs warning (device nbd14): ext4_end_bio:242: I/O error writing to inode 32342 (offset 0 size 4096 starting block 41033) [ 182.984770] JBD2: Detected IO errors while flushing file data on nbd14-8 [ 182.984776] nbd14: Attempted send on closed socket [ 182.984779] end_request: I/O error, dev nbd14, sector 1049856 [ 182.984794] Aborting journal on device nbd14-8. [ 182.984802] nbd14: Attempted send on closed socket [ 182.984804] end_request: I/O error, dev nbd14, sector 1048576 [ 182.984807] Buffer I/O error on device nbd14, logical block 131072 [ 182.984809] lost page write due to I/O error on nbd14 [ 182.984812] JBD2: I/O error detected when updating journal superblock for nbd14-8. [ 182.984825] journal commit I/O error [ 184.789984] br100: port 3(veth1) entering forwarding state [ 184.791634] device veth1 left promiscuous mode [ 184.791639] br100: port 3(veth1) entering disabled state [ 185.236242] nbd12: NBD_DISCONNECT [ 185.236362] nbd12: Receive control failed (result -32) [ 185.236418] nbd12: queue cleared [ 185.236734] nbd12: Attempted send on closed socket [ 185.236737] end_request: I/O error, dev nbd12, sector 328280 [ 185.236740] Buffer I/O error on device nbd12, logical block 41035 [ 185.236745] EXT4-fs warning (device nbd12): ext4_end_bio:242: I/O error writing to inode 32327 (offset 0 size 4096 starting block 41036) [ 185.236804] nbd12: Attempted send on closed socket [ 185.236806] end_request: I/O error, dev nbd12, sector 328256 [ 185.236809] Buffer I/O error on device nbd12, logical block 41032 [ 185.236812] EXT4-fs warning (device nbd12): ext4_end_bio:242: I/O error writing to inode 32342 (offset 0 size 4096 starting block 41033) [ 185.236998] JBD2: Detected IO errors while flushing file data on nbd12-8 [ 185.237005] nbd12: Attempted send on closed socket [ 185.237007] end_request: I/O error, dev nbd12, sector 1049856 [ 185.237025] Aborting journal on device nbd12-8. [ 185.237034] nbd12: Attempted send on closed socket [ 185.237036] end_request: I/O error, dev nbd12, sector 1048576 [ 185.237039] Buffer I/O error on device nbd12, logical block 131072 [ 185.237041] lost page write due to I/O error on nbd12 [ 185.237044] JBD2: I/O error detected when updating journal superblock for nbd12-8. [ 185.237059] journal commit I/O error [ 185.342363] nbd14: Attempted send on closed socket [ 185.342369] end_request: I/O error, dev nbd14, sector 0 [ 185.342374] Buffer I/O error on device nbd14, logical block 0 [ 185.342375] lost page write due to I/O error on nbd14 [ 185.342388] EXT4-fs error (device nbd14): ext4_put_super:771: Couldn't clean up the journal [ 185.342392] EXT4-fs (nbd14): Remounting filesystem read-only [ 185.342394] EXT4-fs (nbd14): previous I/O error to superblock detected [ 185.342399] nbd14: Attempted send on closed socket [ 185.342401] end_request: I/O error, dev nbd14, sector 0 [ 185.342404] Buffer I/O error on device nbd14, logical block 0 [ 185.342405] lost page write due to I/O error on nbd14 [ 185.352231] nbd12: Attempted send on closed socket [ 185.352236] end_request: I/O error, dev nbd12, sector 0 [ 185.352239] Buffer I/O error on device nbd12, logical block 0 [ 185.352241] lost page write due to I/O error on nbd12 [ 185.352252] EXT4-fs error (device nbd12): ext4_put_super:771: Couldn't clean up the journal [ 185.352256] EXT4-fs (nbd12): Remounting filesystem read-only [ 185.352258] EXT4-fs (nbd12): previous I/O error to superblock detected [ 178.733767] nbd13: NBD_DISCONNECT [ 178.733865] nbd13: Receive control failed (result -32) [ 178.733911] nbd13: shutting down socket [ 178.733914] nbd13: queue cleared [ 178.734250] nbd13: Attempted send on closed socket [ 178.734254] end_request: I/O error, dev nbd13, sector 328280 [ 178.734257] Buffer I/O error on device nbd13, logical block 41035 [ 178.734262] EXT4-fs warning (device nbd13): ext4_end_bio:242: I/O error writing to inode 32327 (offset 0 size 4096 starting block 41036) [ 178.734334] nbd13: Attempted send on closed socket [ 178.734336] end_request: I/O error, dev nbd13, sector 328256 [ 178.734338] Buffer I/O error on device nbd13, logical block 41032 [ 178.734342] EXT4-fs warning (device nbd13): ext4_end_bio:242: I/O error writing to inode 32342 (offset 0 size 4096 starting block 41033) [ 178.736325] JBD2: Detected IO errors while flushing file data on nbd13-8 [ 178.736339] nbd13: Attempted send on closed socket [ 178.736343] end_request: I/O error, dev nbd13, sector 1049856 [ 178.736361] Aborting journal on device nbd13-8. [ 178.736370] nbd13: Attempted send on closed socket [ 178.736372] end_request: I/O error, dev nbd13, sector 1048576 [ 178.736375] Buffer I/O error on device nbd13, logical block 131072 [ 178.736377] lost page write due to I/O error on nbd13 --- AlsaVersion: Advanced Linux Sound Architecture Driver Version 1.0.24. AplayDevices: **** List of PLAYBACK Hardware Devices **** card 0: Intel [HDA Intel], device 0: CONEXANT Analog [CONEXANT Analog] Subdevices: 1/1 Subdevice #0: subdevice #0 ApportVersion: 1.23-0ubuntu2 Architecture: amd64 ArecordDevices: **** List of CAPTURE Hardware Devices **** card 0: Intel [HDA Intel], device 0: CONEXANT Analog [CONEXANT Analog] Subdevices: 1/1 Subdevice #0: subdevice #0 AudioDevicesInUse: USER PID ACCESS COMMAND /dev/snd/controlC0: serge 18231 F.... pulseaudio CRDA: Error: [Errno 2] No such file or directory Card0.Amixer.info: Card hw:0 'Intel'/'HDA Intel at 0xf6afc000 irq 47' Mixer name : 'Conexant CX20583 (Pebble HSF)' Components : 'HDA:14f15067,102802d8,00100300' Controls : 9 Simple ctrls : 6 DistroRelease: Ubuntu 11.10 HibernationDevice: RESUME=UUID=6dd34b33-9e9e-46ef-9cd8-3ce1c68b7da3 InstallationMedia: Ubuntu 11.10 "Oneiric Ocelot" - Beta amd64 (20110921.2) MachineType: Dell Inc. Vostro 1220 NonfreeKernelModules: wl Package: linux (not installed) ProcEnviron: PATH=(custom, user) LANG=en_US.UTF-8 SHELL=/bin/bash ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.0.0-12-generic root=UUID=d31d979b-16d0-4522-9043-23b4f85aeb89 ro quiet splash vt.handoff=7 ProcVersionSignature: Ubuntu 3.0.0-12.19-generic 3.0.4 RelatedPackageVersions: linux-restricted-modules-3.0.0-12-generic N/A linux-backports-modules-3.0.0-12-generic N/A linux-firmware 1.60 Tags: oneiric running-unity Uname: Linux 3.0.0-12-generic x86_64 UpgradeStatus: No upgrade log present (probably fresh install) UserGroups: adm admin cdrom dialout kvm libvirtd lpadmin plugdev sambashare dmi.bios.date: 10/15/2009 dmi.bios.vendor: Dell Inc. dmi.bios.version: 1.3.0 dmi.board.name: 0X482M dmi.board.vendor: Dell Inc. dmi.chassis.type: 8 dmi.chassis.vendor: Dell Inc. dmi.modalias: dmi:bvnDellInc.:bvr1.3.0:bd10/15/2009:svnDellInc.:pnVostro1220:pvr:rvnDellInc.:rn0X482M:rvr:cvnDellInc.:ct8:cvr: dmi.product.name: Vostro 1220 dmi.sys.vendor: Dell Inc. --- AlsaVersion: Advanced Linux Sound Architecture Driver Version 1.0.24. AplayDevices: **** List of PLAYBACK Hardware Devices **** card 0: Intel [HDA Intel], device 0: CONEXANT Analog [CONEXANT Analog] Subdevices: 1/1 Subdevice #0: subdevice #0 ApportVersion: 1.23-0ubuntu2 Architecture: amd64 ArecordDevices: **** List of CAPTURE Hardware Devices **** card 0: Intel [HDA Intel], device 0: CONEXANT Analog [CONEXANT Analog] Subdevices: 1/1 Subdevice #0: subdevice #0 AudioDevicesInUse: USER PID ACCESS COMMAND /dev/snd/controlC0: serge 7491 F.... pulseaudio CRDA: Error: [Errno 2] No such file or directory Card0.Amixer.info: Card hw:0 'Intel'/'HDA Intel at 0xf6afc000 irq 47' Mixer name : 'Conexant CX20583 (Pebble HSF)' Components : 'HDA:14f15067,102802d8,00100300' Controls : 9 Simple ctrls : 6 DistroRelease: Ubuntu 11.10 HibernationDevice: RESUME=UUID=6dd34b33-9e9e-46ef-9cd8-3ce1c68b7da3 InstallationMedia: Ubuntu 11.10 "Oneiric Ocelot" - Beta amd64 (20110921.2) MachineType: Dell Inc. Vostro 1220 NonfreeKernelModules: wl Package: linux (not installed) ProcEnviron: PATH=(custom, user) LANG=en_US.UTF-8 SHELL=/bin/bash ProcKernelCmdLine: BOOT_IMAGE=/boot/vmlinuz-3.0.0-12-generic root=UUID=d31d979b-16d0-4522-9043-23b4f85aeb89 ro quiet splash vt.handoff=7 ProcVersionSignature: Ubuntu 3.0.0-12.19-generic 3.0.4 RelatedPackageVersions: linux-restricted-modules-3.0.0-12-generic N/A linux-backports-modules-3.0.0-12-generic N/A linux-firmware 1.60 Tags: oneiric running-unity Uname: Linux 3.0.0-12-generic x86_64 UpgradeStatus: No upgrade log present (probably fresh install) UserGroups: adm admin cdrom dialout kvm libvirtd lpadmin plugdev sambashare dmi.bios.date: 10/15/2009 dmi.bios.vendor: Dell Inc. dmi.bios.version: 1.3.0 dmi.board.name: 0X482M dmi.board.vendor: Dell Inc. dmi.chassis.type: 8 dmi.chassis.vendor: Dell Inc. dmi.modalias: dmi:bvnDellInc.:bvr1.3.0:bd10/15/2009:svnDellInc.:pnVostro1220:pvr:rvnDellInc.:rn0X482M:rvr:cvnDellInc.:ct8:cvr: dmi.product.name: Vostro 1220 dmi.sys.vendor: Dell Inc.
2011-09-30 19:25:02 Serge Hallyn attachment added AcpiTables.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488745/+files/AcpiTables.txt
2011-09-30 19:25:04 Serge Hallyn attachment added AlsaDevices.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488746/+files/AlsaDevices.txt
2011-09-30 19:25:06 Serge Hallyn attachment added BootDmesg.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488747/+files/BootDmesg.txt
2011-09-30 19:25:07 Serge Hallyn attachment added Card0.Amixer.values.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488748/+files/Card0.Amixer.values.txt
2011-09-30 19:25:08 Serge Hallyn attachment added Card0.Codecs.codec.0.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488749/+files/Card0.Codecs.codec.0.txt
2011-09-30 19:25:10 Serge Hallyn attachment added CurrentDmesg.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488750/+files/CurrentDmesg.txt
2011-09-30 19:25:11 Serge Hallyn attachment added IwConfig.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488751/+files/IwConfig.txt
2011-09-30 19:25:14 Serge Hallyn attachment added Lspci.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488752/+files/Lspci.txt
2011-09-30 19:25:16 Serge Hallyn attachment added Lsusb.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488753/+files/Lsusb.txt
2011-09-30 19:25:18 Serge Hallyn attachment added PciMultimedia.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488754/+files/PciMultimedia.txt
2011-09-30 19:25:19 Serge Hallyn attachment added ProcCpuinfo.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488755/+files/ProcCpuinfo.txt
2011-09-30 19:25:20 Serge Hallyn attachment added ProcInterrupts.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488756/+files/ProcInterrupts.txt
2011-09-30 19:25:22 Serge Hallyn attachment added ProcModules.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488757/+files/ProcModules.txt
2011-09-30 19:25:24 Serge Hallyn attachment added PulseSinks.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488758/+files/PulseSinks.txt
2011-09-30 19:25:26 Serge Hallyn attachment added PulseSources.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488759/+files/PulseSources.txt
2011-09-30 19:25:27 Serge Hallyn attachment added RfKill.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488760/+files/RfKill.txt
2011-09-30 19:25:29 Serge Hallyn attachment added UdevDb.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488761/+files/UdevDb.txt
2011-09-30 19:25:31 Serge Hallyn attachment added UdevLog.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488762/+files/UdevLog.txt
2011-09-30 19:25:33 Serge Hallyn attachment added WifiSyslog.txt https://bugs.launchpad.net/bugs/861656/+attachment/2488763/+files/WifiSyslog.txt
2011-09-30 19:53:39 Serge Hallyn bug task added qemu-kvm (Ubuntu)
2011-09-30 19:57:28 Serge Hallyn attachment added qemu-nbd-oops.sh https://bugs.launchpad.net/ubuntu/+source/qemu-kvm/+bug/861656/+attachment/2488851/+files/qemu-nbd-oops.sh
2011-09-30 19:58:51 Serge Hallyn summary many ext4 errors Kernel oops when nbd device is removed before it is unmounted
2011-09-30 21:01:48 Serge Hallyn bug task added nova (Ubuntu)
2011-09-30 21:02:03 Serge Hallyn nova (Ubuntu): status New Confirmed
2011-09-30 21:02:08 Serge Hallyn qemu-kvm (Ubuntu): status New Confirmed
2011-10-04 01:20:00 Serge Hallyn nova (Ubuntu): assignee Chuck Short (zulcss)
2011-10-04 01:20:09 Serge Hallyn nova (Ubuntu): importance Undecided High
2011-10-04 01:21:20 Serge Hallyn attachment added debdiff solving the issue https://bugs.launchpad.net/ubuntu/+source/linux/+bug/861656/+attachment/2504443/+files/nova-nbd.debdiff
2011-10-04 04:08:51 Ubuntu Foundations Team Bug Bot tags apport-collected oneiric running-unity apport-collected oneiric patch running-unity
2011-10-04 04:08:53 Ubuntu Foundations Team Bug Bot bug added subscriber Ubuntu Sponsors Team
2011-10-04 19:11:52 Serge Hallyn linux (Ubuntu): status Confirmed Invalid
2011-10-04 19:11:57 Serge Hallyn qemu-kvm (Ubuntu): status Confirmed Invalid
2011-10-25 11:14:07 James Page removed subscriber Ubuntu Sponsors Team
2012-03-23 03:36:15 Kate Stewart nominated for series Ubuntu Oneiric
2012-03-23 03:36:15 Kate Stewart bug task added linux (Ubuntu Oneiric)
2012-03-23 03:36:15 Kate Stewart bug task added nova (Ubuntu Oneiric)
2012-03-23 03:36:15 Kate Stewart bug task added qemu-kvm (Ubuntu Oneiric)
2012-03-23 03:36:33 Kate Stewart qemu-kvm (Ubuntu Oneiric): status New Invalid
2012-03-23 03:36:38 Kate Stewart linux (Ubuntu Oneiric): status New Invalid
2012-03-23 03:36:47 Kate Stewart nova (Ubuntu Oneiric): status New Confirmed
2012-03-23 03:36:52 Kate Stewart nova (Ubuntu Oneiric): importance Undecided High
2012-10-04 15:15:34 Chuck Short linux (Ubuntu): status Invalid Confirmed
2012-10-04 15:15:39 Chuck Short linux (Ubuntu Oneiric): status Invalid Confirmed
2012-10-04 15:15:47 Chuck Short nominated for series Ubuntu Quantal
2012-10-04 15:15:47 Chuck Short bug task added linux (Ubuntu Quantal)
2012-10-04 15:15:47 Chuck Short bug task added qemu-kvm (Ubuntu Quantal)
2012-10-04 15:15:47 Chuck Short bug task added nova (Ubuntu Quantal)
2012-10-04 15:33:58 Louis Bouchard bug added subscriber Louis Bouchard
2013-02-28 19:24:32 Chuck Short nova (Ubuntu): status Confirmed Fix Released
2013-05-18 14:37:44 dino99 tags apport-collected oneiric patch running-unity apport-collected patch quantal running-unity
2013-05-18 14:40:12 dino99 linux (Ubuntu Oneiric): status Confirmed Invalid
2013-05-18 14:40:20 dino99 nova (Ubuntu Oneiric): status Confirmed Invalid
2013-05-18 14:41:00 dino99 nova (Ubuntu Quantal): status Confirmed Incomplete
2013-05-18 14:41:08 dino99 linux (Ubuntu Quantal): status Confirmed Incomplete
2013-05-18 14:41:19 dino99 linux (Ubuntu): status Confirmed Incomplete
2013-07-08 21:25:59 Chris J Arges bug added subscriber Sustaining Engineering
2014-02-07 15:44:11 Curtis Hovey removed subscriber Registry Administrators
2014-09-15 20:22:03 Joseph Salisbury linux (Ubuntu Quantal): status Incomplete Won't Fix
2014-09-15 23:07:41 dino99 nova (Ubuntu Quantal): status Incomplete Invalid
2014-09-15 23:08:18 dino99 linux (Ubuntu): status Incomplete Invalid