It looks like /sys/fs/cgroup/*/libvirt/qemu/$vm needs to be added to libvirt-qemu.
Also, /dev/ptmx is now a symlink or bind mount to /dev/pts/ptmx. /etc/appamor.d/abstractions/libvirt-qemu lists /dev/ptmx, but needs to also list /dev/pts/ptmx.
After adding /sys/fs/cgroup/** rw and /dev/pts/ptmx rw to /etc/apparmor.d/abstractions/libvirt-qemu, I get what appear to be libvirt-qemu incompatibilities:
It looks like /sys/fs/ cgroup/ */libvirt/ qemu/$vm needs to be added to libvirt-qemu.
Also, /dev/ptmx is now a symlink or bind mount to /dev/pts/ptmx. /etc/appamor. d/abstractions/ libvirt- qemu lists /dev/ptmx, but needs to also list /dev/pts/ptmx.
After adding /sys/fs/cgroup/** rw and /dev/pts/ptmx rw to /etc/apparmor. d/abstractions/ libvirt- qemu, I get what appear to be libvirt-qemu incompatibilities:
2013-03-20 17:50:50.759+0000: 5788: debug : qemuMonitorJSON IOProcessLine: 170 : QEMU_MONITOR_ RECV_REPLY: mon=0x7f0414007f50 reply={"return": [{"name": "SPICE_ MIGRATE_ COMPLETED" }, {"name": "BALLOON_CHANGE"}, {"name": "WAKEUP"}, {"name": "SUSPEND_DISK"}, {"name": "SUSPEND"}, {"name": "DEVICE_ TRAY_MOVED" }, {"name": "BLOCK_JOB_READY"}, {"name": "BLOCK_JOB_ERROR"}, {"name": "BLOCK_ JOB_CANCELLED" }, {"name": "BLOCK_ JOB_COMPLETED" }, {"name": "SPICE_ DISCONNECTED" }, {"name": "SPICE_ INITIALIZED" }, {"name": "SPICE_CONNECTED"}, {"name": "WATCHDOG"}, {"name": "RTC_CHANGE"}, {"name": "BLOCK_IO_ERROR"}, {"name": "VNC_DISCONNECT ED"}, {"name": "VNC_INITIALIZED"}, {"name": "VNC_CONNECTED"}, {"name": "RESUME"}, {"name": "STOP"}, {"name": "POWERDOWN"}, {"name": "RESET"}, {"name": "SHUTDOWN"}], "id": "libvirt-5"} ocess:342 : QEMU_MONITOR_ IO_PROCESS: mon=0x7f0414007f50 buf={"id": "libvirt-9", "error": {"class": "DeviceNotFound", "desc": "Device 'virtio-blk-s390' not found"}} IOProcessLine: 150 : Line [{"id": "libvirt-9", "error": {"class": "DeviceNotFound", "desc": "Device 'virtio-blk-s390' not found"}}] mString: 944 : string={"id": "libvirt-9", "error": {"class": "DeviceNotFound", "desc": "Device 'virtio-blk-s390' not found"}} IOProcessLine: 170 : QEMU_MONITOR_ RECV_REPLY: mon=0x7f0414007f50 reply={"id": "libvirt-9", "error": {"class": "DeviceNotFound", "desc": "Device 'virtio-blk-s390' not found"}} ocess:342 : QEMU_MONITOR_ IO_PROCESS: mon=0x7f0414007f50 buf={"id": "libvirt-10", "error": {"class": "DeviceNotFound", "desc": "Device 'virtio-net-s390' not found"}} IOProcessLine: 150 : Line [{"id": "libvirt-10", "error": {"class": "DeviceNotFound", "desc": "Device 'virtio-net-s390' not found"}}] mString: 944 : string={"id": "libvirt-10", "error": {"class": "DeviceNotFound", "desc": "Device 'virtio-net-s390' not found"}} IOProcessLine: 170 : QEMU_MONITOR_ RECV_REPLY: mon=0x7f0414007f50 reply={"id": "libvirt-10", "error": {"class": "DeviceNotFound", "desc": "Device 'virtio-net-s390' not found"}} ocess:342 : QEMU_MONITOR_ IO_PROCESS: mon=0x7f0414007f50 buf={"id": "libvirt-11", "error": {"class": "DeviceNotFound", "desc": "Device 'pci-assign' not found"}} IOProcessLine: 150 : Line [{"id": "libvirt-11", "error": {"class": "DeviceNotFound", "desc": "Device 'pci-assign' not found"}}] mString: 944 : string={"id": "libvirt-11", "error": {"class": "DeviceNotFound", "desc": "Device 'pci-assign' not found"}} IOProcessLine: 170 : QEMU_MONITOR_ RECV_REPLY: mon=0x7f0414007f50 reply={"id": "libvirt-11", "error": {"class": "DeviceNotFound", "desc": "Device 'pci-assign' not found"}} ocess:342 : QEMU_MONITOR_ IO_PROCESS: mon=0x7f0414007f50 buf={"id": "libvirt-16", "error": {"class": "DeviceNotFound", "desc": "Device 'usb-redir' not found"}} IOProcessLine: 150 : Line [{"id": "libvirt-16", "error": {"class": "DeviceNotFound", "desc": "Device 'usb-redir' not found"}}]
2013-03-20 17:50:50.798+0000: 5788: debug : qemuMonitorIOPr
2013-03-20 17:50:50.798+0000: 5788: debug : qemuMonitorJSON
2013-03-20 17:50:50.798+0000: 5788: debug : virJSONValueFro
2013-03-20 17:50:50.799+0000: 5788: debug : qemuMonitorJSON
2013-03-20 17:50:50.802+0000: 5788: debug : qemuMonitorIOPr
2013-03-20 17:50:50.802+0000: 5788: debug : qemuMonitorJSON
2013-03-20 17:50:50.802+0000: 5788: debug : virJSONValueFro
2013-03-20 17:50:50.802+0000: 5788: debug : qemuMonitorJSON
2013-03-20 17:50:50.805+0000: 5788: debug : qemuMonitorIOPr
2013-03-20 17:50:50.805+0000: 5788: debug : qemuMonitorJSON
2013-03-20 17:50:50.805+0000: 5788: debug : virJSONValueFro
2013-03-20 17:50:50.806+0000: 5788: debug : qemuMonitorJSON
2013-03-20 17:50:50.828+0000: 5788: debug : qemuMonitorIOPr
2013-03-20 17:50:50.828+0000: 5788: debug : qemuMonitorJSON