canonistack-bos01: arm64, s390x, ppc64el raspberry pi 3b: armhf (compat mode) arm64: ----- $ openstack server create --image ubuntu/ubuntu-jammy-22.04-arm64-server-20230302-disk1.img --flavor cpu4-ram4-disk10 --key-name mfo_canonistack-bos01 mfo-jammy-arm64 ... - amd64 (PASS 5/5) $ qemu-system-x86_64 -machine pc -cpu qemu64 -nographic -smp 4 -m 2G -drive file=jammy-server-cloudimg-amd64.img,format=qcow2,id=drive0,if=none -device virtio-blk,drive=drive0 - ppc64le (PASS 5/5) $ qemu-system-ppc64le -machine pseries -cpu POWER9 -nographic -smp 4 -m 2G -drive file=jammy-server-cloudimg-ppc64el.img,format=qcow2,id=drive0,if=none -device virtio-blk,drive=drive0 - s390x (FAIL 2/5 -- also FAILs with LTO disabled) $ qemu-system-s390x -machine s390-ccw-virtio -cpu qemu -nographic -smp 4 -m 2G -drive file=jammy-server-cloudimg-s390x.img,format=qcow2,id=drive0,if=none -device virtio-blk,drive=drive0 [ 27.971000] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.7 ... [ 95.754567] Unable to handle kernel pointer dereference in virtual kernel address space ... [ 95.826330] CPU: 1 PID: 199 Comm: systemd-udevd Not tainted 5.15.0-67-generic #74-Ubuntu [ 95.849669] Hardware name: QEMU 3906 QEMU (KVM/Linux) [ 95.851171] Krnl PSW : 0704c00180000000 000003ff8007c06a (cpu_feature_match_MSA_init+0x6a/0x1000 [sha256_s390]) ... - armhf (FAIL 3/3) qemu-system-arm -machine virt -nographic -smp 4 -m 512M -cpu max -drive file=jammy-server-cloudimg-armhf.img,format=qcow2,id=drive0,if=none -device virtio-blk-device,drive=drive0 -kernel vmlinuz-5.15.0-67-generic-lpae -initrd initrd.img-5.15.0-67-generic-lpae -append 'root=/dev/vda1 ro' [ 509.239710] systemd[1]: Hostname set to . qemu-system-arm: ../../block/aio_task.c:64: aio_task_pool_wait_one: Assertion `qemu_coroutine_self() == pool->main_co' failed. Aborted (core dumped) - armhf (PASS 3/3) -- PPA packages (LTO disabled) Passes that point and reaches Emergency Shell due to timeout on filesystem mount (slow emulation). - arm64 (FAIL 5/5) BdsDxe: failed to load Boot0001 "UEFI Misc Device" from VenHw(93E34C7E-B50E-11DF-9223-2443DFD72085,00): Not Found ... qemu-system-aarch64: GLib: g_source_ref: assertion 'source != NULL' failed Segmentation fault (core dumped) - arm64 (PASS 5/5) -- PPA packages (LTO disabled) BdsDxe: failed to load Boot0001 "UEFI Misc Device" from VenHw(93E34C7E-B50E-11DF-9223-2443DFD72085,00): Not Found BdsDxe: loading Boot0002 "UEFI Misc Device 2" from VenHw(837DCA9E-E874-4D82-B29A-23FE0E23D1E2,003E000A00000000) BdsDxe: starting Boot0002 "UEFI Misc Device 2" from VenHw(837DCA9E-E874-4D82-B29A-23FE0E23D1E2,003E000A00000000) EFI stub: Booting Linux Kernel... EFI stub: EFI_RNG_PROTOCOL unavailable EFI stub: Using DTB from configuration table EFI stub: Exiting boot services... [ 0.000000] Booting Linux on physical CPU 0x0000000000 [0x411fd070] ... s390x ----- $ openstack server create --image ubuntu/ubuntu-jammy-22.04-s390x-server-20230302-disk1.img --flavor cpu8-ram8-disk20 --key-name mfo_canonistack-bos01 mfo-jammy-s390x ... $ dpkg --print-architecture s390x $ head -n1 /proc/cpuinfo vendor_id : IBM/S390 qemu-system-s390x # works fine; rarely, kernel errors (invalid opcode or memory access), 2/30, not fixed with LTO disabled. - s390x (FAIL 2/10 -- also FAILs with LTO disabled) $ wget https://cloud-images.ubuntu.com/jammy/current/jammy-server-cloudimg-s390x.img $ sudo apt install --yes --no-install-recommends qemu-system-s390x $ qemu-system-s390x -machine s390-ccw-virtio -cpu qemu -nographic -smp 4 -m 2G -drive file=jammy-server-cloudimg-s390x.img,format=qcow2,id=drive0,if=none -device virtio-blk,drive=drive0 [ 7.798476] Run /init as init process Loading, please wait... Starting version 249.11-0ubuntu3.7 ... [ 17.489439] illegal operation: 0001 ilc:1 [#1] SMP ... [ 17.491136] CPU: 2 PID: 199 Comm: systemd-udevd Not tainted 5.15.0-67-generic #74-Ubuntu [ 17.491570] Hardware name: QEMU 3906 QEMU (KVM/Linux) [ 17.491776] Krnl PSW : 0704c00180000000 000003ff8008406c (cpu_feature_match_MSA_init+0x6c/0x1000 [sha3_512_s390]) - other run: [ 18.398662] illegal operation: 0001 ilc:1 [#1] SMP ... [ 18.400957] CPU: 1 PID: 199 Comm: systemd-udevd Not tainted 5.15.0-67-generic #74-Ubuntu [ 18.401328] Hardware name: QEMU 3906 QEMU (KVM/Linux) [ 18.401567] Krnl PSW : 0704d00180000000 000003ff8007c02e (cpu_feature_match_MSA_init+0x2e/0x1000 [pkey]) - arm64 (FAIL 5/5) -- Ubuntu packages sudo apt install --yes --no-install-recommends qemu-system-arm qemu-efi-aarch64 ipxe-qemu cp /usr/share/AAVMF/AAVMF_CODE.fd flash0.img cp /usr/share/AAVMF/AAVMF_VARS.fd flash1.img qemu-system-aarch64 \ -machine virt -nographic \ -smp 4 -m 4G \ -cpu cortex-a57 \ -pflash flash0.img -pflash flash1.img \ -drive file=jammy-server-cloudimg-arm64.img,format=qcow2,id=drive0,if=none \ -device virtio-blk-device,drive=drive0 ... qemu-system-aarch64: GLib: g_source_ref: assertion 'source != NULL' failed Segmentation fault (core dumped) ... qemu-system-aarch64: GLib: g_source_ref: assertion 'source != NULL' failed Segmentation fault (core dumped) ... qemu-system-aarch64: GLib: g_source_ref: assertion 'source != NULL' failed Segmentation fault (core dumped) ... qemu-system-aarch64: GLib: g_source_ref: assertion 'source != NULL' failed Segmentation fault (core dumped) ... qemu-system-aarch64: GLib: g_source_ref: assertion 'source != NULL' failed Segmentation fault (core dumped) - arm64 ("PASS" 3/3) -- PPA packages BdsDxe: loading Boot0008 "ubuntu" from HD(15,GPT,0255C457-32B1-43D1-A744-5F65409A80EB,0x800,0x31801)/\EFI\ubuntu\shimaa64.efi BdsDxe: starting Boot0008 "ubuntu" from HD(15,GPT,0255C457-32B1-43D1-A744-5F65409A80EB,0x800,0x31801)/\EFI\ubuntu\shimaa64.efi EFI stub: Booting Linux Kernel... EFI stub: EFI_RNG_PROTOCOL unavailable EFI stub: Using DTB from configuration table EFI stub: Exiting boot services... qemu-system-aarch64: ../../accel/tcg/cpu-exec.c:862: cpu_loop_exec_tb: Assertion `icount_enabled()' failed. Aborted (core dumped) BdsDxe: loading Boot0008 "ubuntu" from HD(15,GPT,0255C457-32B1-43D1-A744-5F65409A80EB,0x800,0x31801)/\EFI\ubuntu\shimaa64.efi BdsDxe: starting Boot0008 "ubuntu" from HD(15,GPT,0255C457-32B1-43D1-A744-5F65409A80EB,0x800,0x31801)/\EFI\ubuntu\shimaa64.efi EFI stub: Booting Linux Kernel... EFI stub: EFI_RNG_PROTOCOL unavailable EFI stub: Using DTB from configuration table EFI stub: Exiting boot services... qemu-system-aarch64: ../../accel/tcg/cpu-exec.c:862: cpu_loop_exec_tb: Assertion `icount_enabled()' failed. Aborted (core dumped) BdsDxe: loading Boot0008 "ubuntu" from HD(15,GPT,0255C457-32B1-43D1-A744-5F65409A80EB,0x800,0x31801)/\EFI\ubuntu\shimaa64.efi BdsDxe: starting Boot0008 "ubuntu" from HD(15,GPT,0255C457-32B1-43D1-A744-5F65409A80EB,0x800,0x31801)/\EFI\ubuntu\shimaa64.efi EFI stub: Booting Linux Kernel... EFI stub: EFI_RNG_PROTOCOL unavailable EFI stub: Using DTB from configuration table EFI stub: Exiting boot services... qemu-system-aarch64: ../../accel/tcg/cpu-exec.c:862: cpu_loop_exec_tb: Assertion `icount_enabled()' failed. Aborted (core dumped) - armhf (FAIL 3/3) -- Ubuntu packages qemu-system-arm -machine virt -nographic -smp 4 -m 512M -cpu max -drive file=jammy-server-cloudimg-armhf.img,format=qcow2,id=drive0,if=none -device virtio-blk-device,drive=drive0 -kernel vmlinuz-5.15.0-67-generic-lpae -initrd initrd.img-5.15.0-67-generic-lpae -append 'root=/dev/vda1 ro' 1st [ 63.355068] systemd[1]: Detected virtualization qemu. [ 63.357105] systemd[1]: Detected architecture arm. Welcome to Ubuntu 22.04.2 LTS! [ 63.413073] systemd[1]: Hostname set to . qemu-system-arm: ../../block/aio_task.c:64: aio_task_pool_wait_one: Assertion `qemu_coroutine_self() == pool->main_co' failed. 2nd [ 60.289823] systemd[1]: Detected virtualization qemu. [ 60.291816] systemd[1]: Detected architecture arm. Welcome to Ubuntu 22.04.2 LTS! [ 60.352053] systemd[1]: Hostname set to . qemu-system-arm: ../../block/aio_task.c:64: aio_task_pool_wait_one: Assertion `qemu_coroutine_self() == pool->main_co' failed. Aborted (core dumped) 3rd [ 60.488553] systemd[1]: Detected virtualization qemu. [ 60.490644] systemd[1]: Detected architecture arm. Welcome to Ubuntu 22.04.2 LTS! [ 60.535493] systemd[1]: Hostname set to . qemu-system-arm: ../../block/aio_task.c:64: aio_task_pool_wait_one: Assertion `qemu_coroutine_self() == pool->main_co' failed. Aborted (core dumped) - armhf (PASS 3/3) -- PPA packages: 3 times: [ 62.562417] systemd[1]: Detected virtualization qemu. [ 62.563852] systemd[1]: Detected architecture arm. Welcome to Ubuntu 22.04.2 LTS! [ 62.600046] systemd[1]: Hostname set to . [ 62.650454] random: systemd: uninitialized urandom read (16 bytes read) [ 62.652240] systemd[1]: Initializing machine ID from random generator. [ 62.664219] systemd[1]: Instqemu-system-riscv64 \ alled transient /etc/machine-id file. ... Ubuntu 22.04.2 LTS mfo-jammy-s390x ttyAMA0 mfo-jammy-s390x login: # s390x hostname: comes from host -- notice arch is 'arm' and console is 'ttyAMA0' (arm). ppc64el ------- $ openstack server create --image ubuntu/ubuntu-jammy-daily-ppc64el-server-20230302-disk1.img --flavor cpu4-ram4-disk10 --key-name mfo_canonistack-bos01 mfo-jammy-ppc64el $ dpkg --print-architecture ppc64el $ head -n4 /proc/cpuinfo processor : 0 cpu : POWER9 (architected), altivec supported clock : 2250.000000MHz revision : 2.2 (pvr 004e 1202) - ppc64el (PASS 5/5) $ wget https://cloud-images.ubuntu.com/jammy/current/jammy-server-cloudimg-ppc64el.img $ sudo apt install --yes --no-install-recommends qemu-system-ppc seabios $ qemu-system-ppc64le -machine pseries -cpu POWER9 -nographic -smp 4 -m 2G -drive file=jammy-server-cloudimg-ppc64el.img,format=qcow2,id=drive0,if=none -device virtio-blk,drive=drive0 no errors arm64 (FAIL 3/3) -- Ubuntu packages qemu-system-aarch64 \ -machine virt -nographic \ -smp 4 -m 2G \ -cpu cortex-a57 \ -pflash flash0.img -pflash flash1.img \ -drive file=jammy-server-cloudimg-arm64.img,format=qcow2,id=drive0,if=none \ -device virtio-blk-device,drive=drive0 1st) [ 57.042927] systemd[1]: Starting Load Kernel Modules... [ 57.116665] systemd[1]: Starting Coldplug All udev Devices... [ 57.433974] systemd[1]: Started Journal Service. qemu-system-aarch64: ../../block/aio_task.c:64: aio_task_pool_wait_one: Assertion `qemu_coroutine_self() == pool->main_co' failed. 2nd) [ 47.254628] systemd[1]: Finished Load Kernel Module chromeos_pstore. [ 47.274620] systemd[1]: Started Journal Service. [ 48.719426] EXT4-fs (vda1): re-mounted. Opts: discard,errors=remount-ro. Quota mode: none. qemu-system-aarch64: ../../block/aio_task.c:64: aio_task_pool_wait_one: Assertion `qemu_coroutine_self() == pool->main_co' failed. Aborted (core dumped) 3rd) [ 27.959514] EXT4-fs (vda1): INFO: recovery required on readonly filesystem [ 27.960519] EXT4-fs (vda1): write access will be enabled during recovery qemu-system-aarch64: ../../block/aio_task.c:64: aio_task_pool_wait_one: Assertion `qemu_coroutine_self() == pool->main_co' failed. Aborted (core dumped) arm64 (PASS 1/3) -- PPA packages [ 32.127329] systemd[1]: Detected virtualization qemu. [ 32.128227] systemd[1]: Detected architecture arm64. ... Ubuntu 22.04.2 LTS mfo-jammy-ppc64el ttyAMA0 mfo-jammy-ppc64el login: # hostname comes from host system; see 'arm64' and 'ttyAMA0' above. armhf (FAIL 3/3) -- Ubuntu packages 1st) [ 87.596540] systemd[1]: Detected virtualization qemu. [ 87.600393] systemd[1]: Detected architecture arm. Welcome to Ubuntu 22.04.2 LTS! [ 87.711549] systemd[1]: Hostname set to . qemu-system-arm: ../../block/aio_task.c:64: aio_task_pool_wait_one: Assertion `qemu_coroutine_self() == pool->main_co' failed. Aborted (core dumped) 2nd) [ 90.562056] systemd[1]: Detected virtualization qemu. [ 90.564643] systemd[1]: Detected architecture arm. Welcome to Ubuntu 22.04.2 LTS! [ 90.623522] systemd[1]: Hostname set to . qemu-system-arm: ../../block/aio_task.c:64: aio_task_pool_wait_one: Assertion `qemu_coroutine_self() == pool->main_co' failed. Aborted (core dumped) 3rd) [ 89.795237] systemd[1]: Detected virtualization qemu. [ 89.799630] systemd[1]: Detected architecture arm. Welcome to Ubuntu 22.04.2 LTS! [ 89.870652] systemd[1]: Hostname set to . qemu-system-arm: ../../block/aio_task.c:64: aio_task_pool_wait_one: Assertion `qemu_coroutine_self() == pool->main_co' failed. Aborted (core dumped) - armhf (PASS 3/3) -- PPA packages [ 98.046584] systemd[1]: Detected virtualization qemu. [ 98.049380] systemd[1]: Detected architecture arm. Welcome to Ubuntu 22.04.2 LTS! [ 98.148625] systemd[1]: Hostname set to . [ 98.467340] random: systemd: uninitialized urandom read (16 bytes read) [ 98.476230] systemd[1]: Initializing machine ID from random generator. [ 98.497210] systemd[1]: Installed transient /etc/machine-id file. [ 110.896851] random: lvmconfig: uninitialized urandom read (4 bytes read) [ 114.513979] systemd[1]: Queued start job for default target Graphical Interface. [ 114.532495] random: systemd: uninitialized urandom read (16 bytes read) [ 114.585358] systemd[1]: Created slice Slice /system/modprobe. ... Ubuntu 22.04.2 LTS mfo-jammy-ppc64el ttyAMA0 mfo-jammy-ppc64el login: # hostname comes from host system; see 'arm' and 'ttyAMA0' above. - riscv64 (PASS 3/3) qemu-system-riscv64 \ -machine virt -nographic \ -smp 4 -m 2G \ -bios default \ -kernel vmlinuz-* -initrd initrd.img-* \ -append 'root=/dev/vda1 ro console=ttyS0' \ -device virtio-blk-device,drive=drive0 \ -drive file=jammy-server-cloudimg-riscv64.img,format=qcow2,id=drive0 armhf ----- $ dpkg --print-architecture armhf $ sudo dmesg | grep -m1 CPU: [ 0.000000] CPU: ARMv7 Processor [410fd034] revision 4 (ARMv7), cr=10c5383d $ sudo dmesg | grep -m1 OF: [ 0.000000] OF: fdt: Machine model: Raspberry Pi 3 Model B Plus Rev 1.3 $ wget https://cloud-images.ubuntu.com/jammy/current/jammy-server-cloudimg-armhf.img $ # qemu-nbd: copy kernel and initrd. $ sudo apt install --yes --no-install-recommends qemu-system-arm ipxe-qemu $ qemu-system-arm -machine virt -nographic -smp 4 -m 512M -cpu max -drive file=jammy-server-cloudimg-armhf.img,format=qcow2,id=drive0,if=none -device virtio-blk-device,drive=drive0 -kernel vmlinuz-5.15.0-67-generic-lpae -initrd initrd.img-5.15.0-67-generic-lpae -append 'root=/dev/vda1 ro'