[18.04 FEAT]: qemu: Enable RDMA support in qemu
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
The Ubuntu-power-systems project |
Fix Released
|
Medium
|
Canonical Server | ||
qemu (Ubuntu) |
Fix Released
|
Medium
|
Christian Ehrhardt |
Bug Description
== Comment: #0 - SRIKANTH B. AITHAL <email address hidden> - 2016-09-22 06:10:33 ==
---Problem Description---
qemu does not support RDMA
Contact Information = <email address hidden>
---uname output---
Linux ltc-hab1 4.8.0-11-generic #12-Ubuntu SMP Sat Sep 17 19:58:16 UTC 2016 ppc64le ppc64le ppc64le GNU/Linux
Machine Type = 8348-21C
---Debugger---
A debugger is not configured
---Steps to Reproduce---
Attempting RDMA migration throws error saying its unknown migration protocol
root@ltc-
> --nographic \
> --enable-kvm \
> -vga none \
> -machine pseries \
> -name migrate_qemu \
> -boot strict=on \
> -monitor telnet:
> -device nec-usb-
> -device spapr-vscsi,
> -drive file=/var/
> -device virtio-
> -m 2048 \
> -smp 8,cores=
> -incoming rdma:0:43000
qemu-system-ppc64: -incoming rdma:0:43000: unknown migration protocol: rdma:0:43000
root@ltc-
ii ipxe-qemu 1.0.0+git-
ii qemu-block-
ii qemu-kvm 1:2.6.1+
ii qemu-slof 20160223+dfsg-1 all Slimline Open Firmware -- QEMU PowerPC version
ii qemu-system-common 1:2.6.1+
ii qemu-system-ppc 1:2.6.1+
ii qemu-utils 1:2.6.1+
I see there is no support built for RDMA from the QEMU build log for 16.10 @ https:/
RDMA support no
We need QEMU to be built with RDMA support
== Comment: #5 - Leonardo Augusto Guimaraes Garcia <email address hidden> - 2016-10-05 15:31:16 ==
Including Brian King here as I am not sure it will be possible to enable this feature in Ubuntu 17.04.
In order to build QEMU with RDMA support, we would need to have RDMA devel packages installed on the build machine. My understanding is that, for Ubuntu in general, IBM is going with MOFED drivers. However, in the environment Canonical is building QEMU, there is no MOFED, as MOFED is not a package supported by Canonical. If they build QEMU with RDMA support in their environment, it will probably not work with MOFED RDMA support. Could you please advise, Brian?
== Comment: #9 - James E. Sponaugle <email address hidden> - 2017-05-19 14:29:17 ==
Per discussion with Brian, moving this to 18.04.
tags: | added: architecture-ppc64le bugnameltc-146635 severity-medium targetmilestone-inin1804 |
Changed in ubuntu: | |
assignee: | nobody → Ubuntu on IBM Power Systems Bug Triage (ubuntu-power-triage) |
affects: | ubuntu → qemu (Ubuntu) |
Changed in ubuntu-power-systems: | |
assignee: | nobody → Canonical Server Team (canonical-server) |
tags: | added: ubuntu-18.04 |
tags: | added: p9-virt-stack |
tags: | removed: bugnameltc-146635 p9-virt-stack severity-medium ubuntu-18.04 |
Changed in ubuntu-power-systems: | |
status: | New → Incomplete |
tags: | added: p9-virt-stack-18.04 |
tags: |
added: ubuntu-18.04 removed: p9-virt-stack-18.04 |
Changed in qemu (Ubuntu): | |
importance: | Undecided → Medium |
Changed in ubuntu-power-systems: | |
importance: | Undecided → Medium |
tags: | added: triage-g |
Changed in qemu (Ubuntu): | |
assignee: | Ubuntu on IBM Power Systems Bug Triage (ubuntu-power-triage) → David Britton (davidpbritton) |
Changed in qemu (Ubuntu): | |
status: | Incomplete → In Progress |
assignee: | David Britton (davidpbritton) → ChristianEhrhardt (paelzer) |
Changed in ubuntu-power-systems: | |
status: | Incomplete → In Progress |
Changed in ubuntu-power-systems: | |
status: | In Progress → Fix Released |
tags: |
added: targetmilestone-inin1810 removed: targetmilestone-inin1804 |
tags: |
added: targetmilestone-inin1804 removed: targetmilestone-inin1810 |
Hi,
thank you for the info - from what I read I can only agree to:
"In order to build QEMU with RDMA support, we would need to have RDMA devel packages installed on the build machine. My understanding is that, for Ubuntu in general, IBM is going with MOFED drivers. However, in the environment Canonical is building QEMU, there is no MOFED, as MOFED is not a package supported by Canonical. If they build QEMU with RDMA support in their environment, it will probably not work with MOFED RDMA support."
I haven't checked what rdma dev lib your need in particular, but in general the assumption is correct we can and will only build against those packaged in the archive. www.openfabrics .org/
And that usually means what is published via http://
So what we can provide is (atm) libibverbs-dev at version 1.2.1-2ubuntu1 and librdmacm-dev at 1.1.0-2
Both are in main so no MIR will be needed to enable rdma.
Yet if you consider it useless since you want to drive it via MOFED there is no big reason to do so.
It is an ongoing issue of Openfabrics vs manufacturer libs, but if you think towards 18.04 you'll be good enabling and building this against the open libs (at that time) I still see no big reason why this should be Ubuntu only.
Especially since you target 18.04 (and not 17.10) timing should be ok. So I'd kindly ask you to open a bug with Debian to enable it and report the bug number there.