hyper-v: Hyper-V drivers missing from UEFI based installer

[Abhishek Gupta]

Hi folks,

We are unable to create Generation 2 VMs because Hyper-V drivers are missing from the UEFI based alternate installer for server builds. The ask is to include all hyper-v drivers in to the alternate server installer. Please see below bug for more details:

https://bugs.launchpad.net/bugs/1285434

I opened a new bug because wasn't sure if the above bug is still visible. Please help fix this as soon as possible as testing is blocked.

Thanks,
Abhishek

[Tim Gardner (timg-tpi)]

The only missing module that I can see is hv_balloon.

git grep hv_ debian.master/d-i/
debian.master/d-i/modules/virtio-modules:hv_vmbus ?
debian.master/d-i/modules/virtio-modules:hv_utils ?
debian.master/d-i/modules/virtio-modules:hv_netvsc ?
debian.master/d-i/modules/virtio-modules:hv_mouse ?
debian.master/d-i/modules/virtio-modules:hv_storvsc ?

grep hv_ debian.master/abi/3.13.0-17.37/amd64/generic.modules
hv_balloon
hv_netvsc
hv_storvsc
hv_utils
hv_vmbus

[Abhishek Gupta (abgupta)]

Hi Tim,

Thanks for checking. Two follow up questions:

a) How come these modules lister under virtio-modules? Shouldn't they be in some hyper-v specific folder?

b) Previously we were missing the keyboard driver as outlined in the bug:

https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1285434

From the notes in the above bug, it seems like Andy added the keyboard driver but not the other drivers. Are you sure you are looking at the right build? From what you are describing, it appears that all drivers except the keyboard driver are available.

As a side note, the keyboard driver is available here:

http://git.kernel.org/cgit/linux/kernel/git/next/linux-next.git/tree/drivers/input/serio/hyperv-keyboard.c?id=HEAD

Please let me know if you need more info.
Thanks,
Abhishek

[Andy Whitcroft (apw)]

The other bug was specifically about the keyboard not working and asking for a fix for that to be applied, which it was. We also added the hyperv_keyboard module to 'serial-modules'.

In answer to (a) the modules are grouped into categories specified by the installer, this is the closest match for your drivers. The installer is trying to be as thin as possible and so we have to specify all boot-essential devices as only those are included.

From what we know all of the hyperv related drivers have been slotted into those now (either virtio-modules or serial-modules), if it is not working there must be additional ones which need adding and we need to know which ones are boot essential in order to be able to add them.

[Abhishek Gupta (abgupta)]

Thanks Andy for the explanation. We are seeing that the desktop release can be booted in to generation 2 mode but the server release cannot. Every time I try to boot the server release, I get an error saying that it could not mount the ISO. Do you think, this could be happening due to a missing ata_piix driver? Please let me us know. In the meantime we will continue to triage it at our end.

Thanks,
Abhishek

[Abhishek Gupta (abgupta)]

Hi folks,

I confirm that the drivers are not present in the server builds located here: http://cdimage.ubuntu.com/ubuntu-server/daily/current/.

Please can you help find out the reason?

The drivers are there in the client builds. Our test guys confirmed this by opening up the initrd in the ISO. We see the following contents in the initrd:

abhishek@abhishek-Virtual-Machine:/tmp/content$ ls
bin etc initrd lib64 mnt run sys usr
dev init lib media proc sbin tmp var

abhishek@abhishek-Virtual-Machine:/tmp/content$ find . -name '*hv*'
./lib/modules/3.13.0-17-generic/kernel/drivers/hv
./lib/modules/3.13.0-17-generic/kernel/drivers/hv/hv_vmbus.ko

abhishek@abhishek-Virtual-Machine:/tmp/content$ find . -name '*hyperv*'
./lib/modules/3.13.0-17-generic/kernel/drivers/input/serio/hyperv-keyboard.ko

The remaining drivers that are needed are:

hv_utils
hv_mouse
hv_storvsc

Please let us know how we may help further.
Thanks,
Abhishek

[Andy Whitcroft (apw)]

Ok, this is occuring because the V2 VMs no longer have emulated hardware during early boot. This means we need the virtio-modules drivers on the CD for early boot. (The drivers identified above are on there as serial-modules are included.) Talking this through with the installer team it seems that the cdimage should include the virtio-modules. Task created for that.

[Launchpad Janitor (janitor)]

This bug was fixed in the package linux - 3.13.0-18.38

---------------
linux (3.13.0-18.38) trusty; urgency=low

  [ Tim Gardner ]

  * Release Tracking Bug
    - LP: #1293725
  * [Config] Add hv_balloon to d-i virtio-modules
    - LP: #1292216

  [ Andy Whitcroft ]

  * [Config] d-i -- add virtio_scsi to virtio-modules
    - LP: #1288607

  [ Colin Ian King ]

  * SAUCE: intel_pstate: inform user that thermald is worth considering

  [ dann frazier ]

  * [Config] arm64: KVM=y

  [ Gerd Hoffmann ]

  * SAUCE: vmbus: add missing breaks
    - LP: #1287398
  * SAUCE: vmbus: use resource for hyperv mmio region
    - LP: #1287398
  * SAUCE: hyperv-fb: add support for generation 2 virtual machines.
    - LP: #1287398
  * SAUCE: hyperv-fb: kick off efifb early
    - LP: #1287398

  [ Haiyang Zhang ]

  * SAUCE: hyperv: Change the receive buffer size for legacy hosts
    - LP: #1290151

  [ K. Y. Srinivasan ]

  * SAUCE: Drivers: hv: vmbus: Extract the mmio information from DSDT
    - LP: #1287398

  [ Paolo Pisati ]

  * SAUCE: leds-gpio: of: introduce MODULE_DEVICE_TABLE for module
    autoloading
  * [Config] amhf: LEDS_TRIGGER_HEARTBEAT=y

  [ Upstream Kernel Changes ]

  * Revert "xhci 1.0: Limit arbitrarily-aligned scatter gather."
    - LP: #1293361
  * Revert "USBNET: ax88179_178a: enable tso if usb host supports sg dma"
    - LP: #1293361
  * powerpc/tm: Fix crash when forking inside a transaction
  * AX88179_178A: Add VID:DID for Lenovo OneLinkDock Gigabit LAN
    - LP: #1291890
  * drm/vmwgfx: Fix a surface reference corner-case in legacy emulation
    mode
  * Input: wacom - scale up touch width and height values for Intuos Pro
  * Input: wacom - make sure touch_max is set for touch devices
  * Input: wacom - add support for three new Intuos devices
  * Input: wacom - add reporting of SW_MUTE_DEVICE events
  * Input: wacom - fix wacom->shared guards for dual input devices
  * Input: wacom - add support for DTU-1031
  * net: fix for a race condition in the inet frag code
    - CVE-2014-0100
  * net: sctp: fix sctp_sf_do_5_1D_ce to verify if we/peer is AUTH capable
    - CVE-2014-0101
  * KEYS: Make the keyring cycle detector ignore other keyrings of the same
    name
    - CVE-2014-0102
  * ipv6: don't set DST_NOCOUNT for remotely added routes
    - CVE-2014-2309
 -- Andy Whitcroft <email address hidden> Thu, 13 Mar 2014 10:06:05 +0000

[Launchpad Janitor (janitor)]

This bug was fixed in the package debian-installer - 20101020ubuntu307

---------------
debian-installer (20101020ubuntu307) trusty; urgency=medium

  * Add virtio-modules to all x86 flavours (LP: #1292216)
  * Move master kernels to 3.13.0-18.
 -- Adam Conrad <email address hidden> Mon, 17 Mar 2014 11:55:27 -0600