[INTEL 24.04 BUG] [VROC] Automatic OS installation crashes (raid _info object None, attempt to get size fails)

[Kinga Tanska]

Found with Ubuntu 24.04. Subiquity was updated before test.

Steps for reproduce:
1. Create RAID volume in PreOS:
e.g. VMD: #rcfgvroc /C:r5d3 /L:5 /DS:0x0 0x1 0x2 /SS:128
2. Prepare install configuration file and set installation on GPT partition.
3. Start OS installation using configuration file.
4. Wait for installation to finish.

Installation error occured:

2024-04-19 14:27:55,092 WARNING subiquity.server.controllers.mirror:173 Mirror checking failed
2024-04-19 14:28:09,719 WARNING subiquity.server.controllers.mirror:173 Mirror checking failed
2024-04-19 14:28:09,720 WARNING subiquity.server.controllers.mirror:242 reverting to an offline install since no primary mirror is usable
2024-04-19 14:28:09,732 INFO root:38 finish: subiquity/Meta/status_GET: SUCCESS: 200 {"state": "NEEDS_CONFIRMATION", "confirming_tty": "", "error": null, "nonrepo...
2024-04-19 14:28:09,733 INFO root:38 finish: subiquity/Meta/status_GET: SUCCESS: 200 {"state": "NEEDS_CONFIRMATION", "confirming_tty": "", "error": null, "nonrepo...
2024-04-19 14:28:09,733 INFO root:38 finish: subiquity/Meta/status_GET: SUCCESS: 200 {"state": "NEEDS_CONFIRMATION", "confirming_tty": "", "error": null, "nonrepo...
2024-04-19 14:28:09,734 INFO root:38 finish: subiquity/Meta/status_GET: SUCCESS: 200 {"state": "NEEDS_CONFIRMATION", "confirming_tty": "", "error": null, "nonrepo...
2024-04-19 14:28:09,737 INFO root:38 finish: subiquity/apply_autoinstall_config: SUCCESS:
2024-04-19 14:28:09,738 INFO root:38 start: subiquity/Install/install/configure_apt: configuring apt
2024-04-19 14:28:09,740 INFO root:38 start: subiquity/Meta/status_GET:
2024-04-19 14:28:09,741 INFO root:38 finish: subiquity/Meta/status_GET: SUCCESS: 200 {"state": "RUNNING", "confirming_tty": "", "error": null, "nonreportable_erro...
2024-04-19 14:28:09,742 INFO root:38 start: subiquity/Meta/status_GET:
2024-04-19 14:28:09,742 INFO root:38 finish: subiquity/Meta/status_GET: SUCCESS: 200 {"state": "RUNNING", "confirming_tty": "", "error": null, "nonreportable_erro...
2024-04-19 14:28:09,743 INFO root:38 start: subiquity/Meta/status_GET:
2024-04-19 14:28:09,744 INFO root:38 finish: subiquity/Meta/status_GET: SUCCESS: 200 {"state": "RUNNING", "confirming_tty": "", "error": null, "nonreportable_erro...
2024-04-19 14:28:09,744 INFO root:38 start: subiquity/Meta/status_GET:
2024-04-19 14:28:09,745 INFO root:38 finish: subiquity/Meta/status_GET: SUCCESS: 200 {"state": "RUNNING", "confirming_tty": "", "error": null, "nonreportable_erro...
2024-04-19 14:28:09,746 INFO root:38 start: subiquity/Meta/status_GET:
2024-04-19 14:28:09,746 INFO root:38 start: subiquity/Meta/status_GET:
2024-04-19 14:28:09,747 INFO root:38 start: subiquity/Meta/status_GET:
2024-04-19 14:28:09,748 INFO root:38 start: subiquity/Meta/status_GET:
2024-04-19 14:28:19,747 ERROR root:38 finish: subiquity/Mirror/waiting: FAIL:
2024-04-19 14:28:23,763 INFO root:38 finish: subiquity/Install/install/configure_apt: SUCCESS: configuring apt
2024-04-19 14:28:23,765 INFO root:38 start: subiquity/Install/install/curtin_install: installing system
2024-04-19 14:28:24,627 ERROR root:38 finish: subiquity/Install/install/curtin_install: FAIL: 'NoneType' object has no attribute 'size'
2024-04-19 14:28:24,635 INFO subiquity.common.errorreport:424 saving crash report 'install failed crashed with AttributeError' to /var/crash/1713536904.627682924.install_fail.crash
2024-04-19 14:28:24,635 ERROR root:38 finish: subiquity/Install/install: FAIL: 'NoneType' object has no attribute 'size'
2024-04-19 14:28:24,636 INFO root:38 start: subiquity/ErrorReporter/1713536904.627682924.install_fail/add_info:
2024-04-19 14:28:24,636 ERROR subiquity.server.server:494 top level error
Traceback (most recent call last):
  File "/snap/subiquity/5741/lib/python3.10/site-packages/subiquity/server/controllers/shutdown.py", line 73, in _wait_install
    await self.app.controllers.Install.install_task
AttributeError: 'NoneType' object has no attribute 'size'
2024-04-19 14:28:24,637 ERROR subiquity.server.server:494 top level error
Traceback (most recent call last):
  File "/snap/subiquity/5741/lib/python3.10/site-packages/subiquity/server/controllers/shutdown.py", line 73, in _wait_install
    await self.app.controllers.Install.install_task
AttributeError: 'NoneType' object has no attribute 'size'
2024-04-19 14:28:32,924 INFO root:38 finish: subiquity/ErrorReporter/1713536904.627682924.install_fail/add_info: SUCCESS: written to /var/crash/1713536904.627682924.install_fail.crash
2024-04-19 14:28:32,926 INFO root:38 finish: subiquity/Meta/status_GET: SUCCESS: 200 {"state": "ERROR", "confirming_tty": "", "error": {"state": "DONE", "base": "...
2024-04-19 14:28:32,927 INFO root:38 finish: subiquity/Meta/status_GET: SUCCESS: 200 {"state": "ERROR", "confirming_tty": "", "error": {"state": "DONE", "base": "...
2024-04-19 14:28:32,928 INFO root:38 finish: subiquity/Meta/status_GET: SUCCESS: 200 {"state": "ERROR", "confirming_tty": "", "error": {"state": "DONE", "base": "...
2024-04-19 14:28:32,929 INFO root:38 finish: subiquity/Meta/status_GET: SUCCESS: 200 {"state": "ERROR", "confirming_tty": "", "error": {"state": "DONE", "base": "...
2024-04-19 14:31:49,101 WARNING subiquity.server.geoip:113 geoip lookup failed: ClientConnectorError(ConnectionKey(host='geoip.ubuntu.com', port=443, is_ssl=True, ssl=None, proxy=None, proxy_auth=None, proxy_headers_hash=None), TimeoutError(110, "Connect call failed ('185.125.188.133', 443)"))

[Kinga Tanska (ktanska)]

Hi

do you have any update? Has anybody analyzed this issue?

[Kinga Tanska (ktanska)]

Hi,

can somebody look at this issue, please?

[Kinga Tanska (ktanska)]

Hi Michael Hudson-Doyle

could you help me with this one, please?

[Dan Bungert (dbungert)]

Hi there, thanks for the bug report.

Please supply the autoinstall in question.

[Kinga Tanska (ktanska)]

Hi

is that a file, which you expected?

autoinstall:
  user-data:
    disable_root: false
  identity:
    hostname: ubuntu-server
    username: ubuntu
  locale: en_US
  early-commands:
    - echo `ls -la /dev/md/r1d2_A* | grep -Eo -m 1 "md[0-9]+"` > /tmp/volume_md_name
    - sed -i -e "s/<VOLUME_MD_NAME>/$(cat /tmp/volume_md_name)/g" /autoinstall.yaml
    - mdadm --detail /dev/md/r1d2_A* | grep -Po "\/dev\/md\/\K.+?(?=,)" > /tmp/container_name
    - ls -la /dev/md/$(cat /tmp/container_name) | grep -Po -m 1 "md[0-9]+" > /tmp/container_md_name
    - sed -i -e "s/<CONTAINER_MD_NAME>/$(cat /tmp/container_md_name)/g" /autoinstall.yaml
    - mdadm --detail /dev/`cat /tmp/volume_md_name` | grep -o -E "\/dev\/sd[a-z]+|\/dev\/nvme.*" > /tmp/disks
    - index=0;for i in `cat /tmp/disks`; do echo $index ; toreplace="<DISK_SERIAL_$index>"; replacement=`udevadm info $i | grep -Po 'ID_SERIAL=\K.*'`; sed -i "s/$toreplace/$replacement/" /autoinstall.yaml; index=$(($index+1)) ; done
  #Ubuntu 22 does not throw any installation logs on screen/ssh. This workaround is needed to tracking installation progress.
    - sleep 20
    - tail -f /var/log/syslog > /dev/pts/0 &
  ssh:
    install-server: true
  kernel:
    package: linux-generic
  storage:
    grub:
      reorder_uefi: false
      update_nvram: false
    config:
    - id: disk-0
      serial: <DISK_SERIAL_0>
      type: disk
      grub_device: false
      preserve: true
    - id: disk-1
      serial: <DISK_SERIAL_1>
      type: disk
      grub_device: false
      preserve: true

    - id: container
      name: <CONTAINER_MD_NAME>
      raidlevel: container
      type: raid
      preserve: true
      metadata: imsm
      spare_devices: []
      devices:
      - disk-0
      - disk-1

    - id: volume
      name: <VOLUME_MD_NAME>
      raidlevel: raid1
      type: raid
      preserve: true
      container: container
      devices: []
      spare_devices: []
      ptable: gpt
      wipe: superblock-recursive

    - id: partition-0
      device: volume
      size: 512M
      type: partition
      flag: boot
      grub_device: true
    - id: format-0
      fstype: fat32
      volume: partition-0
      type: format
    - id: mount-0
      path: /boot/efi
      device: format-0
      type: mount

    - id: partition-1
      device: volume
      size: 512M
      type: partition
    - id: format-1
      fstype: ext4
      volume: partition-1
      type: format
    - id: mount-1
      path: /boot
      device: format-1
      type: mount

    - id: partition-2
      device: volume
      size: 10240M
      type: partition
    - id: format-2
      fstype: ext4
      volume: partition-2
      type: format
    - id: mount-2
      path: /
      device: format-2
      type: mount

    - id: partition-3
      device: volume
      size: 1024M
      type: partition
    - id: format-3
      fstype: swap
      volume: partition-3
      type: format
    - id: mount-3
      path: swap
      device: format-3
      type: mount

    version: 1
  late-commands:
    - curtin in-target --target=/target -- sudo usermod -p '$6$/z8uQTlEllCWu1C$85HPfQx5DkltE4Nx1nWJbB.VsXqEt8py0Nap4N3xhsHUs2kvroN/mfEkKCg...