[VROC] Installation on RAID volume fails - ubuntu 22.04

[Kinga Tanska]

Installation on RAID volume created in uefi fails with error "ValueError: devices or container for raid must be specified". Syslog contains error log with curtin:

Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: start: cmd-install/stage-partitioning/builtin/cmd-block-meta: configuring raid: raid-md127
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: An error occured handling 'raid-md127': ValueError - devices or container for raid must be specified
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: finish: cmd-install/stage-partitioning/builtin/cmd-block-meta: FAIL: configuring raid: raid-md127
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: TIMED BLOCK_META: 0.647
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: finish: cmd-install/stage-partitioning/builtin/cmd-block-meta: FAIL: curtin command block-meta
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: Traceback (most recent call last):
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: File "/snap/subiquity/2974/lib/python3.8/site-packages/curtin/commands/main.py", line 202, in main
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: ret = args.func(args)
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: File "/snap/subiquity/2974/lib/python3.8/site-packages/curtin/log.py", line 97, in wrapper
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: return log_time("TIMED %s: " % msg, func, *args, **kwargs)
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: File "/snap/subiquity/2974/lib/python3.8/site-packages/curtin/log.py", line 79, in log_time
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: return func(*args, **kwargs)
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: File "/snap/subiquity/2974/lib/python3.8/site-packages/curtin/commands/block_meta.py", line 117, in block_meta
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: return meta_custom(args)
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: File "/snap/subiquity/2974/lib/python3.8/site-packages/curtin/commands/block_meta.py", line 2024, in meta_custom
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: handler(command, storage_config_dict)
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: File "/snap/subiquity/2974/lib/python3.8/site-packages/curtin/commands/block_meta.py", line 1586, in raid_handler
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: raise ValueError("devices or container for raid must be specified")
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: ValueError: devices or container for raid must be specified
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: devices or container for raid must be specified
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: builtin command failed
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: finish: cmd-install/stage-partitioning/builtin: FAIL: running 'curtin block-meta simple'
Jan 20 08:58:16 ubuntu-server curtin_event.4517.3[4968]: finish: cmd-install/stage-partitioning/builtin: FAIL: running 'curtin block-meta simple'
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: builtin took 1.288 seconds
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: stage_partitioning took 1.289 seconds
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: finish: cmd-install/stage-partitioning: FAIL: configuring storage
Jan 20 08:58:16 ubuntu-server curtin_event.4517.3[4968]: finish: cmd-install/stage-partitioning: FAIL: configuring storage
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: curtin: Installation failed with exception: Unexpected error while running command.
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: Command: ['curtin', 'block-meta', 'simple']
Jan 20 08:58:16 ubuntu-server subiquity_log.4517[4968]: Exit code: 3

[Jeff Lane  (bladernr)]

Two questions:

1: Just to confirm, you're seeing this on the 22.04 daily images?

2: does this also happen on 20.04?

[Michael Hudson-Doyle (mwhudson)]

This looks like https://bugs.launchpad.net/ubuntu/+source/linux/+bug/1960392. I don't really know what's going on there so perhaps this doesn't help very much...

[Jeff Lane  (bladernr)]

Hahah, that's the one I just marked as a duplicate of this one :D

[Michael Hudson-Doyle (mwhudson)]

Can you try booting with udev.log_level=debug on the kernel command line and attach the journal?

[shangsong (shangsong2)]

Hi Jeff,
  1: Just to confirm, you're seeing this on the 22.04 daily images?
  --> Yes
  2: does this also happen on 20.04?
  -->The latest 20.04 daily build can finish the installation successfully.

[Michael Hudson-Doyle (mwhudson)]

Oh, it looks like this is caused by this upstream mdadm change: https://git.kernel.org/pub/scm/utils/mdadm/mdadm.git/commit/?id=1a52f1fc0266d438c996789d4addbfac999a6139.

I guess the installer can't rely on udev for array memebership information and will have to run mdadm --detail or similar itself.

[Jeff Lane  (bladernr)]

hrmm so is the fix here then an update to subiquity to change how it gets array data? or is there a reversion or change needed for madam instead?

[Michael Hudson-Doyle (mwhudson)]

I think we should change the installer but I haven't thought about what that means in detail!

[Michael Hudson-Doyle (mwhudson)]

https://github.com/canonical/probert/pull/110 should fix this. I'll try to make an ISO including that change for testing.

[Michael Hudson-Doyle (mwhudson)]

Hi this should be fixed in edge now, can you try that? https://discourse.ubuntu.com/t/how-to-test-the-latest-version-of-subiquity/12428

[Kinga Tanska (ktanska)]

Issue does not occur with latest version of subiquity. Please let me know, in which Ubuntu daily build, fix will be included.

[Michael Hudson-Doyle (mwhudson)]

I'm not sure but it will definitely be before 22.04 is released. (This bug only affects installs of 22.04 I think?)

[Kinga Tanska (ktanska)]

Yes, it affects only 22.04.
OK, I will check some of the builds, but if you will have any information about date, please let me know.

[Michael Hudson-Doyle (mwhudson)]

Will do. Thanks for testing!