Comment 6 for bug 2049516

After some more testing, I think I found the culprit: it's the updated installer.
With the original installer provided by the iso file, it works as you described without any weirdness.

But my yaml also contained this:
  refresh-installer:
    update: true

Once you add that to your yaml, you will see that window.