Openstack Training Labs Rocky does not work because Virtualbox 6 problem

[Yannick LE NY]

Hello,

After created VM controller, Attaching to VM controller (multi): .../labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi does not work and the node controller IS NOT created.

Software components :
* Openstack Training Labs Rocky (August 2018) (Rocky For Linux here : https://docs.openstack.org/training_labs/ )
* Mageia 7 beta 2 linux distro with all the updates ( https://www.mageia.org/en/ )
* Virtualbox 6.0.4
* ssh : OpenSSH_7.9p1, OpenSSL 1.1.0j
* iso file used by Openstack Training Labs Rocky : ubuntu-18.04.1-server-amd64.iso

I have the following errors :

In the console output with debug mode enabled :

D15:13:12 21985 INFO Start autostart/07_shutdown.sh
15:13:12 21985 DEBUG vm_ssh: ssh -q -i /home/user/OpenStack-lab/labs/lib/osbash-ssh-keys/osbash_key -o UserKnownHostsFile=/dev/null -o StrictHostKeyChecking=no -o ConnectTimeout=10 -o ControlPath=none -p 2229 osbash@127.0.0.1 bash autostart/07_shutdown.sh && rm -vf autostart/07_shutdown.sh
15:13:12 21985 DEBUG Writing live log for ssh call at /home/user/OpenStack-lab/labs/log/007_07_shutdown.auto.
DD15:13:15 21985 INFO done
15:13:15 12705 INFO Processing of scripts successful.
15:13:15 12705 DEBUG sshp exit code: 0
15:13:15 12705 INFO Waiting for shutdown of VM base.
15:13:16 12705 DEBUG get_vm_vmstate: poweroff
15:13:16 12705 DEBUG vm_is_shut_down: ;poweroff;
15:13:16 12705 INFO Machine powered off.
15:13:16 12705 INFO Detaching disk from VM base.
15:13:17 12705 INFO Unregistering and deleting VM: base
15:13:17 12705 INFO Compacting /home/user/OpenStack-lab/labs/img/tmp-disk.vdi.
15:13:20 12705 INFO Unregistering disk

15:13:20 12705 INFO Base disk created.
15:13:20 12705 INFO Moving base disk to:

15:13:20 12705 INFO Base disk build ends.
15:13:20 12705 INFO Basedisk build took 930 seconds
15:13:20 12705 INFO Creating mgmt network: 10.0.0.0.
15:13:21 12705 INFO Creating host-only interface.
15:13:21 12705 INFO Configuring host-only network mgmt with gw address 10.0.0.1 (vboxnet0).
15:13:22 12705 INFO Creating provider network: 203.0.113.0.
15:13:22 12705 INFO Creating host-only interface.
15:13:22 12705 INFO Configuring host-only network provider with gw address 203.0.113.1 (vboxnet1).
15:13:22 12705 DEBUG Resetting autostart directories.
15:13:22 12705 DEBUG Port forwarding ssh: 2230
15:13:22 12705 DEBUG Port forwarding http: 8888
15:13:22 12705 DEBUG Disks: base
15:13:22 12705 DEBUG <VMconfig: vm_name='controller' disks=['base', None, None] ssh_ip='127.0.0.1' ssh_port='2230' http_port='8888' vm_mem='5120' vm_cpus=1 net_ifs=[{'typ': 'dhcp', 'prio': 0}, {'ip': '10.0.0.11', 'typ': 'static', 'prio': '1'}, {'ip': '203.0.113.0', 'typ': 'manual', 'prio': 0}]>
15:13:22 12705 INFO Asked to delete VM controller
15:13:22 12705 INFO not found

15:13:23 12705 INFO Created VM controller.

15:13:24 12705 WARNING VBoxManage call failed.
15:13:24 12705 WARNING VBoxManage modifyhd --type multiattach /home/user/OpenStack-lab/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi
15:13:24 12705 WARNING call_args: ['VBoxManage', 'modifyhd', '--type', 'multiattach', '/home/user/OpenStack-lab/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi']
15:13:24 12705 WARNING rc: 1
15:13:24 12705 WARNING output:
VBoxManage: error: Cannot change type for medium '/home/user/OpenStack-lab/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi': the media type 'MultiAttach' can only be used on media registered with a machine that was created with VirtualBox 4.0 or later
VBoxManage: error: Details: code VBOX_E_INVALID_OBJECT_STATE (0x80bb0007), component MediumWrap, interface IMedium, callee nsISupports
VBoxManage: error: Context: "COMSETTER(Type)(enmMediumType)" at line 727 of file VBoxManageDisk.cpp

15:13:24 12705 ERROR Exception
Traceback (most recent call last):
  File "/home/user/OpenStack-lab/labs/stacktrain/virtualbox/vm_create.py", line 73, in vbm
    output = subprocess.check_output(call_args, stderr=errout)
  File "/usr/lib64/python2.7/subprocess.py", line 223, in check_output
    raise CalledProcessError(retcode, cmd, output=output)
CalledProcessError: Command '['VBoxManage', 'modifyhd', '--type', 'multiattach', '/home/user/OpenStack-lab/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi']' returned non-zero exit status 1

15:13:24 12705 WARNING --------------------------------------------------
Traceback (most recent call last):
  File "/home/user/OpenStack-lab/labs/stacktrain/virtualbox/vm_create.py", line 73, in vbm
    output = subprocess.check_output(call_args, stderr=errout)
  File "/usr/lib64/python2.7/subprocess.py", line 223, in check_output
    raise CalledProcessError(retcode, cmd, output=output)
CalledProcessError: Command '['VBoxManage', 'modifyhd', '--type', 'multiattach', '/home/user/OpenStack-lab/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi']' returned non-zero exit status 1

[user@localhost labs]$

Can you fix this problem ?

A problem with the new Virtualbox 6.0.4 ?
With Virtualbox 5.2.22 and Mageia 6, Openstack Training Labs Rocky works well.

Thank you.

[Micheal Benzel (tictoc)]

I have the same issue on RHEL 3.10.0-957.12.1.el7.x86_64 AND virtualbox 6.0.0 thru 6.0.6 on both Rocky and Queens.

INFO Created VM controller.
WARNING VBoxManage call failed.
WARNING VBoxManage modifyhd --type multiattach /home/tictoc/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi
WARNING call_args: ['VBoxManage', 'modifyhd', '--type', 'multiattach', '/home/tictoc/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi']
WARNING rc: 1
WARNING output:
VBoxManage: error: Cannot change type for medium '/home/tictoc/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi': the media type 'MultiAttach' can only be used on media registered with a machine that was created with VirtualBox 4.0 or later
VBoxManage: error: Details: code VBOX_E_INVALID_OBJECT_STATE (0x80bb0007), component MediumWrap, interface IMedium, callee nsISupports
VBoxManage: error: Context: "COMSETTER(Type)(enmMediumType)" at line 727 of file VBoxManageDisk.cpp

ERROR Exception
Traceback (most recent call last):
  File "/home/tictoc/labs/stacktrain/virtualbox/vm_create.py", line 73, in vbm
    output = subprocess.check_output(call_args, stderr=errout)
  File "/usr/lib64/python2.7/subprocess.py", line 575, in check_output
    raise CalledProcessError(retcode, cmd, output=output)
CalledProcessError: Command '['VBoxManage', 'modifyhd', '--type', 'multiattach', '/home/tictoc/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi']' returned non-zero exit status 1
WARNING --------------------------------------------------
Traceback (most recent call last):
  File "/home/tictoc/labs/stacktrain/virtualbox/vm_create.py", line 73, in vbm
    output = subprocess.check_output(call_args, stderr=errout)
  File "/usr/lib64/python2.7/subprocess.py", line 575, in check_output
    raise CalledProcessError(retcode, cmd, output=output)
CalledProcessError: Command '['VBoxManage', 'modifyhd', '--type', 'multiattach', '/home/tictoc/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi']' returned non-zero exit status 1

Works on my MACBook Pro with an older VirtualBox though

[saurabh (saurabh683)]

Facing same issue with mac pro and virtual box 6...do i downgrade virtual box ..which version?

INFO Created VM controller.
WARNING VBoxManage call failed.
WARNING VBoxManage modifyhd --type multiattach /Users/saurabh/Downloads/training-labs/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi
WARNING call_args: ['VBoxManage', 'modifyhd', '--type', 'multiattach', '/Users/saurabh/Downloads/training-labs/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi']
WARNING rc: 1
WARNING output:
VBoxManage: error: Cannot change type for medium '/Users/saurabh/Downloads/training-labs/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi': the media type 'MultiAttach' can only be used on media registered with a machine that was created with VirtualBox 4.0 or later
VBoxManage: error: Details: code VBOX_E_INVALID_OBJECT_STATE (0x80bb0007), component MediumWrap, interface IMedium, callee nsISupports
VBoxManage: error: Context: "COMSETTER(Type)(enmMediumType)" at line 727 of file VBoxManageDisk.cpp

ERROR Exception
Traceback (most recent call last):
  File "/Users/saurabh/Downloads/training-labs/labs/stacktrain/virtualbox/vm_create.py", line 73, in vbm
    output = subprocess.check_output(call_args, stderr=errout)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 573, in check_output
    raise CalledProcessError(retcode, cmd, output=output)
CalledProcessError: Command '['VBoxManage', 'modifyhd', '--type', 'multiattach', '/Users/saurabh/Downloads/training-labs/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi']' returned non-zero exit status 1
WARNING --------------------------------------------------
Traceback (most recent call last):
  File "/Users/saurabh/Downloads/training-labs/labs/stacktrain/virtualbox/vm_create.py", line 73, in vbm
    output = subprocess.check_output(call_args, stderr=errout)
  File "/System/Library/Frameworks/Python.framework/Versions/2.7/lib/python2.7/subprocess.py", line 573, in check_output
    raise CalledProcessError(retcode, cmd, output=output)
CalledProcessError: Command '['VBoxManage', 'modifyhd', '--type', 'multiattach', '/Users/saurabh/Downloads/training-labs/labs/img/base-ssh-rocky-ubuntu-18.04-amd64.vdi']' returned non-zero exit status 1

[saurabh (saurabh683)]

this helped to resolve the issue

https://stackoverflow.com/questions/56036691/how-to-create-a-differencing-multi-attach-disk-in-virtualbox

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/659942
Committed: https://git.openstack.org/cgit/openstack/training-labs/commit/?id=e4dec38469acdac6f9e408ac8612e709405cd998
Submitter: Zuul
Branch: master

commit e4dec38469acdac6f9e408ac8612e709405cd998
Author: Roger Luethi <email address hidden>
Date: Mon May 13 08:54:24 2019 +0200

    Fix disk multiattach with VirtualBox 6

    Starting with version 6.0, the behavior of VirtualBox with regards to
    disk multiattach changed.

    The result are error messages like:
      VBoxManage: error: Cannot change type for medium '<base_disk_path>':
      the media type 'MultiAttach' can only be used on media registered
      with a machine that was created with VirtualBox 4.0 or later

    The new code should work for both VirtualBox 6 and older versions.

    The workaround suggests that we may not be using the VirtualBox volumes
    the way they are meant to be used, but with scant documentation out
    there rewriting the volume logic may result in no improvement at all,
    so let's leave it at that for the time being.

    backport: rocky queens pike ocata

    Closes-Bug: 1817584

    Change-Id: I9307d2e0f077539c118f540a9b0a4358e4f3b459

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/rocky
Review: https://review.opendev.org/661430

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/queens
Review: https://review.opendev.org/661431

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/ocata
Review: https://review.opendev.org/661432

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/pike
Review: https://review.opendev.org/661433

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/661433
Committed: https://git.openstack.org/cgit/openstack/training-labs/commit/?id=70eee13c86a01a869d845aa13fe21f2b686781f0
Submitter: Zuul
Branch: stable/pike

commit 70eee13c86a01a869d845aa13fe21f2b686781f0
Author: Roger Luethi <email address hidden>
Date: Mon May 13 08:54:24 2019 +0200

    Fix disk multiattach with VirtualBox 6

    Starting with version 6.0, the behavior of VirtualBox with regards to
    disk multiattach changed.

    The result are error messages like:
      VBoxManage: error: Cannot change type for medium '<base_disk_path>':
      the media type 'MultiAttach' can only be used on media registered
      with a machine that was created with VirtualBox 4.0 or later

    The new code should work for both VirtualBox 6 and older versions.

    The workaround suggests that we may not be using the VirtualBox volumes
    the way they are meant to be used, but with scant documentation out
    there rewriting the volume logic may result in no improvement at all,
    so let's leave it at that for the time being.

    backport: rocky queens pike ocata

    Closes-Bug: 1817584

    Change-Id: I9307d2e0f077539c118f540a9b0a4358e4f3b459
    (cherry picked from commit e4dec38469acdac6f9e408ac8612e709405cd998)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/661430
Committed: https://git.openstack.org/cgit/openstack/training-labs/commit/?id=4375f502985514c3ebea48a3f6bd376045111a4f
Submitter: Zuul
Branch: stable/rocky

commit 4375f502985514c3ebea48a3f6bd376045111a4f
Author: Roger Luethi <email address hidden>
Date: Mon May 13 08:54:24 2019 +0200

    Fix disk multiattach with VirtualBox 6

    Starting with version 6.0, the behavior of VirtualBox with regards to
    disk multiattach changed.

    The result are error messages like:
      VBoxManage: error: Cannot change type for medium '<base_disk_path>':
      the media type 'MultiAttach' can only be used on media registered
      with a machine that was created with VirtualBox 4.0 or later

    The new code should work for both VirtualBox 6 and older versions.

    The workaround suggests that we may not be using the VirtualBox volumes
    the way they are meant to be used, but with scant documentation out
    there rewriting the volume logic may result in no improvement at all,
    so let's leave it at that for the time being.

    backport: rocky queens pike ocata

    Closes-Bug: 1817584

    Change-Id: I9307d2e0f077539c118f540a9b0a4358e4f3b459
    (cherry picked from commit e4dec38469acdac6f9e408ac8612e709405cd998)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/661432
Committed: https://git.openstack.org/cgit/openstack/training-labs/commit/?id=0d8de0f81fb8e5aa0d5b3500670e434c39a80f20
Submitter: Zuul
Branch: stable/ocata

commit 0d8de0f81fb8e5aa0d5b3500670e434c39a80f20
Author: Roger Luethi <email address hidden>
Date: Mon May 13 08:54:24 2019 +0200

    Fix disk multiattach with VirtualBox 6

    Starting with version 6.0, the behavior of VirtualBox with regards to
    disk multiattach changed.

    The result are error messages like:
      VBoxManage: error: Cannot change type for medium '<base_disk_path>':
      the media type 'MultiAttach' can only be used on media registered
      with a machine that was created with VirtualBox 4.0 or later

    The new code should work for both VirtualBox 6 and older versions.

    The workaround suggests that we may not be using the VirtualBox volumes
    the way they are meant to be used, but with scant documentation out
    there rewriting the volume logic may result in no improvement at all,
    so let's leave it at that for the time being.

    backport: rocky queens pike ocata

    Closes-Bug: 1817584

    Change-Id: I9307d2e0f077539c118f540a9b0a4358e4f3b459
    (cherry picked from commit e4dec38469acdac6f9e408ac8612e709405cd998)

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.opendev.org/661431
Committed: https://git.openstack.org/cgit/openstack/training-labs/commit/?id=e246560caba3237fd11aa0e992d434a04be4ba1a
Submitter: Zuul
Branch: stable/queens

commit e246560caba3237fd11aa0e992d434a04be4ba1a
Author: Roger Luethi <email address hidden>
Date: Mon May 13 08:54:24 2019 +0200

    Fix disk multiattach with VirtualBox 6

    Starting with version 6.0, the behavior of VirtualBox with regards to
    disk multiattach changed.

    The result are error messages like:
      VBoxManage: error: Cannot change type for medium '<base_disk_path>':
      the media type 'MultiAttach' can only be used on media registered
      with a machine that was created with VirtualBox 4.0 or later

    The new code should work for both VirtualBox 6 and older versions.

    The workaround suggests that we may not be using the VirtualBox volumes
    the way they are meant to be used, but with scant documentation out
    there rewriting the volume logic may result in no improvement at all,
    so let's leave it at that for the time being.

    backport: rocky queens pike ocata

    Closes-Bug: 1817584

    Change-Id: I9307d2e0f077539c118f540a9b0a4358e4f3b459
    (cherry picked from commit e4dec38469acdac6f9e408ac8612e709405cd998)