No slave-nodes available after MOS installation using virtualbox scripts

Bug #1525967 reported by Ekaterina Shutova
12
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
Critical
Dmitry Bilunov

Bug Description

MOS installation using virtualbox scripts
ISO: 284, 291
VB scripts: latest master
server:

1) Install latest VB scripts on server
2) Copy ISO to iso folser
3) Update config.sh with:

elif [ "$CONFIG_FOR" = "8GB" ]; then
  vm_slave_memory_default=4096

  vm_slave_memory_mb[1]=10240
  vm_slave_memory_mb[2]=10240
  vm_slave_memory_mb[3]=10240
...
headless=1
skipfuelmenu="yes"

4) Run ./launch_8GB.sh

Expected behaviour:

Slave nodes are up and available for deploying.

Got next output:
Waiting for VM "fuel-master" to power on...
VM "fuel-master" has been successfully started.
Waiting for product VM to install. Please do NOT abort the script...
Checking for internet connectivity on the host system... OK
Checking local DNS configuration... ./functions/product.sh: line 156: [: too many arguments
OK
Enabling outbound network/internet access for the product VM...
Waiting until the network services are restarted...
FAIL
############################################################
# WARNING: some of the Fuel features will not be supported #
# because there is no Internet connectivity #
############################################################

Master node has been installed.
...

Slave nodes have been created. They will boot over PXE and get discovered by the master node.
To access master node, please point your browser to:
    http://10.20.0.2:8000/
The default username and password is admin:admin

But no nodes are available for deploying:

[root@fuel ~]# fuel nodes
id | status | name | cluster | ip | mac | roles | pending_roles | online | group_id
---|--------|------|---------|----|-----|-------|---------------|--------|---------

Revision history for this message
Ekaterina Shutova (eshutova) wrote :
tags: added: vbox-scripts
Revision history for this message
Evgeny Sikachev (esikachev) wrote :

i reproduce this bug on mos-components-ci scripts. ISO 291-295

Changed in fuel:
milestone: none → 8.0
assignee: nobody → Fuel Library Team (fuel-library)
importance: Undecided → High
status: New → Confirmed
Dmitry Pyzhov (dpyzhov)
tags: added: area-library
Revision history for this message
Maksim Malchuk (mmalchuk) wrote :

I reproduced this bug too, it appears after 'renaming interfaces' commit was merged.

1. Оn the Fuel master configured only first ethernet adapter, node don't have default route and don't have MASQUERADE rule.

2. All slaves in boot loader interactive mode where bootstrap should be chosen.

Changed in fuel:
importance: High → Critical
Changed in fuel:
assignee: Fuel Library Team (fuel-library) → Dmitry Bilunov (dbilunov)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (master)

Fix proposed to branch: master
Review: https://review.openstack.org/258549

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.openstack.org/258568

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-main (master)

Reviewed: https://review.openstack.org/259052
Committed: https://git.openstack.org/cgit/openstack/fuel-main/commit/?id=699db1f3d92db01f1e6284aaf4ffb7c62f93b2db
Submitter: Jenkins
Branch: master

commit 699db1f3d92db01f1e6284aaf4ffb7c62f93b2db
Author: Dmitry Bilunov <email address hidden>
Date: Thu Dec 17 17:44:05 2015 +0300

    Fix network connectivity issues

    Master node needs an outbound internet connection to download repository
    metadata during admin node bootstrap process. We need to wait until it
    starts building docker containers, then enable the connection and wait
    until the bootstrap process completes.

    Partial-Bug: 1525967
    Change-Id: I0ca296cb5f727d2b6a5708355956c30e4ccf283b

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Reviewed: https://review.openstack.org/258549
Committed: https://git.openstack.org/cgit/openstack/fuel-main/commit/?id=79665761a710d8ff1602286fed449047d00f8f3a
Submitter: Jenkins
Branch: master

commit 79665761a710d8ff1602286fed449047d00f8f3a
Author: Dmitry Bilunov <email address hidden>
Date: Wed Dec 16 17:37:52 2015 +0300

    Do not hardcode scancodes that change isolinux boot params

    We have a "skipfuelmenu" variable in virtualbox scripts, which allows to
    skip "fuelmenu" step during the installation procedure. This option is
    enabled by default.

    Currently, we have a hardcoded variable $boot_line, which contains scan
    codes, passed by VirtualBox into isolinux on an emulated keyboard.

    We should generate these scancodes from a user specified line instead of
    hardcoding them.

    Partial-Bug: 1525967
    Change-Id: Ia2419b5e2eaa4b30cd2876112d7c080abbebcba5

tags: added: team-bugfix
Revision history for this message
Maksim Malchuk (mmalchuk) wrote :

I think this bug should be closed as 'Fix Committed', all merged fixes already solves an issue.
There is no need to merge the last fix because predictable interface names not used in VirtualBox deploy right now.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (master)

Fix proposed to branch: master
Review: https://review.openstack.org/262167

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: master
Review: https://review.openstack.org/262168

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-main (master)

Reviewed: https://review.openstack.org/262168
Committed: https://git.openstack.org/cgit/openstack/fuel-main/commit/?id=cf5e98161297072677211e890a8d7eaafae45087
Submitter: Jenkins
Branch: master

commit cf5e98161297072677211e890a8d7eaafae45087
Author: Dmitry Bilunov <email address hidden>
Date: Tue Dec 29 12:08:13 2015 +0300

    Fix network connectivity issues

    Master node needs an outbound internet connection to download repository
    metadata during admin node bootstrap process. We need to wait until it
    starts building docker containers, then enable the connection and wait
    until the bootstrap process completes.

    This change depends on another patch, which makes 'dockerctl build all'
    much more verbose (https://review.openstack.org/#/c/261062/36).

    Change-Id: Ibcc50bb47bd95dc1675aaf1abddbac375a434e2a
    Depends-On: I77a1d3a32633390c1fe37bbeb81da5d0996972df
    Closes-Bug: 1525967

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Reviewed: https://review.openstack.org/262167
Committed: https://git.openstack.org/cgit/openstack/fuel-main/commit/?id=e8abfee12c85fbcb11a0688dad59872071542202
Submitter: Jenkins
Branch: master

commit e8abfee12c85fbcb11a0688dad59872071542202
Author: Dmitry Bilunov <email address hidden>
Date: Tue Dec 29 12:19:32 2015 +0300

    Update dependency checks

    VirtualBox scripts rely on various utilities to function. To validate
    the environment, virtualbox/prepare-environment.sh checks if all these
    utilities are available to the shell. However, some of the checks
    (namely xxd and ssh) were missing. This change should fix this by
    aborting the prepare step in case if these utilities are not found.

    Change-Id: Ic49c11054345964c9785e9c4c791ea33dba4791c
    Partial-Bug: 1525967

tags: added: on-verification
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (stable/8.0)

Fix proposed to branch: stable/8.0
Review: https://review.openstack.org/269600

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Fix proposed to branch: stable/8.0
Review: https://review.openstack.org/269601

tags: removed: on-verification
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-main (stable/8.0)

Reviewed: https://review.openstack.org/269601
Committed: https://git.openstack.org/cgit/openstack/fuel-main/commit/?id=f973db051f1b2731a2d125fba43602ae4f66a295
Submitter: Jenkins
Branch: stable/8.0

commit f973db051f1b2731a2d125fba43602ae4f66a295
Author: Dmitry Bilunov <email address hidden>
Date: Tue Dec 29 12:08:13 2015 +0300

    Fix network connectivity issues

    Master node needs an outbound internet connection to download repository
    metadata during admin node bootstrap process. We need to wait until it
    starts building docker containers, then enable the connection and wait
    until the bootstrap process completes.

    This change depends on another patch, which makes 'dockerctl build all'
    much more verbose (https://review.openstack.org/#/c/261062/36).

    Change-Id: Ibcc50bb47bd95dc1675aaf1abddbac375a434e2a
    Depends-On: I77a1d3a32633390c1fe37bbeb81da5d0996972df
    Closes-Bug: 1525967
    (cherry picked from commit cf5e98161297072677211e890a8d7eaafae45087)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote :

Reviewed: https://review.openstack.org/269600
Committed: https://git.openstack.org/cgit/openstack/fuel-main/commit/?id=9ac2c23d2fe779f46eb9d15b73b08004c3800530
Submitter: Jenkins
Branch: stable/8.0

commit 9ac2c23d2fe779f46eb9d15b73b08004c3800530
Author: Dmitry Bilunov <email address hidden>
Date: Tue Dec 29 12:19:32 2015 +0300

    Update dependency checks

    VirtualBox scripts rely on various utilities to function. To validate
    the environment, virtualbox/prepare-environment.sh checks if all these
    utilities are available to the shell. However, some of the checks
    (namely xxd and ssh) were missing. This change should fix this by
    aborting the prepare step in case if these utilities are not found.

    Change-Id: Ic49c11054345964c9785e9c4c791ea33dba4791c
    Partial-Bug: 1525967
    (cherry picked from commit e8abfee12c85fbcb11a0688dad59872071542202)

tags: added: on-verification
Revision history for this message
Dmitriy Kruglov (dkruglov) wrote :

The verification is blocked until the following bug is fixed - https://bugs.launchpad.net/fuel/+bug/1534129.

Revision history for this message
Maksim Malchuk (mmalchuk) wrote :

these changes not related to this bug, but it's ok to test using latest fixed scripts

Revision history for this message
Dmitriy Kruglov (dkruglov) wrote :

Verified vbox scripts on stable/8.0 branch code, the latest commit 6c6b088a3d52dd0eaf43d59f3a3a149c93a07e7e, and MOS 8.0 ISO, build 468.
The issue is fixed.

Changed in fuel:
status: Fix Committed → Fix Released
tags: removed: on-verification
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-main (master)

Related fix proposed to branch: master
Review: https://review.openstack.org/272270

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-main (master)

Reviewed: https://review.openstack.org/272270
Committed: https://git.openstack.org/cgit/openstack/fuel-main/commit/?id=cf0c3d8eb93e604058300dc698f78ad7dcd06f8d
Submitter: Jenkins
Branch: master

commit cf0c3d8eb93e604058300dc698f78ad7dcd06f8d
Author: Maksim Malchuk <email address hidden>
Date: Mon Jan 25 23:32:18 2016 +0300

    Restore forgotten kernel name for VirtualBox

    This commit adds forgotten kernel name back to boot Fuel
    using VirtualBox scripts with skipfuelmenu="yes" set.

    Change-Id: I58e21558024c3974dab8af6cefa141bf270fb065
    Closes-Bug: #1537897
    Closes-Bug: #1487047
    Related-Bug: #1525967

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix proposed to fuel-main (stable/8.0)

Related fix proposed to branch: stable/8.0
Review: https://review.openstack.org/272445

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Related fix merged to fuel-main (stable/8.0)

Reviewed: https://review.openstack.org/272445
Committed: https://git.openstack.org/cgit/openstack/fuel-main/commit/?id=21d3d722b4ec1e84aa2c2ab207cefc89917baf78
Submitter: Jenkins
Branch: stable/8.0

commit 21d3d722b4ec1e84aa2c2ab207cefc89917baf78
Author: Maksim Malchuk <email address hidden>
Date: Mon Jan 25 23:32:18 2016 +0300

    Restore forgotten kernel name for VirtualBox

    This commit adds forgotten kernel name back to boot Fuel
    using VirtualBox scripts with skipfuelmenu="yes" set.

    Change-Id: I58e21558024c3974dab8af6cefa141bf270fb065
    (cherry-pick from commit cf0c3d8eb93e604058300dc698f78ad7dcd06f8d)
    Closes-Bug: #1537897
    Closes-Bug: #1487047
    Related-Bug: #1525967

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-main (master)

Change abandoned by Dmitry Bilunov (<email address hidden>) on branch: master
Review: https://review.openstack.org/258568
Reason: This won't be fixed in this release.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.