Periodic disappearance of default route. Can't save configuration and quit from fuelmenu

Bug #1543767 reported by Alexander Podrepniy
22
This bug affects 3 people
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Released
High
Georgy Kibardin
8.0.x
Confirmed
High
Fuel Python (Deprecated)

Bug Description

Summary:

Manual installation fuel-master node.
Periodic disappearance of default route received via DHCP on eth1 interface in fuelmenu on first node boot.

Version: Fuel 8.0 build 545

[root@fuel log]# cat /etc/fuel/version.yaml
VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "8.0"
  api: "1.0"
  build_number: "545"
  build_id: "545"
  fuel-nailgun_sha: "baec8643ca624e52b37873f2dbd511c135d236d9"
  python-fuelclient_sha: "4f234669cfe88a9406f4e438b1e1f74f1ef484a5"
  fuel-agent_sha: "658be72c4b42d3e1436b86ac4567ab914bfb451b"
  fuel-nailgun-agent_sha: "b2bb466fd5bd92da614cdbd819d6999c510ebfb1"
  astute_sha: "b81577a5b7857c4be8748492bae1dec2fa89b446"
  fuel-library_sha: "e2d79330d5d708796330fac67722c21f85569b87"
  fuel-ostf_sha: "3bc76a63a9e7d195ff34eadc29552f4235fa6c52"
  fuel-mirror_sha: "fb45b80d7bee5899d931f926e5c9512e2b442749"
  fuelmenu_sha: "78ffc73065a9674b707c081d128cb7eea611474f"
  shotgun_sha: "63645dea384a37dde5c01d4f8905566978e5d906"
  network-checker_sha: "a43cf96cd9532f10794dce736350bf5bed350e9d"
  fuel-upgrade_sha: "616a7490ec7199f69759e97e42f9b97dfc87e85b"
  fuelmain_sha: "87dfb6bc25d4650264f09c338ed77c21a3d6fe87"

Steps to reproduce:
1. Start Fuel installation from ISO image
2. After CentOS installation complete and the fuel node reboot first time wait until fuelmenu apply default setting and press any key for run fuelmenu
3. Choice "Network Setup"
4. Select:
   - Interface: eth1
   - Enable interface: Yes
   - Configuration via DHCP: Yes
5. Don't change any other option. All other settings filled by default values.
6. Press "Apply" button.

Expected result:
   Get values "IP address", "Netmask" and "Default Gateway" from DHCP server located in eth1 network and fill fields in "Network Setup" menu.
   Interface "eth1" configured with IP and netmask. Default route set to eth1 via "Default Gateway".

Actual result:
   "IP address" and "Netmask" fields has correct values in "Network Setup" menu.
   "Default Gateway" field still empty.
   Interface "eth1" configured with correct IP and netmask. Default route still set to eth0 via default "10.20.0.1".

Continue steps to reproduce:
7. Don't change any options and press "Apply button" again.

Expected result:
   The same.

Actual result:
   "IP address" and "Netmask" fields has correct values in "Network Setup" menu.
   "Default Gateway" has correct value too.
   Interface "eth1" configured with correct IP and netmask. Default route set to eth1 via correct IP address.
   Route table has 2 default routes:
[root@fuel ~]# route -n
Kernel IP routing table
Destination Gateway Genmask Flags Metric Ref Use Iface
0.0.0.0 172.18.201.1 0.0.0.0 UG 0 0 0 eth1
0.0.0.0 10.20.0.1 0.0.0.0 UG 100 0 0 eth0
10.20.0.0 0.0.0.0 255.255.255.0 U 100 0 0 eth0
169.254.0.0 0.0.0.0 255.255.0.0 U 1003 0 0 eth1
172.18.201.0 0.0.0.0 255.255.255.0 U 0 0 0 eth1

Continue steps to reproduce:
8. Don't change any options and press "Apply button" again.

Expected result:
   The same.

Actual result:
   The result is the same as after step #6.

Workaround:
   After step #6 exit to shell via "Shell login" menu.
   Comment out "GATEWAY" in /etc/sysconfig/network-scripts/ifcfg-eth0.
   Run "ifdown eth0 ; ifdown eth1 ; ifup eth0 ; ifup eth1"
   Exit from "Shell login" and navigate to "Network Setup" menu. All fileds has correct values and they doesn't change after pressing "Apply" button many times.

IMPORTANT DETAILS:
   I.e. after each second pressign "Apply" button we don't have correct default route.
   This bug doesn't allow save configuration and quit from fuelmenu normally if press "Save and Quit" or "Save and Continue" after step #7. We got message "Checking data..." and wait about 3-5 minutes. After this we got error message "URL for repository ubuntu is not accessible".

Revision history for this message
Alexander Podrepniy (apodrepniy) wrote :
Ilya Kutukov (ikutukov)
Changed in fuel:
assignee: nobody → Fuel Python Team (fuel-python)
importance: Undecided → Medium
importance: Medium → High
status: New → Confirmed
milestone: none → 9.0
tags: added: area-python module-networks
Dmitry Pyzhov (dpyzhov)
tags: added: team-network
tags: added: module-fuelmenu
removed: team-network
tags: removed: module-networks
Changed in fuel:
assignee: Fuel Python Team (fuel-python) → Georgy Kibardin (gkibardin)
status: Confirmed → In Progress
Revision history for this message
Georgy Kibardin (gkibardin) wrote :

I could reproduce 6 and 7, but not 8. The "Save and Quit" behaviour is also not reproducible on current master.

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-main (master)

Fix proposed to branch: master
Review: https://review.openstack.org/295123

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-menu (master)

Fix proposed to branch: master
Review: https://review.openstack.org/295124

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/295129

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-menu (master)

Fix proposed to branch: master
Review: https://review.openstack.org/295256

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-menu (master)

Change abandoned by Georgy Kibardin (<email address hidden>) on branch: master
Review: https://review.openstack.org/295256

Sergii (sgudz)
Changed in fuel:
status: In Progress → Fix Released
Revision history for this message
Mikhail Chernik (mchernik) wrote :

Status was accidentally changed, reverting.

Changed in fuel:
status: Fix Released → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/295129
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=c5c67262b5fae6105e74a9a8f837840cf4f43da1
Submitter: Jenkins
Branch: master

commit c5c67262b5fae6105e74a9a8f837840cf4f43da1
Author: Georgy Kibardin <email address hidden>
Date: Mon Mar 21 10:36:09 2016 +0300

    Do not try change default route obtained via DHCP.

    When DHCP is used to configure a network interface we must ignore
    gateway settings so that the default route doesn't get deleted when
    gateway settings are absent (which is reasonable for DHCP).

    Change-Id: I94f7fb903ce2f271ad14329f353202ca7251915c
    Closes-Bug: #1543767

Changed in fuel:
status: In Progress → Fix Committed
Changed in fuel:
status: Fix Committed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Change abandoned on fuel-main (master)

Change abandoned by Georgy Kibardin (<email address hidden>) on branch: master
Review: https://review.openstack.org/295123
Reason: Disabling NetworkManager has been moved into fuelmenu itself

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/296923

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/296923
Committed: https://git.openstack.org/cgit/openstack/fuel-library/commit/?id=c493a822147cb39ce0b567a730e86c4893e663ed
Submitter: Jenkins
Branch: master

commit c493a822147cb39ce0b567a730e86c4893e663ed
Author: Georgy Kibardin <email address hidden>
Date: Thu Mar 24 10:07:35 2016 +0300

    ipaddr is a list, cannot compare it with a string

    Closes-Bug: #1543767
    Change-Id: I58ce33af7fbabe42f57c2ef802d9446a144f802e

Changed in fuel:
status: In Progress → Fix Committed
Changed in fuel:
status: Fix Committed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-menu (master)

Reviewed: https://review.openstack.org/295124
Committed: https://git.openstack.org/cgit/openstack/fuel-menu/commit/?id=604c20a9bbb23df25495e93930588cc7ee0511d5
Submitter: Jenkins
Branch: master

commit 604c20a9bbb23df25495e93930588cc7ee0511d5
Author: Georgy Kibardin <email address hidden>
Date: Mon Mar 21 10:31:46 2016 +0300

    Ensure network interface is up befure running DHCP server discovery.

    It happened that the interface where DHCP servers are about to discover
    was always up due to NetworkManager service. Since we are disabling it
    we need to ensure that the interface is up.
    Default routes deletion is now done by puppet.

    Change-Id: Ieda8b67be8133bdc953ace2054aaa6db1ce949c0
    Closes-Bug: #1543767

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-menu (master)

Fix proposed to branch: master
Review: https://review.openstack.org/302167

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-menu (master)

Reviewed: https://review.openstack.org/302167
Committed: https://git.openstack.org/cgit/openstack/fuel-menu/commit/?id=610f1274256fb247d44fc7b698b4d5b71238e219
Submitter: Jenkins
Branch: master

commit 610f1274256fb247d44fc7b698b4d5b71238e219
Author: Georgy Kibardin <email address hidden>
Date: Wed Apr 6 13:40:18 2016 +0300

    Filter out empty ip addresses

    When resetting default gateways filter out interfaces with empty
    ip addresses and netmasks
    Also log invalid addresses and netmasks

    Change-Id: I5ad4865fff7294e837d6786da759547179dbbe65
    Closes-Bug: #1543767

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-menu (stable/mitaka)

Fix proposed to branch: stable/mitaka
Review: https://review.openstack.org/304290

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-menu (stable/mitaka)

Reviewed: https://review.openstack.org/304290
Committed: https://git.openstack.org/cgit/openstack/fuel-menu/commit/?id=5b9987cfc82e5ef67d658cc3502f80676711fd80
Submitter: Jenkins
Branch: stable/mitaka

commit 5b9987cfc82e5ef67d658cc3502f80676711fd80
Author: Georgy Kibardin <email address hidden>
Date: Wed Apr 6 13:40:18 2016 +0300

    Filter out empty ip addresses

    When resetting default gateways filter out interfaces with empty
    ip addresses and netmasks
    Also log invalid addresses and netmasks

    Change-Id: I5ad4865fff7294e837d6786da759547179dbbe65
    Closes-Bug: #1543767
    (cherry picked from commit 610f1274256fb247d44fc7b698b4d5b71238e219)

tags: added: in-stable-mitaka
Changed in fuel:
status: Fix Committed → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.