too much 2M hugepages reserved

Bug #1825814 reported by cheng li
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
StarlingX
Fix Released
High
Tao Liu

Bug Description

Env: ISO built on 11 April. Simplex AIO on libvirt VM, vswitch_type = ovs-dpdk

After deployment/apply, the VM is slow, and finally doesn't response.
Reboot doesn't resolve this problem.
After investigation, I find this happens because of low memory available.

I find that 6554 x 2M hugepages are reserved, it's more than 10GB memory.
I can see only 512 x 2M is used by ovs-dpdk. I lowered the hugepages to 1024, no such issue anymore.

Revision history for this message
Frank Miller (sensfan22) wrote :

StarlingX is designed by default to allocate all memory as 2M hugepages minus the memory reserved for the platform (including ovs-dpdk). Users are expected to use servers that have enough memory to run a StarlingX software load.

Changed in starlingx:
status: New → Invalid
assignee: nobody → cheng li (chengli3)
Revision history for this message
cheng li (chengli3) wrote :

Seems so little memory for StarlingX software load. I would suggest to allocate more memory for StartlingX software load.

Revision history for this message
Al Bailey (albailey1974) wrote :

Investigating 2 changes to address this
1) Not allocating hugepages (by default) when running in vbox.
2) Increasing platform memory available.

Note: The vbox change is not specific to the environment where this bug was detected.

Changed in starlingx:
status: Invalid → Confirmed
Revision history for this message
Frank Miller (sensfan22) wrote :

This LP should only address item #1 where code is updated to not allocate hugepages by default for virtual environments. (Item #2 should be done in a separate LP.)

tags: added: stx.2.0
Changed in starlingx:
assignee: cheng li (chengli3) → Al Bailey (albailey1974)
importance: Undecided → High
status: Confirmed → Triaged
Revision history for this message
Frank Miller (sensfan22) wrote :

Marking release gating as StarlingX developers require a working virtual environment for development.

Frank Miller (sensfan22)
Changed in starlingx:
assignee: Al Bailey (albailey1974) → Tao Liu (tliu88)
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to config (master)

Fix proposed to branch: master
Review: https://review.opendev.org/656788

Changed in starlingx:
status: Triaged → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to config (master)

Reviewed: https://review.opendev.org/656788
Committed: https://git.openstack.org/cgit/starlingx/config/commit/?id=e51976083e6042546b1922e8a00bbb2e86e21423
Submitter: Zuul
Branch: master

commit e51976083e6042546b1922e8a00bbb2e86e21423
Author: Tao Liu <email address hidden>
Date: Thu May 2 10:45:11 2019 -0400

    Disable pre-allocation of 2M hugepages on VBox

    Slow performance was observed in vbox with the default
    2M hugepages allocation.

    This update disables the default 2M hugepages allocation
    in vbox. Users are expected to allocate desired huge pages
    via CLI or Horizon.

    In addition, the default platform reserved memory has been
    increased to 2500M on the worker nodes running in vbox.

    Fixes-Bug: 1825814

    Change-Id: I2558bcde76a23f1293e07486dbbe5a4b6f91db2f
    Signed-off-by: Tao Liu <email address hidden>

Changed in starlingx:
status: In Progress → Fix Released
Ghada Khalil (gkhalil)
tags: added: stx.config
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.