| 2016-04-05 12:45:22 |
Ksenia Svechnikova |
bug |
|
|
added bug |
| 2016-04-05 12:51:32 |
Ksenia Svechnikova |
summary |
Simultaneously allocation 1Gb and 2 M HugePages prevent launching VM |
Simultaneous allocation of 1Gb and 2 M HugePages break VMs launching |
|
| 2016-04-05 12:52:34 |
Ksenia Svechnikova |
description |
ISO 9.0 150 - version http://paste.openstack.org/show/492973/
Steps to reproduce:
Prepare 2+1 nodes
[root@fuel ~]# fuel node --env 2
id | status | name | cluster | ip | mac | roles | pending_roles | online | group_id
---|--------|------------------|---------|-----------|-------------------|-----------------|---------------|--------|---------
5 | ready | Untitled (58:06) | 2 | 10.20.0.6 | 0c:c4:7a:6c:58:06 | cinder, compute | | True | 2
2 | ready | Untitled (55:2c) | 2 | 10.20.0.5 | 0c:c4:7a:34:55:2c | cinder, compute | | True | 2
6 | ready | Untitled (53:8e) | 2 | 10.20.0.4 | 0c:c4:7a:34:53:8e | controller | | True | 2
There are 4 NUMA nodes on compute node-2. Allocate Nova Huge pages: 2.0 MB - 2030 and 1.0 GB - 10
Deploy env
Verify HP are present on node-2
Create an aggregate for compute nodes with huge pages and CPU pinning:
nova aggregate-create performance_3_cpu
nova aggregate-set-metadata performance_3_cpur hpgs=true
nova aggregate-set-metadata performance_3_cpu pinned=true
Add hosts to them:
nova aggregate-add-host hpgs-aggr node-8.domain.tld
nova aggregate-add-host normal-aggr node-9.domain.tld
nova aggregate-add-host normal-aggr node-10.domain.tld
Create new flavors for instances with hugepages for each HP on the hosts:
nova flavor-create h1.huge.hpgs auto 512 1 1
nova flavor-create h1.small.hpgs auto 1024 1 1
nova flavor-key h1.huge.hpgs set hw:mem_page_size=1048576
nova flavor-key h1.huge.hpgs set aggregate_instance_extra_specs:hpgs=true
nova flavor-key h1.small.hpgs set hw:mem_page_size=2048
nova flavor-key h1.small.hpgs set aggregate_instance_extra_specs:hpgs=true
Add to the flavors requirement for the CPU pinning:
nova flavor-key h1.huge.hpgs set hw:cpu_policy=dedicated
nova flavor-key h1.huge.hpgs set aggregate_instance_extra_specs:pinned=true
nova flavor-key h1.small.hpgs set hw:cpu_policy=dedicated
nova flavor-key h1.small.hpgs set aggregate_instance_extra_specs:pinned=true
Create instance with 2M flavor HP size
Delete instace
Create instance with 1Gb flavor size
Expected result:
VMs are created
Actual result:
Vm with 1Gb is in Error state with "No valid host" error.
From libvirt log (node-2): qemuBuildNumaArgStr:6760 : internal error: Unable to find any usable hugetlbfs mount for 1048576 KiB
No mount point for 1Gb HugePages are present |
ISO 9.0 150 - version http://paste.openstack.org/show/492973/
Steps to reproduce:
Prepare 2+1 nodes
[root@fuel ~]# fuel node --env 2
id | status | name | cluster | ip | mac | roles | pending_roles | online | group_id
---|--------|------------------|---------|-----------|-------------------|-----------------|---------------|--------|---------
5 | ready | Untitled (58:06) | 2 | 10.20.0.6 | 0c:c4:7a:6c:58:06 | cinder, compute | | True | 2
2 | ready | Untitled (55:2c) | 2 | 10.20.0.5 | 0c:c4:7a:34:55:2c | cinder, compute | | True | 2
6 | ready | Untitled (53:8e) | 2 | 10.20.0.4 | 0c:c4:7a:34:53:8e | controller | | True | 2
There are 4 NUMA nodes on compute node-2. Allocate Nova Huge pages: 2.0 MB - 2030 and 1.0 GB - 10
Deploy env
Verify HP are present on node-2
Create an aggregate for compute nodes with huge pages and CPU pinning:
nova aggregate-create performance_3_cpu
nova aggregate-set-metadata performance_3_cpur hpgs=true
nova aggregate-set-metadata performance_3_cpu pinned=true
Add hosts to them:
nova aggregate-add-host performance_3_cpu node-2.domain.tld
Create new flavors for instances with hugepages for each HP on the hosts:
nova flavor-create h1.huge.hpgs auto 512 1 1
nova flavor-create h1.small.hpgs auto 1024 1 1
nova flavor-key h1.huge.hpgs set hw:mem_page_size=1048576
nova flavor-key h1.huge.hpgs set aggregate_instance_extra_specs:hpgs=true
nova flavor-key h1.small.hpgs set hw:mem_page_size=2048
nova flavor-key h1.small.hpgs set aggregate_instance_extra_specs:hpgs=true
Add to the flavors requirement for the CPU pinning:
nova flavor-key h1.huge.hpgs set hw:cpu_policy=dedicated
nova flavor-key h1.huge.hpgs set aggregate_instance_extra_specs:pinned=true
nova flavor-key h1.small.hpgs set hw:cpu_policy=dedicated
nova flavor-key h1.small.hpgs set aggregate_instance_extra_specs:pinned=true
Create instance with 2M flavor HP size
Delete instace
Create instance with 1Gb flavor size
Expected result:
VMs are created
Actual result:
Vm with 1Gb is in Error state with "No valid host" error.
From libvirt log (node-2): qemuBuildNumaArgStr:6760 : internal error: Unable to find any usable hugetlbfs mount for 1048576 KiB
No mount point for 1Gb HugePages are present |
|
| 2016-04-05 13:16:07 |
Arthur Svechnikov |
bug |
|
|
added subscriber Arthur Svechnikov |
| 2016-04-05 20:10:29 |
Dmitry Klenov |
fuel: status |
New |
Confirmed |
|
| 2016-04-06 10:06:53 |
Matthew Mosesohn |
tags |
area-library feature-huge-pages |
area-library feature-huge-pages team-telco |
|
| 2016-04-07 08:34:32 |
Sergey Kolekonov |
fuel: assignee |
Fuel Telco (fuel-telco-team) |
Sergey Kolekonov (skolekonov) |
|
| 2016-04-08 18:59:16 |
OpenStack Infra |
fuel: status |
Confirmed |
In Progress |
|
| 2016-04-11 15:49:22 |
Ivan Berezovskiy |
nominated for series |
|
fuel/mitaka |
|
| 2016-04-11 15:49:22 |
Ivan Berezovskiy |
bug task added |
|
fuel/mitaka |
|
| 2016-04-11 15:49:22 |
Ivan Berezovskiy |
nominated for series |
|
fuel/newton |
|
| 2016-04-11 15:49:22 |
Ivan Berezovskiy |
bug task added |
|
fuel/newton |
|
| 2016-04-11 15:49:28 |
Ivan Berezovskiy |
fuel/mitaka: status |
New |
Confirmed |
|
| 2016-04-11 15:49:30 |
Ivan Berezovskiy |
fuel/mitaka: importance |
Undecided |
High |
|
| 2016-04-11 15:49:38 |
Ivan Berezovskiy |
fuel/mitaka: assignee |
|
Sergey Kolekonov (skolekonov) |
|
| 2016-04-11 15:49:39 |
Ivan Berezovskiy |
fuel/mitaka: milestone |
|
9.0 |
|
| 2016-04-11 15:49:41 |
Ivan Berezovskiy |
fuel/newton: milestone |
9.0 |
10.0 |
|
| 2016-04-14 10:24:56 |
OpenStack Infra |
fuel: status |
In Progress |
Fix Committed |
|
| 2016-04-14 10:36:54 |
OpenStack Infra |
fuel/mitaka: status |
Confirmed |
In Progress |
|
| 2016-04-14 10:36:54 |
OpenStack Infra |
fuel/mitaka: assignee |
Sergey Kolekonov (skolekonov) |
Ivan Berezovskiy (iberezovskiy) |
|
| 2016-04-14 10:37:05 |
OpenStack Infra |
fuel/mitaka: assignee |
Ivan Berezovskiy (iberezovskiy) |
Sergey Kolekonov (skolekonov) |
|
| 2016-04-15 18:08:06 |
OpenStack Infra |
fuel/mitaka: assignee |
Sergey Kolekonov (skolekonov) |
Ivan Berezovskiy (iberezovskiy) |
|
| 2016-04-18 08:43:33 |
OpenStack Infra |
fuel/mitaka: status |
In Progress |
Fix Committed |
|
| 2016-04-21 16:07:04 |
Mikhail Chernik |
fuel/mitaka: status |
Fix Committed |
Fix Released |
|
| 2016-09-21 20:42:45 |
Roy Tang |
bug |
|
|
added subscriber Roy Tang |
