| 2014-07-10 21:07:42 |
Roman Sokolkov |
bug |
|
|
added bug |
| 2014-07-10 21:12:33 |
Roman Sokolkov |
description |
Description:
While ubuntu installation "late_command" directive is used for a lot of stuff i.e. disk partitioning, grub installation, etc.
But actually all this stuff just single shell string. Pretty big string...
In our case we have ceph-osd nodes with 23 disks (1 OS, 4 journals, 18 osds). While Ubuntu installation "late_command" directive fails and node starts loop reboots. (nopxe flag was not set).After some investigation I've found that late_command immediately fails with 'Argu ment list too long' error. After reducing number of disks or removing some parts of the late_command it starts working. My assumption that string too long and not fits some kernel limits (i.e. MAX_ARG_PAGES http://www.linuxjournal.com/article/6060). How "late_command" executed http://bazaar.launchpad.net/~ubuntu-branches/ubuntu/precise/preseed/precise/view/head:/preseed_command#L16
Environment:
Fuel 5.0, Ubuntu, HA, Neutron+VLAN, Ceph on dedicated nodes
Steps to reproduce:
- Create environment(HA or not) with dedicated ceph nodes
- Assign large number of disks for ceph-osds (at least 20)
- Deploy
Expected result:
- Ubuntu installed successfully
Actual result:
- Ubuntu installation stuck on 100% in Fuel (loop reinstallation)
Possible solution:
- Rebuild debian-installer
Details:
In /var/log/remote/node-X.domain.tld/finish-install.log:
2014-07-10T12:42:38.789606+00:00 notice: info: Running /usr/lib/finish-install.d/07preseed
2014-07-10T12:42:38.845174+00:00 notice: /bin/preseed_command: line 23: logger: Argument list too long
2014-07-10T12:42:38.846209+00:00 notice: warning: /usr/lib/finish-install.d/07preseed returned error code 2 |
Description:
While ubuntu installation "late_command" directive is used for a lot of stuff i.e. disk partitioning, grub installation, etc.
But actually all this stuff just single shell string. Pretty big string...
In our case we have ceph-osd nodes with 23 disks (1 OS, 4 journals, 18 osds). While Ubuntu installation "late_command" directive fails and node starts loop reboots. (nopxe flag was not set).After some investigation I've found that late_command immediately fails with 'Argu ment list too long' error. After reducing number of disks or removing some parts of the late_command it starts working. My assumption that string too long and not fits some kernel limits (i.e. MAX_ARG_PAGES http://www.linuxjournal.com/article/6060). How "late_command" executed http://bazaar.launchpad.net/~ubuntu-branches/ubuntu/precise/preseed/precise/view/head:/preseed_command#L16
Environment:
Fuel 5.0, Ubuntu, HA, Neutron+VLAN, Ceph on dedicated nodes
Steps to reproduce:
- Create environment(HA or not) with dedicated ceph nodes
- Assign large number of disks for ceph-osds (at least 20)
- Deploy
Expected result:
- Ubuntu installed successfully
Actual result:
- Ubuntu installation stuck on 100% in Fuel (loop reinstallation)
Possible solution:
- Rebuild debian-installer kernel with increased limit (need more research)
- Move out ceph partitioning stuff from late_command (to puppet?)
Details:
In /var/log/remote/node-X.domain.tld/finish-install.log:
2014-07-10T12:42:38.789606+00:00 notice: info: Running /usr/lib/finish-install.d/07preseed
2014-07-10T12:42:38.845174+00:00 notice: /bin/preseed_command: line 23: logger: Argument list too long
2014-07-10T12:42:38.846209+00:00 notice: warning: /usr/lib/finish-install.d/07preseed returned error code 2 |
|
| 2014-07-11 08:32:38 |
Nastya Urlapova |
fuel: importance |
Undecided |
Medium |
|
| 2014-07-11 08:32:54 |
Nastya Urlapova |
fuel: assignee |
|
Fuel Library Team (fuel-library) |
|
| 2014-07-11 08:32:57 |
Nastya Urlapova |
fuel: milestone |
|
5.1 |
|
| 2014-07-15 17:45:31 |
Dmitry Ilyin |
summary |
Large number of disks could fail ubuntu installation |
[library] Large number of disks could fail ubuntu installation |
|
| 2014-07-17 15:25:46 |
Vladimir Kuklin |
fuel: assignee |
Fuel Library Team (fuel-library) |
Vladimir Kozhukalov (kozhukalov) |
|
| 2014-07-22 10:11:16 |
Vladimir Kuklin |
fuel: status |
New |
Confirmed |
|
| 2014-07-23 16:33:48 |
Dmitry Ilyin |
summary |
[library] Large number of disks could fail ubuntu installation |
[provision] Large number of disks could fail ubuntu installation |
|
| 2014-07-28 22:14:17 |
Vladimir Kuklin |
tags |
|
customer-found |
|
| 2014-07-28 22:14:20 |
Vladimir Kuklin |
fuel: importance |
Medium |
High |
|
| 2014-08-06 13:15:37 |
Vladimir Kozhukalov |
fuel: milestone |
5.1 |
6.0 |
|
| 2014-08-06 13:15:58 |
Vladimir Kozhukalov |
fuel: importance |
High |
Medium |
|
| 2014-09-10 13:49:19 |
Irina Povolotskaya |
tags |
customer-found |
customer-found release-notes |
|
| 2014-10-27 19:03:51 |
Dmitry Borodaenko |
fuel: status |
Confirmed |
In Progress |
|
| 2014-11-24 12:47:53 |
Dmitry Pyzhov |
fuel: status |
In Progress |
Confirmed |
|
| 2014-11-24 12:47:57 |
Dmitry Pyzhov |
fuel: milestone |
6.0 |
6.1 |
|
| 2014-11-24 12:48:11 |
Dmitry Pyzhov |
tags |
customer-found release-notes |
customer-found release-notes volumes |
|
| 2015-02-06 09:50:25 |
Chang-Yi Lee |
bug |
|
|
added subscriber Chang-Yi Lee |
| 2015-02-07 06:32:36 |
Rico Lin |
bug |
|
|
added subscriber Rico lin |
| 2015-02-18 11:47:34 |
Dmitry Pyzhov |
fuel: assignee |
Vladimir Kozhukalov (kozhukalov) |
Fuel provisioning team (fuel-provisioning) |
|
| 2015-03-23 16:29:19 |
Dmitry Pyzhov |
fuel: milestone |
6.1 |
7.0 |
|
| 2015-03-30 17:40:05 |
Dmitry Pyzhov |
tags |
customer-found release-notes volumes |
customer-found module-volumes release-notes |
|
| 2015-04-01 15:10:39 |
Dmitry Pyzhov |
fuel: importance |
Medium |
High |
|
| 2015-04-01 15:10:49 |
Dmitry Pyzhov |
fuel: milestone |
7.0 |
6.1 |
|
| 2015-04-02 17:54:09 |
Dmitry Pyzhov |
fuel: assignee |
Fuel provisioning team (fuel-provisioning) |
Vladimir Kozhukalov (kozhukalov) |
|
| 2015-04-08 14:13:47 |
OpenStack Infra |
fuel: status |
Confirmed |
In Progress |
|
| 2015-04-16 13:05:02 |
OpenStack Infra |
fuel: status |
In Progress |
Fix Committed |
|
| 2015-05-21 15:56:40 |
Evgeny Konstantinov |
tags |
customer-found module-volumes release-notes |
customer-found module-volumes release-notes release-notes-done |
|
