| 2016-06-06 09:27:36 |
Yury Tregubov |
bug |
|
|
added bug |
| 2016-06-06 09:28:49 |
Yury Tregubov |
attachment added |
|
9.0 iso #443 disagnostic https://bugs.launchpad.net/fuel/+bug/1589433/+attachment/4677985/+files/fuel-snapshot-2016-06-06_09-01-44.tar.gz |
|
| 2016-06-06 09:30:19 |
Yury Tregubov |
summary |
Deployment of env with mongodb is failed |
Deployment of env with mongodb and ceilometer is failed |
|
| 2016-06-06 12:14:22 |
Aleksey Zvyagintsev |
tags |
|
area-library |
|
| 2016-06-06 12:14:32 |
Aleksey Zvyagintsev |
tags |
area-library |
area-library module-astute module-nailgun |
|
| 2016-06-06 12:14:40 |
Aleksey Zvyagintsev |
fuel: assignee |
|
Fuel Sustaining (fuel-sustaining-team) |
|
| 2016-06-06 13:28:29 |
Timur Nurlygayanov |
fuel: importance |
Undecided |
Critical |
|
| 2016-06-06 13:28:39 |
Timur Nurlygayanov |
nominated for series |
|
fuel/mitaka |
|
| 2016-06-06 13:28:39 |
Timur Nurlygayanov |
bug task added |
|
fuel/mitaka |
|
| 2016-06-06 13:28:39 |
Timur Nurlygayanov |
nominated for series |
|
fuel/newton |
|
| 2016-06-06 13:28:39 |
Timur Nurlygayanov |
bug task added |
|
fuel/newton |
|
| 2016-06-06 13:37:20 |
Oleksiy Molchanov |
fuel/newton: assignee |
Fuel Sustaining (fuel-sustaining-team) |
Oleksiy Molchanov (omolchanov) |
|
| 2016-06-06 13:38:20 |
Oleksiy Molchanov |
fuel/newton: status |
New |
In Progress |
|
| 2016-06-06 13:38:23 |
Oleksiy Molchanov |
fuel/mitaka: status |
New |
Confirmed |
|
| 2016-06-06 13:38:25 |
Oleksiy Molchanov |
fuel/mitaka: importance |
Undecided |
Critical |
|
| 2016-06-06 13:38:28 |
Oleksiy Molchanov |
fuel/mitaka: assignee |
|
Oleksiy Molchanov (omolchanov) |
|
| 2016-06-06 13:38:29 |
Oleksiy Molchanov |
fuel/mitaka: milestone |
|
9.0 |
|
| 2016-06-06 13:38:31 |
Oleksiy Molchanov |
fuel/newton: milestone |
|
10.0 |
|
| 2016-06-06 13:44:15 |
Yury Tregubov |
description |
Deployment of the env with below node's roles is failed since 9.0 mos iso #427:
1 controller
1 Controller + Cinder
1 MongoDB
The previous success deploy was on mos 9.0 iso #424.
The following errors from puppet are seen in logs on affected controller:
016-06-05 22:17:45 ERR /usr/lib/ruby/vendor_ruby/puppet/util/errors.rb:106:in `fail'
2016-06-05 22:17:45 ERR /bin/bash "/etc/puppet/shell_manifests/upload_cirros_command.sh" returned 1 instead of one of [0]
2016-06-05 22:17:35 ERR (/Stage[main]/Main/Exec[upload_cirros_shell]/returns) change from notrun to 0 failed: /bin/bash "/etc/puppet/shell_manifests/upload_cirros_command.sh" returned 1 instead of one of [0]
Also on node with MongoDB:
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager Traceback (most recent call last):
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/ceilometer/agent/manager.py", line 458, in discover
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager discovered = discoverer.discover(self, param)
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/ceilometer/network/services/discovery.py", line 68, in discover
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager loadbalancers = self.neutron_cli.list_loadbalancer()
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/ceilometer/neutron_client.py", line 401, in list_loadbalancer
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager resp = self.client.list_loadbalancers()
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 97, in with_params
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager ret = self.function(instance, *args, **kwargs)
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1045, in list_loadbalancers
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager retrieve_all, **_params)
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 373, in list
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager for r in self._pagination(collection, path, **params):
/var/log/remote/node-3.test.domain.local/bootstrap/mcollective.log:2016-06-05T21:29:05.709647+00:00 err: 21:29:05.219092 #1484] ERROR -- : pluginmanager.rb:171:in `rescue in loadclass' Failed to load MCollective::Agent::Puppetd: cannot load such file -- puppet
/var/log/remote/node-3.test.domain.local/bootstrap/mcollective.log:2016-06-05T21:29:05.709728+00:00 err: 21:29:05.219197 #1484] ERROR -- : agents.rb:71:in `rescue in loadagent' Loading agent puppetd failed: cannot load such file -- puppet
/var/log/remote/node-3.test.domain.local/bootstrap/mcollective.log:2016-06-05T21:29:27.865469+00:00 err: 21:29:27.139772 #1795] ERROR -- : pluginmanager.rb:171:in `rescue in loadclass' Failed to load MCollective::Agent::Puppetd: cannot load such file -- puppet
/var/log/remote/node-3.test.domain.local/bootstrap/mcollective.log:2016-06-05T21:29:27.865564+00:00 err: 21:29:27.139866 #1795] ERROR -- : agents.rb:71:in `rescue in loadagent' Loading agent puppetd failed: cannot load such file -- puppet
/var/log/shotgun.log:2016-06-05 22:18:16 ERROR 11374 (manager) Clearing target failed. function: <built-in function listdir>, path: /var/dump, excinfo: (<type 'exceptions.OSError'>, OSError(2, 'No such file or directory'), <traceback object at 0x2e567e8>)
/var/log/shotgun.log:2016-06-05 22:18:16 ERROR 11374 (manager) Clearing target failed. function: <built-in function rmdir>, path: /var/dump, excinfo: (<type 'exceptions.OSError'>, OSError(2, 'No such file or directory'), <traceback object at 0x2e56ea8>)
The problem is reproduced so far. Diagnostic snapshot from iso #443 is attached.
The other environments without MongoDB node are deployed without problems at the moment. |
Deployment of the env with below node's roles is failed since 9.0 mos iso #427:
1 Controller
1 Compute + Cinder
1 MongoDB
The previous success deploy was on mos 9.0 iso #424.
The following errors from puppet are seen in logs on affected controller:
016-06-05 22:17:45 ERR /usr/lib/ruby/vendor_ruby/puppet/util/errors.rb:106:in `fail'
2016-06-05 22:17:45 ERR /bin/bash "/etc/puppet/shell_manifests/upload_cirros_command.sh" returned 1 instead of one of [0]
2016-06-05 22:17:35 ERR (/Stage[main]/Main/Exec[upload_cirros_shell]/returns) change from notrun to 0 failed: /bin/bash "/etc/puppet/shell_manifests/upload_cirros_command.sh" returned 1 instead of one of [0]
Also on node with MongoDB:
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager Traceback (most recent call last):
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/ceilometer/agent/manager.py", line 458, in discover
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager discovered = discoverer.discover(self, param)
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/ceilometer/network/services/discovery.py", line 68, in discover
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager loadbalancers = self.neutron_cli.list_loadbalancer()
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/ceilometer/neutron_client.py", line 401, in list_loadbalancer
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager resp = self.client.list_loadbalancers()
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 97, in with_params
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager ret = self.function(instance, *args, **kwargs)
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1045, in list_loadbalancers
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager retrieve_all, **_params)
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 373, in list
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager for r in self._pagination(collection, path, **params):
/var/log/remote/node-3.test.domain.local/bootstrap/mcollective.log:2016-06-05T21:29:05.709647+00:00 err: 21:29:05.219092 #1484] ERROR -- : pluginmanager.rb:171:in `rescue in loadclass' Failed to load MCollective::Agent::Puppetd: cannot load such file -- puppet
/var/log/remote/node-3.test.domain.local/bootstrap/mcollective.log:2016-06-05T21:29:05.709728+00:00 err: 21:29:05.219197 #1484] ERROR -- : agents.rb:71:in `rescue in loadagent' Loading agent puppetd failed: cannot load such file -- puppet
/var/log/remote/node-3.test.domain.local/bootstrap/mcollective.log:2016-06-05T21:29:27.865469+00:00 err: 21:29:27.139772 #1795] ERROR -- : pluginmanager.rb:171:in `rescue in loadclass' Failed to load MCollective::Agent::Puppetd: cannot load such file -- puppet
/var/log/remote/node-3.test.domain.local/bootstrap/mcollective.log:2016-06-05T21:29:27.865564+00:00 err: 21:29:27.139866 #1795] ERROR -- : agents.rb:71:in `rescue in loadagent' Loading agent puppetd failed: cannot load such file -- puppet
/var/log/shotgun.log:2016-06-05 22:18:16 ERROR 11374 (manager) Clearing target failed. function: <built-in function listdir>, path: /var/dump, excinfo: (<type 'exceptions.OSError'>, OSError(2, 'No such file or directory'), <traceback object at 0x2e567e8>)
/var/log/shotgun.log:2016-06-05 22:18:16 ERROR 11374 (manager) Clearing target failed. function: <built-in function rmdir>, path: /var/dump, excinfo: (<type 'exceptions.OSError'>, OSError(2, 'No such file or directory'), <traceback object at 0x2e56ea8>)
The problem is reproduced so far. Diagnostic snapshot from iso #443 is attached.
The other environments without MongoDB node are deployed without problems at the moment. |
|
| 2016-06-06 13:48:25 |
Timur Nurlygayanov |
fuel/mitaka: assignee |
Oleksiy Molchanov (omolchanov) |
Fuel Sustaining (fuel-sustaining-team) |
|
| 2016-06-06 15:15:13 |
Dmitry Pyzhov |
fuel/mitaka: assignee |
Fuel Sustaining (fuel-sustaining-team) |
Oleksiy Molchanov (omolchanov) |
|
| 2016-06-06 15:15:35 |
Dmitry Pyzhov |
bug task deleted |
fuel/newton |
|
|
| 2016-06-06 15:38:13 |
Oleksiy Molchanov |
fuel/mitaka: status |
Confirmed |
Invalid |
|
| 2016-06-06 15:44:49 |
Oleksiy Molchanov |
fuel/mitaka: status |
Invalid |
Confirmed |
|
| 2016-06-06 15:48:27 |
Alex Schultz |
marked as duplicate |
|
1587771 |
|
| 2016-06-07 11:39:50 |
Oleksiy Molchanov |
removed duplicate marker |
1587771 |
|
|
| 2016-06-07 11:40:23 |
Oleksiy Molchanov |
fuel: assignee |
Oleksiy Molchanov (omolchanov) |
MOS Keystone (mos-keystone) |
|
| 2016-06-07 11:40:26 |
Oleksiy Molchanov |
fuel/mitaka: assignee |
Oleksiy Molchanov (omolchanov) |
MOS Keystone (mos-keystone) |
|
| 2016-06-07 14:55:46 |
Andrey Maximov |
tags |
area-library module-astute module-nailgun |
area-library |
|
| 2016-06-07 15:14:35 |
Alexander Makarov |
fuel: assignee |
MOS Keystone (mos-keystone) |
Alexander Makarov (amakarov) |
|
| 2016-06-07 15:14:39 |
Alexander Makarov |
fuel/mitaka: assignee |
MOS Keystone (mos-keystone) |
Alexander Makarov (amakarov) |
|
| 2016-06-07 15:15:21 |
Dina Belova |
fuel/mitaka: status |
Confirmed |
In Progress |
|
| 2016-06-07 21:40:25 |
OpenStack Infra |
fuel/mitaka: assignee |
Alexander Makarov (amakarov) |
Alex Schultz (alex-schultz) |
|
| 2016-06-07 21:51:36 |
Alex Schultz |
fuel/mitaka: assignee |
Alex Schultz (alex-schultz) |
Alexander Makarov (amakarov) |
|
| 2016-06-08 01:01:23 |
Timur Nurlygayanov |
fuel/mitaka: status |
In Progress |
Confirmed |
|
| 2016-06-08 01:01:26 |
Timur Nurlygayanov |
fuel: status |
In Progress |
Confirmed |
|
| 2016-06-08 10:09:59 |
Dmitry Pyzhov |
tags |
area-library |
|
|
| 2016-06-08 16:00:00 |
Sergey Shevorakov |
tags |
|
swarm-blocker |
|
| 2016-06-09 14:19:03 |
Dina Belova |
fuel/mitaka: assignee |
Alexander Makarov (amakarov) |
Alex Schultz (alex-schultz) |
|
| 2016-06-09 14:26:03 |
Dina Belova |
tags |
swarm-blocker |
area-keystone swarm-blocker |
|
| 2016-06-09 16:09:16 |
OpenStack Infra |
fuel/mitaka: status |
Confirmed |
In Progress |
|
| 2016-06-09 21:06:45 |
Vladimir Kuklin |
summary |
Deployment of env with mongodb and ceilometer is failed |
Stale oslo.cache leads to false-positive cache misses |
|
| 2016-06-09 22:31:26 |
OpenStack Infra |
tags |
area-keystone swarm-blocker |
area-keystone in-stable-mitaka swarm-blocker |
|
| 2016-06-10 09:48:23 |
Dina Belova |
fuel/mitaka: status |
In Progress |
Fix Committed |
|
| 2016-06-14 09:14:56 |
Sofiia Andriichenko |
tags |
area-keystone in-stable-mitaka swarm-blocker |
area-keystone in-stable-mitaka on-verification swarm-blocker |
|
| 2016-06-14 11:05:51 |
Sofiia Andriichenko |
fuel/mitaka: status |
Fix Committed |
Fix Released |
|
| 2016-06-14 11:08:17 |
Sofiia Andriichenko |
tags |
area-keystone in-stable-mitaka on-verification swarm-blocker |
area-keystone in-stable-mitaka swarm-blocker |
|
| 2016-07-07 10:16:18 |
Boris Bobrov |
fuel: milestone |
10.0 |
9.1 |
|
| 2016-08-04 15:05:48 |
Sergey Shevorakov |
tags |
area-keystone in-stable-mitaka swarm-blocker |
area-keystone in-stable-mitaka swarm-fail |
|
| 2016-09-06 12:17:12 |
Alexander Makarov |
fuel: milestone |
9.1 |
9.2 |
|
| 2016-11-24 14:29:31 |
Boris Bobrov |
fuel: status |
Confirmed |
Invalid |
|
| 2016-11-24 14:29:48 |
Boris Bobrov |
fuel: status |
Invalid |
Fix Released |
|
