Deployment of the env with below node's roles is failed since 9.0 mos iso #427:
1 controller
1 Controller + Cinder
1 MongoDB
The previous success deploy was on mos 9.0 iso #424.
The following errors from puppet are seen in logs on affected controller:
016-06-05 22:17:45 ERR /usr/lib/ruby/vendor_ruby/puppet/util/errors.rb:106:in `fail'
2016-06-05 22:17:45 ERR /bin/bash "/etc/puppet/shell_manifests/upload_cirros_command.sh" returned 1 instead of one of [0]
2016-06-05 22:17:35 ERR (/Stage[main]/Main/Exec[upload_cirros_shell]/returns) change from notrun to 0 failed: /bin/bash "/etc/puppet/shell_manifests/upload_cirros_command.sh" returned 1 instead of one of [0]
Also on node with MongoDB:
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager Traceback (most recent call last):
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/ceilometer/agent/manager.py", line 458, in discover
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager discovered = discoverer.discover(self, param)
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/ceilometer/network/services/discovery.py", line 68, in discover
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager loadbalancers = self.neutron_cli.list_loadbalancer()
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/ceilometer/neutron_client.py", line 401, in list_loadbalancer
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager resp = self.client.list_loadbalancers()
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 97, in with_params
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager ret = self.function(instance, *args, **kwargs)
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 1045, in list_loadbalancers
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager retrieve_all, **_params)
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager File "/usr/lib/python2.7/dist-packages/neutronclient/v2_0/client.py", line 373, in list
/var/log/remote/10.109.2.3/ceilometer-polling.log:2016-06-06 08:53:05.924 10630 ERROR ceilometer.agent.manager for r in self._pagination(collection, path, **params):
/var/log/remote/node-3.test.domain.local/bootstrap/mcollective.log:2016-06-05T21:29:05.709647+00:00 err: 21:29:05.219092 #1484] ERROR -- : pluginmanager.rb:171:in `rescue in loadclass' Failed to load MCollective::Agent::Puppetd: cannot load such file -- puppet
/var/log/remote/node-3.test.domain.local/bootstrap/mcollective.log:2016-06-05T21:29:05.709728+00:00 err: 21:29:05.219197 #1484] ERROR -- : agents.rb:71:in `rescue in loadagent' Loading agent puppetd failed: cannot load such file -- puppet
/var/log/remote/node-3.test.domain.local/bootstrap/mcollective.log:2016-06-05T21:29:27.865469+00:00 err: 21:29:27.139772 #1795] ERROR -- : pluginmanager.rb:171:in `rescue in loadclass' Failed to load MCollective::Agent::Puppetd: cannot load such file -- puppet
/var/log/remote/node-3.test.domain.local/bootstrap/mcollective.log:2016-06-05T21:29:27.865564+00:00 err: 21:29:27.139866 #1795] ERROR -- : agents.rb:71:in `rescue in loadagent' Loading agent puppetd failed: cannot load such file -- puppet
/var/log/shotgun.log:2016-06-05 22:18:16 ERROR 11374 (manager) Clearing target failed. function: <built-in function listdir>, path: /var/dump, excinfo: (<type 'exceptions.OSError'>, OSError(2, 'No such file or directory'), <traceback object at 0x2e567e8>)
/var/log/shotgun.log:2016-06-05 22:18:16 ERROR 11374 (manager) Clearing target failed. function: <built-in function rmdir>, path: /var/dump, excinfo: (<type 'exceptions.OSError'>, OSError(2, 'No such file or directory'), <traceback object at 0x2e56ea8>)
The problem is reproduced so far. Diagnostic snapshot from iso #443 is attached.
The other environments without MongoDB node are deployed without problems at the moment.
Deployment of the env with below node's roles is failed since 9.0 mos iso #427:
1 controller
1 Controller + Cinder
1 MongoDB
The previous success deploy was on mos 9.0 iso #424.
The following errors from puppet are seen in logs on affected controller:
016-06-05 22:17:45 ERR /usr/lib/ ruby/vendor_ ruby/puppet/ util/errors. rb:106: in `fail' shell_manifests /upload_ cirros_ command. sh" returned 1 instead of one of [0] main]/Main/ Exec[upload_ cirros_ shell]/ returns) change from notrun to 0 failed: /bin/bash "/etc/puppet/ shell_manifests /upload_ cirros_ command. sh" returned 1 instead of one of [0]
2016-06-05 22:17:45 ERR /bin/bash "/etc/puppet/
2016-06-05 22:17:35 ERR (/Stage[
Also on node with MongoDB:
/var/log/ remote/ 10.109. 2.3/ceilometer- polling. log:2016- 06-06 08:53:05.924 10630 ERROR ceilometer. agent.manager Traceback (most recent call last): remote/ 10.109. 2.3/ceilometer- polling. log:2016- 06-06 08:53:05.924 10630 ERROR ceilometer. agent.manager File "/usr/lib/ python2. 7/dist- packages/ ceilometer/ agent/manager. py", line 458, in discover remote/ 10.109. 2.3/ceilometer- polling. log:2016- 06-06 08:53:05.924 10630 ERROR ceilometer. agent.manager discovered = discoverer. discover( self, param) remote/ 10.109. 2.3/ceilometer- polling. log:2016- 06-06 08:53:05.924 10630 ERROR ceilometer. agent.manager File "/usr/lib/ python2. 7/dist- packages/ ceilometer/ network/ services/ discovery. py", line 68, in discover remote/ 10.109. 2.3/ceilometer- polling. log:2016- 06-06 08:53:05.924 10630 ERROR ceilometer. agent.manager loadbalancers = self.neutron_ cli.list_ loadbalancer( ) remote/ 10.109. 2.3/ceilometer- polling. log:2016- 06-06 08:53:05.924 10630 ERROR ceilometer. agent.manager File "/usr/lib/ python2. 7/dist- packages/ ceilometer/ neutron_ client. py", line 401, in list_loadbalancer remote/ 10.109. 2.3/ceilometer- polling. log:2016- 06-06 08:53:05.924 10630 ERROR ceilometer. agent.manager resp = self.client. list_loadbalanc ers() remote/ 10.109. 2.3/ceilometer- polling. log:2016- 06-06 08:53:05.924 10630 ERROR ceilometer. agent.manager File "/usr/lib/ python2. 7/dist- packages/ neutronclient/ v2_0/client. py", line 97, in with_params remote/ 10.109. 2.3/ceilometer- polling. log:2016- 06-06 08:53:05.924 10630 ERROR ceilometer. agent.manager ret = self.function( instance, *args, **kwargs) remote/ 10.109. 2.3/ceilometer- polling. log:2016- 06-06 08:53:05.924 10630 ERROR ceilometer. agent.manager File "/usr/lib/ python2. 7/dist- packages/ neutronclient/ v2_0/client. py", line 1045, in list_loadbalancers remote/ 10.109. 2.3/ceilometer- polling. log:2016- 06-06 08:53:05.924 10630 ERROR ceilometer. agent.manager retrieve_all, **_params) remote/ 10.109. 2.3/ceilometer- polling. log:2016- 06-06 08:53:05.924 10630 ERROR ceilometer. agent.manager File "/usr/lib/ python2. 7/dist- packages/ neutronclient/ v2_0/client. py", line 373, in list remote/ 10.109. 2.3/ceilometer- polling. log:2016- 06-06 08:53:05.924 10630 ERROR ceilometer. agent.manager for r in self._paginatio n(collection, path, **params):
/var/log/
/var/log/
/var/log/
/var/log/
/var/log/
/var/log/
/var/log/
/var/log/
/var/log/
/var/log/
/var/log/
/var/log/
/var/log/ remote/ node-3. test.domain. local/bootstrap /mcollective. log:2016- 06-05T21: 29:05.709647+ 00:00 err: 21:29:05.219092 #1484] ERROR -- : pluginmanager. rb:171: in `rescue in loadclass' Failed to load MCollective: :Agent: :Puppetd: cannot load such file -- puppet remote/ node-3. test.domain. local/bootstrap /mcollective. log:2016- 06-05T21: 29:05.709728+ 00:00 err: 21:29:05.219197 #1484] ERROR -- : agents.rb:71:in `rescue in loadagent' Loading agent puppetd failed: cannot load such file -- puppet remote/ node-3. test.domain. local/bootstrap /mcollective. log:2016- 06-05T21: 29:27.865469+ 00:00 err: 21:29:27.139772 #1795] ERROR -- : pluginmanager. rb:171: in `rescue in loadclass' Failed to load MCollective: :Agent: :Puppetd: cannot load such file -- puppet remote/ node-3. test.domain. local/bootstrap /mcollective. log:2016- 06-05T21: 29:27.865564+ 00:00 err: 21:29:27.139866 #1795] ERROR -- : agents.rb:71:in `rescue in loadagent' Loading agent puppetd failed: cannot load such file -- puppet shotgun. log:2016- 06-05 22:18:16 ERROR 11374 (manager) Clearing target failed. function: <built-in function listdir>, path: /var/dump, excinfo: (<type 'exceptions. OSError' >, OSError(2, 'No such file or directory'), <traceback object at 0x2e567e8>) shotgun. log:2016- 06-05 22:18:16 ERROR 11374 (manager) Clearing target failed. function: <built-in function rmdir>, path: /var/dump, excinfo: (<type 'exceptions. OSError' >, OSError(2, 'No such file or directory'), <traceback object at 0x2e56ea8>)
/var/log/
/var/log/
/var/log/
/var/log/
/var/log/
The problem is reproduced so far. Diagnostic snapshot from iso #443 is attached.
The other environments without MongoDB node are deployed without problems at the moment.