| 2015-06-24 12:23:52 |
Vasyl Saienko |
bug |
|
|
added bug |
| 2015-06-24 12:31:19 |
Vasyl Saienko |
affects |
mos |
fuel |
|
| 2015-06-24 12:31:19 |
Vasyl Saienko |
fuel: milestone |
7.0 |
|
|
| 2015-06-24 12:31:50 |
Vasyl Saienko |
fuel: assignee |
Fuel DevOps (fuel-devops) |
|
|
| 2015-06-24 12:32:49 |
Dmitry Mescheryakov |
fuel: assignee |
|
Fuel Library Team (fuel-library) |
|
| 2015-06-24 12:44:33 |
Bartłomiej Piotrowski |
fuel: status |
New |
Invalid |
|
| 2015-06-24 12:44:36 |
Bartłomiej Piotrowski |
fuel: milestone |
|
7.0 |
|
| 2015-06-24 12:54:46 |
Vasyl Saienko |
fuel: status |
Invalid |
New |
|
| 2015-06-24 12:55:08 |
Ivan Berezovskiy |
fuel: status |
New |
Confirmed |
|
| 2015-06-24 14:04:29 |
Oleksiy Molchanov |
fuel: assignee |
Fuel Library Team (fuel-library) |
MOS Linux (mos-linux) |
|
| 2015-06-24 14:52:19 |
Alexei Sheplyakov |
fuel: assignee |
MOS Linux (mos-linux) |
Fuel OSCI Team (fuel-osci) |
|
| 2015-06-24 15:04:28 |
Alexei Sheplyakov |
fuel: assignee |
Fuel OSCI Team (fuel-osci) |
Fuel provisioning team (fuel-provisioning) |
|
| 2015-06-24 15:18:06 |
Alexei Sheplyakov |
fuel: assignee |
Fuel provisioning team (fuel-provisioning) |
Fuel OSCI Team (fuel-osci) |
|
| 2015-06-24 15:18:46 |
Alexei Sheplyakov |
summary |
mcollective failed to start after deployment |
Wrong MOS 7.0 APT repo metadata => broken deployment |
|
| 2015-06-24 16:01:58 |
Alexei Sheplyakov |
description |
Provisioning stucked on 100%, then I tried to reset env, fuel can't reach to mcollective on server.
Then I've tried to start mcollective manually bu got error
root@nailgun log]# tail -f docker-logs/astute/astute.log
2015-06-24T12:09:00 debug: [684] Affected nodes: ["10.109.12.4", "10.109.12.3"]
2015-06-24T12:09:00 debug: [684] Retry result: success nodes: ["10.109.12.4", "10.109.12.3"], error nodes: [], inaccessible nodes: []
2015-06-24T12:09:00 info: [684] 443e7750-109e-491b-b9d3-5c24f4db2e1d: Finished running shell command: ["1", "2"]
2015-06-24T12:09:10 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:22 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:34 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:46 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:58 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:10 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:22 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:34 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:46 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:58 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:11:00 debug: [684] MCO final result: mco success nodes: , mco error nodes: , mco inaccessible nodes: , all mco nodes: []
2015-06-24T12:11:00 info: [684] Casting message to Nailgun: {"method"=>"stop_deployment_resp", "args"=>{"task_uuid"=>"443e7750-109e-491b-b9d3-5c24f4db2e1d", "status"=>"ready", "progress"=>100, "nodes"=>[{"uid"=>"1"}, {"uid"=>"2"}], "error_nodes"=>[], "inaccessible_nodes"=>[]}}
root@node-1:~# mcollectived
/usr/lib/ruby/vendor_ruby/mcollective/pluginmanager.rb:169:in `load': cannot load such file -- mcollective/connector/rabbitmq.rb (LoadError)
from /usr/lib/ruby/vendor_ruby/mcollective/pluginmanager.rb:169:in `loadclass'
from /usr/lib/ruby/vendor_ruby/mcollective/config.rb:128:in `loadconfig'
from /usr/sbin/mcollectived:29:in `<main>'
Indeed rabbitmq.rb is missed:
root@node-1:~# ls /usr/lib/ruby/vendor_ruby/mcollective/connector/
base.rb
[root@nailgun log]# fuel --f
DEPRECATION WARNING: /etc/fuel/client/config.yaml exists and will be used as the source for settings. This behavior is deprecated. Please specify the path to your custom settings file in the FUELCLIENT_CUSTOM_SETTINGS environment variable.
api: '1.0'
astute_sha: 776157f722b13aff5f59bc098cf948793e6498ef
auth_required: true
build_id: 2015-06-15_23-35-25
build_number: '1'
feature_groups:
- mirantis
fuel-library_sha: 7e10ed56bc66a8b4a180ff763d6512e6dcc0ba41
fuel-ostf_sha: bac04dccb22a1b247a607b618ccc96c6fcdef2c8
fuelmain_sha: 41942867e9348ba2e18b49837051b4549342e8da
nailgun_sha: 81cc5db978eff19271512266ce23143b229ef4d8
openstack_version: 2014.2.2-7.0
production: docker
python-fuelclient_sha: 8e221ab4b1565fc03382debfff1096768170362c
release: '7.0'
release_versions:
2014.2.2-7.0:
VERSION:
api: '1.0'
astute_sha: 776157f722b13aff5f59bc098cf948793e6498ef
build_id: 2015-06-15_23-35-25
build_number: '1'
feature_groups:
- mirantis
fuel-library_sha: 7e10ed56bc66a8b4a180ff763d6512e6dcc0ba41
fuel-ostf_sha: bac04dccb22a1b247a607b618ccc96c6fcdef2c8
fuelmain_sha: 41942867e9348ba2e18b49837051b4549342e8da
nailgun_sha: 81cc5db978eff19271512266ce23143b229ef4d8
openstack_version: 2014.2.2-7.0
production: docker
python-fuelclient_sha: 8e221ab4b1565fc03382debfff1096768170362c
release: '7.0' |
The Release file [1] in MOS 7.0 APT repo is invalid. In particular Codename is wrong: it should be mos7.0, and actually it's mos6.1.
This breaks the provisioning/deployment logic which installs the packages from the *current* MOS release (i.e. mos7.0), not from the previous one (mos6.1).
Symptoms: provisioning stucked on 100%, then I tried to reset env, fuel can't reach to mcollective on server.
Then I've tried to start mcollective manually bu got error
root@nailgun log]# tail -f docker-logs/astute/astute.log
2015-06-24T12:09:00 debug: [684] Affected nodes: ["10.109.12.4", "10.109.12.3"]
2015-06-24T12:09:00 debug: [684] Retry result: success nodes: ["10.109.12.4", "10.109.12.3"], error nodes: [], inaccessible nodes: []
2015-06-24T12:09:00 info: [684] 443e7750-109e-491b-b9d3-5c24f4db2e1d: Finished running shell command: ["1", "2"]
2015-06-24T12:09:10 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:22 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:34 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:46 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:58 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:10 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:22 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:34 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:46 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:58 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:11:00 debug: [684] MCO final result: mco success nodes: , mco error nodes: , mco inaccessible nodes: , all mco nodes: []
2015-06-24T12:11:00 info: [684] Casting message to Nailgun: {"method"=>"stop_deployment_resp", "args"=>{"task_uuid"=>"443e7750-109e-491b-b9d3-5c24f4db2e1d", "status"=>"ready", "progress"=>100, "nodes"=>[{"uid"=>"1"}, {"uid"=>"2"}], "error_nodes"=>[], "inaccessible_nodes"=>[]}}
root@node-1:~# mcollectived
/usr/lib/ruby/vendor_ruby/mcollective/pluginmanager.rb:169:in `load': cannot load such file -- mcollective/connector/rabbitmq.rb (LoadError)
from /usr/lib/ruby/vendor_ruby/mcollective/pluginmanager.rb:169:in `loadclass'
from /usr/lib/ruby/vendor_ruby/mcollective/config.rb:128:in `loadconfig'
from /usr/sbin/mcollectived:29:in `<main>'
Indeed rabbitmq.rb is missed:
root@node-1:~# ls /usr/lib/ruby/vendor_ruby/mcollective/connector/
base.rb
[root@nailgun log]# fuel --f
DEPRECATION WARNING: /etc/fuel/client/config.yaml exists and will be used as the source for settings. This behavior is deprecated. Please specify the path to your custom settings file in the FUELCLIENT_CUSTOM_SETTINGS environment variable.
api: '1.0'
astute_sha: 776157f722b13aff5f59bc098cf948793e6498ef
auth_required: true
build_id: 2015-06-15_23-35-25
build_number: '1'
feature_groups:
- mirantis
fuel-library_sha: 7e10ed56bc66a8b4a180ff763d6512e6dcc0ba41
fuel-ostf_sha: bac04dccb22a1b247a607b618ccc96c6fcdef2c8
fuelmain_sha: 41942867e9348ba2e18b49837051b4549342e8da
nailgun_sha: 81cc5db978eff19271512266ce23143b229ef4d8
openstack_version: 2014.2.2-7.0
production: docker
python-fuelclient_sha: 8e221ab4b1565fc03382debfff1096768170362c
release: '7.0'
release_versions:
2014.2.2-7.0:
VERSION:
api: '1.0'
astute_sha: 776157f722b13aff5f59bc098cf948793e6498ef
build_id: 2015-06-15_23-35-25
build_number: '1'
feature_groups:
- mirantis
fuel-library_sha: 7e10ed56bc66a8b4a180ff763d6512e6dcc0ba41
fuel-ostf_sha: bac04dccb22a1b247a607b618ccc96c6fcdef2c8
fuelmain_sha: 41942867e9348ba2e18b49837051b4549342e8da
nailgun_sha: 81cc5db978eff19271512266ce23143b229ef4d8
openstack_version: 2014.2.2-7.0
production: docker
python-fuelclient_sha: 8e221ab4b1565fc03382debfff1096768170362c
release: '7.0' |
|
| 2015-06-24 16:02:25 |
Alexei Sheplyakov |
description |
The Release file [1] in MOS 7.0 APT repo is invalid. In particular Codename is wrong: it should be mos7.0, and actually it's mos6.1.
This breaks the provisioning/deployment logic which installs the packages from the *current* MOS release (i.e. mos7.0), not from the previous one (mos6.1).
Symptoms: provisioning stucked on 100%, then I tried to reset env, fuel can't reach to mcollective on server.
Then I've tried to start mcollective manually bu got error
root@nailgun log]# tail -f docker-logs/astute/astute.log
2015-06-24T12:09:00 debug: [684] Affected nodes: ["10.109.12.4", "10.109.12.3"]
2015-06-24T12:09:00 debug: [684] Retry result: success nodes: ["10.109.12.4", "10.109.12.3"], error nodes: [], inaccessible nodes: []
2015-06-24T12:09:00 info: [684] 443e7750-109e-491b-b9d3-5c24f4db2e1d: Finished running shell command: ["1", "2"]
2015-06-24T12:09:10 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:22 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:34 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:46 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:58 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:10 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:22 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:34 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:46 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:58 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:11:00 debug: [684] MCO final result: mco success nodes: , mco error nodes: , mco inaccessible nodes: , all mco nodes: []
2015-06-24T12:11:00 info: [684] Casting message to Nailgun: {"method"=>"stop_deployment_resp", "args"=>{"task_uuid"=>"443e7750-109e-491b-b9d3-5c24f4db2e1d", "status"=>"ready", "progress"=>100, "nodes"=>[{"uid"=>"1"}, {"uid"=>"2"}], "error_nodes"=>[], "inaccessible_nodes"=>[]}}
root@node-1:~# mcollectived
/usr/lib/ruby/vendor_ruby/mcollective/pluginmanager.rb:169:in `load': cannot load such file -- mcollective/connector/rabbitmq.rb (LoadError)
from /usr/lib/ruby/vendor_ruby/mcollective/pluginmanager.rb:169:in `loadclass'
from /usr/lib/ruby/vendor_ruby/mcollective/config.rb:128:in `loadconfig'
from /usr/sbin/mcollectived:29:in `<main>'
Indeed rabbitmq.rb is missed:
root@node-1:~# ls /usr/lib/ruby/vendor_ruby/mcollective/connector/
base.rb
[root@nailgun log]# fuel --f
DEPRECATION WARNING: /etc/fuel/client/config.yaml exists and will be used as the source for settings. This behavior is deprecated. Please specify the path to your custom settings file in the FUELCLIENT_CUSTOM_SETTINGS environment variable.
api: '1.0'
astute_sha: 776157f722b13aff5f59bc098cf948793e6498ef
auth_required: true
build_id: 2015-06-15_23-35-25
build_number: '1'
feature_groups:
- mirantis
fuel-library_sha: 7e10ed56bc66a8b4a180ff763d6512e6dcc0ba41
fuel-ostf_sha: bac04dccb22a1b247a607b618ccc96c6fcdef2c8
fuelmain_sha: 41942867e9348ba2e18b49837051b4549342e8da
nailgun_sha: 81cc5db978eff19271512266ce23143b229ef4d8
openstack_version: 2014.2.2-7.0
production: docker
python-fuelclient_sha: 8e221ab4b1565fc03382debfff1096768170362c
release: '7.0'
release_versions:
2014.2.2-7.0:
VERSION:
api: '1.0'
astute_sha: 776157f722b13aff5f59bc098cf948793e6498ef
build_id: 2015-06-15_23-35-25
build_number: '1'
feature_groups:
- mirantis
fuel-library_sha: 7e10ed56bc66a8b4a180ff763d6512e6dcc0ba41
fuel-ostf_sha: bac04dccb22a1b247a607b618ccc96c6fcdef2c8
fuelmain_sha: 41942867e9348ba2e18b49837051b4549342e8da
nailgun_sha: 81cc5db978eff19271512266ce23143b229ef4d8
openstack_version: 2014.2.2-7.0
production: docker
python-fuelclient_sha: 8e221ab4b1565fc03382debfff1096768170362c
release: '7.0' |
The Release file http://mirror.fuel-infra.org/mos/ubuntu/dists/mos7.0/Release in MOS 7.0 APT repo is invalid. In particular Codename is wrong: it should be mos7.0, and actually it's mos6.1.
This breaks the provisioning/deployment logic which installs the packages from the *current* MOS release (i.e. mos7.0), not from the previous one (mos6.1).
Symptoms: provisioning stucked on 100%, then I tried to reset env, fuel can't reach to mcollective on server.
Then I've tried to start mcollective manually bu got error
root@nailgun log]# tail -f docker-logs/astute/astute.log
2015-06-24T12:09:00 debug: [684] Affected nodes: ["10.109.12.4", "10.109.12.3"]
2015-06-24T12:09:00 debug: [684] Retry result: success nodes: ["10.109.12.4", "10.109.12.3"], error nodes: [], inaccessible nodes: []
2015-06-24T12:09:00 info: [684] 443e7750-109e-491b-b9d3-5c24f4db2e1d: Finished running shell command: ["1", "2"]
2015-06-24T12:09:10 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:22 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:34 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:46 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:09:58 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:10 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:22 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:34 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:46 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:10:58 debug: [684] Trying to connect to nodes ["1", "2"] using mcollective
2015-06-24T12:11:00 debug: [684] MCO final result: mco success nodes: , mco error nodes: , mco inaccessible nodes: , all mco nodes: []
2015-06-24T12:11:00 info: [684] Casting message to Nailgun: {"method"=>"stop_deployment_resp", "args"=>{"task_uuid"=>"443e7750-109e-491b-b9d3-5c24f4db2e1d", "status"=>"ready", "progress"=>100, "nodes"=>[{"uid"=>"1"}, {"uid"=>"2"}], "error_nodes"=>[], "inaccessible_nodes"=>[]}}
root@node-1:~# mcollectived
/usr/lib/ruby/vendor_ruby/mcollective/pluginmanager.rb:169:in `load': cannot load such file -- mcollective/connector/rabbitmq.rb (LoadError)
from /usr/lib/ruby/vendor_ruby/mcollective/pluginmanager.rb:169:in `loadclass'
from /usr/lib/ruby/vendor_ruby/mcollective/config.rb:128:in `loadconfig'
from /usr/sbin/mcollectived:29:in `<main>'
Indeed rabbitmq.rb is missed:
root@node-1:~# ls /usr/lib/ruby/vendor_ruby/mcollective/connector/
base.rb
[root@nailgun log]# fuel --f
DEPRECATION WARNING: /etc/fuel/client/config.yaml exists and will be used as the source for settings. This behavior is deprecated. Please specify the path to your custom settings file in the FUELCLIENT_CUSTOM_SETTINGS environment variable.
api: '1.0'
astute_sha: 776157f722b13aff5f59bc098cf948793e6498ef
auth_required: true
build_id: 2015-06-15_23-35-25
build_number: '1'
feature_groups:
- mirantis
fuel-library_sha: 7e10ed56bc66a8b4a180ff763d6512e6dcc0ba41
fuel-ostf_sha: bac04dccb22a1b247a607b618ccc96c6fcdef2c8
fuelmain_sha: 41942867e9348ba2e18b49837051b4549342e8da
nailgun_sha: 81cc5db978eff19271512266ce23143b229ef4d8
openstack_version: 2014.2.2-7.0
production: docker
python-fuelclient_sha: 8e221ab4b1565fc03382debfff1096768170362c
release: '7.0'
release_versions:
2014.2.2-7.0:
VERSION:
api: '1.0'
astute_sha: 776157f722b13aff5f59bc098cf948793e6498ef
build_id: 2015-06-15_23-35-25
build_number: '1'
feature_groups:
- mirantis
fuel-library_sha: 7e10ed56bc66a8b4a180ff763d6512e6dcc0ba41
fuel-ostf_sha: bac04dccb22a1b247a607b618ccc96c6fcdef2c8
fuelmain_sha: 41942867e9348ba2e18b49837051b4549342e8da
nailgun_sha: 81cc5db978eff19271512266ce23143b229ef4d8
openstack_version: 2014.2.2-7.0
production: docker
python-fuelclient_sha: 8e221ab4b1565fc03382debfff1096768170362c
release: '7.0' |
|
| 2015-06-26 07:41:46 |
Bartłomiej Piotrowski |
fuel: status |
Confirmed |
Triaged |
|
| 2015-07-08 07:48:36 |
Vasyl Saienko |
fuel: status |
Triaged |
Fix Committed |
|
| 2015-07-08 07:48:40 |
Vasyl Saienko |
fuel: status |
Fix Committed |
Fix Released |
|
| 2017-04-13 23:03:15 |
Curtis Hovey |
fuel: assignee |
Registry Administrators (registry) |
|
|
