Activity log for bug #1523449

Date Who What changed Old value New value Message
2015-12-07 11:02:46 Vitaly Gusev bug added bug
2015-12-07 11:02:46 Vitaly Gusev attachment added fuel-snapshot-2015-12-06_23-46-59.tar.xz https://bugs.launchpad.net/bugs/1523449/+attachment/4530904/+files/fuel-snapshot-2015-12-06_23-46-59.tar.xz
2015-12-07 11:51:46 Vitaly Gusev description VERSION: feature_groups: - mirantis production: "docker" release: "8.0" openstack_version: "2015.1.0-8.0" api: "1.0" build_number: "263" build_id: "263" fuel-nailgun_sha: "0e09dce510927f2cc490b898e5fe3f813bd791be" python-fuelclient_sha: "f033192b84263f0e699458a4274289a5198ae7e4" fuel-agent_sha: "660c6514caa8f5fcd482f1cc4008a6028243e009" fuel-nailgun-agent_sha: "a33a58d378c117c0f509b0e7badc6f0910364154" astute_sha: "48fd58676debcc85951db68df6d77c22daa55e52" fuel-library_sha: "ab7e51f345ffb7c256e0f61addcf86553d7c3867" fuel-ostf_sha: "23b7ae2a1a57de5a3e1861ffb7805394ca339cc2" fuel-mirror_sha: "6534117233a5bdc51d7d47361bc7d511e4b11e6f" fuelmenu_sha: "fcb15df4fd1a790b17dd78cf675c11c279040941" shotgun_sha: "a0bd06508067935f2ae9be2523ed0d1717b995ce" network-checker_sha: "a3534f8885246afb15609c54f91d3b23d599a5b1" fuel-upgrade_sha: "1e894e26d4e1423a9b0d66abd6a79505f4175ff6" fuelmain_sha: "26adf12c320936a97a9b0a84169a6e58c530e848" Bug reproduced here: https://product-ci.infra.mirantis.net/view/8.0_swarm/job/8.0.system_test.ubuntu.services_ha.ceilometer/66/console Steps to reproduce: 1. Create env with parameters: 3 controller + mongo, 1 compute, 1 cinder; Cinder LVM; hypervisor KVM 2. Start deploy Expected result: Deployment finished successfully. Actual result: Deployment failed. In Astute log we can see these errors: 2015-12-06 23:35:09 ERR 2015-12-06T23:35:09.534+0000 Error: couldn't connect to server 127.0.0.1:27017 (127.0.0.1), connection attempt failed at src/mongo/shell/mongo.js:148 2015-12-06 23:35:09 ERR Could not prefetch mongodb_replset provider 'mongodb': Execution of '/usr/bin/mongo --quiet --host 127.0.0.1:27017 --eval load('/root/.mongorc.js'); printjson(rs.conf())' returned 1: 2015-12-06T23:35:09.533+0000 warning: Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused 2015-12-06 23:35:09 ERR (/Stage[main]/Mongodb::Server::Service/Mongodb_conn_validator[mongodb]/ensure) change from absent to present failed: Unable to connect to mongodb server! (127.0.0.1:27017) https://paste.mirantis.net/show/1540/ In /var/log/mongod.log we can see this error: <14>Dec 7 00:01:11 node-1 mongod.27017[15164]: invalid char in key file /etc/mongodb.key: ' Output of the /etc/mongodb.key file: https://paste.mirantis.net/show/1541/ Looks like that root cause is in incorrect mongodb key. VERSION:   feature_groups:     - mirantis   production: "docker"   release: "8.0"   openstack_version: "2015.1.0-8.0"   api: "1.0"   build_number: "263"   build_id: "263"   fuel-nailgun_sha: "0e09dce510927f2cc490b898e5fe3f813bd791be"   python-fuelclient_sha: "f033192b84263f0e699458a4274289a5198ae7e4"   fuel-agent_sha: "660c6514caa8f5fcd482f1cc4008a6028243e009"   fuel-nailgun-agent_sha: "a33a58d378c117c0f509b0e7badc6f0910364154"   astute_sha: "48fd58676debcc85951db68df6d77c22daa55e52"   fuel-library_sha: "ab7e51f345ffb7c256e0f61addcf86553d7c3867"   fuel-ostf_sha: "23b7ae2a1a57de5a3e1861ffb7805394ca339cc2"   fuel-mirror_sha: "6534117233a5bdc51d7d47361bc7d511e4b11e6f"   fuelmenu_sha: "fcb15df4fd1a790b17dd78cf675c11c279040941"   shotgun_sha: "a0bd06508067935f2ae9be2523ed0d1717b995ce"   network-checker_sha: "a3534f8885246afb15609c54f91d3b23d599a5b1"   fuel-upgrade_sha: "1e894e26d4e1423a9b0d66abd6a79505f4175ff6"   fuelmain_sha: "26adf12c320936a97a9b0a84169a6e58c530e848" Bug reproduced here: https://product-ci.infra.mirantis.net/view/8.0_swarm/job/8.0.system_test.ubuntu.services_ha.ceilometer/66/console Steps to reproduce: 1. Create env with parameters: 3 controller + mongo, 1 compute, 1 cinder; Cinder LVM; hypervisor KVM; Neutron VXLAN 2. Start deploy Expected result: Deployment finished successfully. Actual result: Deployment failed. In Astute log we can see these errors: 2015-12-06 23:35:09 ERR 2015-12-06T23:35:09.534+0000 Error: couldn't connect to server 127.0.0.1:27017 (127.0.0.1), connection attempt failed at src/mongo/shell/mongo.js:148 2015-12-06 23:35:09 ERR Could not prefetch mongodb_replset provider 'mongodb': Execution of '/usr/bin/mongo --quiet --host 127.0.0.1:27017 --eval load('/root/.mongorc.js'); printjson(rs.conf())' returned 1: 2015-12-06T23:35:09.533+0000 warning: Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused 2015-12-06 23:35:09 ERR (/Stage[main]/Mongodb::Server::Service/Mongodb_conn_validator[mongodb]/ensure) change from absent to present failed: Unable to connect to mongodb server! (127.0.0.1:27017) https://paste.mirantis.net/show/1540/ In /var/log/mongod.log we can see this error: <14>Dec 7 00:01:11 node-1 mongod.27017[15164]: invalid char in key file /etc/mongodb.key: ' Output of the /etc/mongodb.key file: https://paste.mirantis.net/show/1541/ Looks like that root cause is in incorrect mongodb key.
2015-12-07 20:22:03 Roman Prykhodchenko description VERSION:   feature_groups:     - mirantis   production: "docker"   release: "8.0"   openstack_version: "2015.1.0-8.0"   api: "1.0"   build_number: "263"   build_id: "263"   fuel-nailgun_sha: "0e09dce510927f2cc490b898e5fe3f813bd791be"   python-fuelclient_sha: "f033192b84263f0e699458a4274289a5198ae7e4"   fuel-agent_sha: "660c6514caa8f5fcd482f1cc4008a6028243e009"   fuel-nailgun-agent_sha: "a33a58d378c117c0f509b0e7badc6f0910364154"   astute_sha: "48fd58676debcc85951db68df6d77c22daa55e52"   fuel-library_sha: "ab7e51f345ffb7c256e0f61addcf86553d7c3867"   fuel-ostf_sha: "23b7ae2a1a57de5a3e1861ffb7805394ca339cc2"   fuel-mirror_sha: "6534117233a5bdc51d7d47361bc7d511e4b11e6f"   fuelmenu_sha: "fcb15df4fd1a790b17dd78cf675c11c279040941"   shotgun_sha: "a0bd06508067935f2ae9be2523ed0d1717b995ce"   network-checker_sha: "a3534f8885246afb15609c54f91d3b23d599a5b1"   fuel-upgrade_sha: "1e894e26d4e1423a9b0d66abd6a79505f4175ff6"   fuelmain_sha: "26adf12c320936a97a9b0a84169a6e58c530e848" Bug reproduced here: https://product-ci.infra.mirantis.net/view/8.0_swarm/job/8.0.system_test.ubuntu.services_ha.ceilometer/66/console Steps to reproduce: 1. Create env with parameters: 3 controller + mongo, 1 compute, 1 cinder; Cinder LVM; hypervisor KVM; Neutron VXLAN 2. Start deploy Expected result: Deployment finished successfully. Actual result: Deployment failed. In Astute log we can see these errors: 2015-12-06 23:35:09 ERR 2015-12-06T23:35:09.534+0000 Error: couldn't connect to server 127.0.0.1:27017 (127.0.0.1), connection attempt failed at src/mongo/shell/mongo.js:148 2015-12-06 23:35:09 ERR Could not prefetch mongodb_replset provider 'mongodb': Execution of '/usr/bin/mongo --quiet --host 127.0.0.1:27017 --eval load('/root/.mongorc.js'); printjson(rs.conf())' returned 1: 2015-12-06T23:35:09.533+0000 warning: Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused 2015-12-06 23:35:09 ERR (/Stage[main]/Mongodb::Server::Service/Mongodb_conn_validator[mongodb]/ensure) change from absent to present failed: Unable to connect to mongodb server! (127.0.0.1:27017) https://paste.mirantis.net/show/1540/ In /var/log/mongod.log we can see this error: <14>Dec 7 00:01:11 node-1 mongod.27017[15164]: invalid char in key file /etc/mongodb.key: ' Output of the /etc/mongodb.key file: https://paste.mirantis.net/show/1541/ Looks like that root cause is in incorrect mongodb key. Bug reproduced here: https://product-ci.infra.mirantis.net/view/8.0_swarm/job/8.0.system_test.ubuntu.services_ha.ceilometer/66/console Steps to reproduce: 1. Create env with parameters: 3 controller + mongo, 1 compute, 1 cinder; Cinder LVM; hypervisor KVM; Neutron VXLAN 2. Start deploy Expected result: Deployment finished successfully. Actual result: Deployment failed. In Astute log we can see these errors: 2015-12-06 23:35:09 ERR 2015-12-06T23:35:09.534+0000 Error: couldn't connect to server 127.0.0.1:27017 (127.0.0.1), connection attempt failed at src/mongo/shell/mongo.js:148 2015-12-06 23:35:09 ERR Could not prefetch mongodb_replset provider 'mongodb': Execution of '/usr/bin/mongo --quiet --host 127.0.0.1:27017 --eval load('/root/.mongorc.js'); printjson(rs.conf())' returned 1: 2015-12-06T23:35:09.533+0000 warning: Failed to connect to 127.0.0.1:27017, reason: errno:111 Connection refused 2015-12-06 23:35:09 ERR (/Stage[main]/Mongodb::Server::Service/Mongodb_conn_validator[mongodb]/ensure) change from absent to present failed: Unable to connect to mongodb server! (127.0.0.1:27017) https://paste.mirantis.net/show/1540/ In /var/log/mongod.log we can see this error: <14>Dec 7 00:01:11 node-1 mongod.27017[15164]: invalid char in key file /etc/mongodb.key: ' Output of the /etc/mongodb.key file: https://paste.mirantis.net/show/1541/ Looks like that root cause is in incorrect mongodb key. VERSION: feature_groups: - mirantis production: "docker" release: "8.0" openstack_version: "2015.1.0-8.0" api: "1.0" build_number: "263" build_id: "263" fuel-nailgun_sha: "0e09dce510927f2cc490b898e5fe3f813bd791be" python-fuelclient_sha: "f033192b84263f0e699458a4274289a5198ae7e4" fuel-agent_sha: "660c6514caa8f5fcd482f1cc4008a6028243e009" fuel-nailgun-agent_sha: "a33a58d378c117c0f509b0e7badc6f0910364154" astute_sha: "48fd58676debcc85951db68df6d77c22daa55e52" fuel-library_sha: "ab7e51f345ffb7c256e0f61addcf86553d7c3867" fuel-ostf_sha: "23b7ae2a1a57de5a3e1861ffb7805394ca339cc2" fuel-mirror_sha: "6534117233a5bdc51d7d47361bc7d511e4b11e6f" fuelmenu_sha: "fcb15df4fd1a790b17dd78cf675c11c279040941" shotgun_sha: "a0bd06508067935f2ae9be2523ed0d1717b995ce" network-checker_sha: "a3534f8885246afb15609c54f91d3b23d599a5b1" fuel-upgrade_sha: "1e894e26d4e1423a9b0d66abd6a79505f4175ff6" fuelmain_sha: "26adf12c320936a97a9b0a84169a6e58c530e848"
2015-12-07 20:22:07 Roman Prykhodchenko fuel: status New Confirmed
2015-12-07 20:23:08 Roman Prykhodchenko tags ceilometer area-devops ceilometer
2015-12-07 20:23:17 Roman Prykhodchenko fuel: assignee Fuel Python Team (fuel-python) Fuel Library Team (fuel-library)
2015-12-08 08:29:13 Veronica Krayneva bug added subscriber Veronica Krayneva
2015-12-08 10:09:03 Matthew Mosesohn fuel: assignee Fuel Library Team (fuel-library) Stanislaw Bogatkin (sbogatkin)
2015-12-08 10:48:33 Veronica Krayneva tags area-devops ceilometer area-devops ceilometer swarm-blocker
2015-12-08 14:43:46 OpenStack Infra fuel: status Confirmed In Progress
2015-12-09 12:56:56 Ksenia Svechnikova bug added subscriber Ksenia Demina
2015-12-09 15:32:00 OpenStack Infra fuel: status In Progress Fix Released
2015-12-09 18:15:11 Nastya Urlapova fuel: status Fix Released Fix Committed
2015-12-10 09:54:21 Vitaly Gusev fuel: status Fix Committed Fix Released
2015-12-11 04:29:00 Nastya Urlapova fuel: status Fix Released Fix Committed
2015-12-11 07:49:32 Vitaly Gusev fuel: status Fix Committed Fix Released