Activity log for bug #1465840

Date Who What changed Old value New value Message
2015-06-16 20:21:44 Tatyanka bug added bug
2015-06-16 20:27:37 Tatyanka description Delete stack failed with next error: http://paste.openstack.org/show/296169/, at the same time other services (like nova on command nova delete instance_uuid works fine) haproxy status for heat: # pxname svname stot ereq econ eresp status chkfail chkdown downtime iid heat-api FRONTEND 0 0 OPEN 16 heat-api node-76 0 0 0 UP 0 0 0 16 heat-api node-77 0 0 0 UP 0 0 0 16 heat-api node-79 0 0 0 UP 0 0 0 16 heat-api BACKEND 0 0 0 UP 0 0 16 heat-api-cfn FRONTEND 0 0 OPEN 17 heat-api-cfn node-76 0 0 0 UP 0 0 0 17 heat-api-cfn node-77 0 0 0 UP 0 0 0 17 heat-api-cfn node-79 0 0 0 UP 0 0 0 17 heat-api-cfn BACKEND 0 0 0 UP 0 0 17 heat-api-cloudwatch FRONTEND 0 0 OPEN 18 heat-api-cloudwatch node-76 0 0 0 UP 0 0 0 18 heat-api-cloudwatch node-77 0 0 0 UP 0 0 0 18 heat-api-cloudwatch node-79 0 0 0 UP 0 0 0 18 heat-api-cloudwatch BACKEND 0 0 0 UP 0 0 18 crm status http://paste.openstack.org/show/296170/ Steps to Reproduce: Os: Centos HA wit neutro gre: 1 controller + 2 controller with mongo 1 mongo 1 cinder 2 omputes Ceilometer enabled 1.Deploy cluster, when cluster is ready 2. Navigate to fuel health tab and run all ostf tests - ha, smoke. sanity, platfrom tests are passed (configuration may fail if you do not change default cread for ssh on master node and user cred to openstack cluster) 3. Shutdown primary controller 4. wait 5 minutes - run ostf ha suit (it passed, if not you may need to wait for a liitle bit more and run again) 5. run smoke, sanity OSTF tests - they are passed 6. Run platfrom tests - Actual result all heat test failed (update/ create/ delete stack) with 504 error 7. turn on controller - repeat step 4-6 - result is the same all heat tests are failed ssh to each controller and try to delete stack - failed with error listed about {"build_id": "2015-06-08_06-13-27", "build_number": "521", "release_versions": {"2014.2.2-6.1": {"VERSION": {"build_id": "2015-06-08_06-13-27", "build_number": "521", "api": "1.0", "fuel-library_sha": "f43c2ae1af3b493ee0e7810eab7bb7b50c986c7d", "nailgun_sha": "4340d55c19029394cd5610b0e0f56d6cb8cb661b", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha": "4fc55db0265bbf39c369df398b9dc7d6469ba13b", "astute_sha": "7766818f079881e2dbeedb34e1f67e517ed7d479", "fuel-ostf_sha": "7c938648a246e0311d05e2372ff43ef1eb2e2761", "release": "6.1", "fuelmain_sha": "bcc909ffc5dd5156ba54cae348b6a07c1b607b24"}}}, "auth_required": true, "api": "1.0", "fuel-library_sha": "f43c2ae1af3b493ee0e7810eab7bb7b50c986c7d", "nailgun_sha": "4340d55c19029394cd5610b0e0f56d6cb8cb661b", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha": "4fc55db0265bbf39c369df398b9dc7d6469ba13b", "astute_sha": "7766818f079881e2dbeedb34e1f67e517ed7d479", "fuel-ostf_sha": "7c938648a246e0311d05e2372ff43ef1eb2e2761", "release": "6.1", "fuelmain_sha": "bcc909ffc5dd5156ba54cae348b6a07c1b607b24"} Second env: UBUNTU 3 controllers with ceph + 1 compute + 2 mongo + 2 ceph with nova Flat 1. Deploy cluster 2. When cluster ready - run ostf ha, smoke, sanity, platfrom tests - tests are passed 3. shutdown non-primary controller 4. wait near 5-7 minutes and run ostf ha - passed 5. run sanity/ smoke - passed 6. run platform tests - heat tests are failed with 504 error 7. ssh to online controllers and try to create and delete stack - failed with 504 error Info: Add snapshot later according it is to big and to slow uploading in google drive Delete stack failed with next error: http://paste.openstack.org/show/296169/, at the same time other services (like nova on command nova delete instance_uuid works fine) haproxy status for heat:       # pxname svname stot ereq econ eresp status chkfail chkdown downtime iid       heat-api FRONTEND 0 0 OPEN 16       heat-api node-76 0 0 0 UP 0 0 0 16       heat-api node-77 0 0 0 UP 0 0 0 16       heat-api node-79 0 0 0 UP 0 0 0 16       heat-api BACKEND 0 0 0 UP 0 0 16   heat-api-cfn FRONTEND 0 0 OPEN 17   heat-api-cfn node-76 0 0 0 UP 0 0 0 17   heat-api-cfn node-77 0 0 0 UP 0 0 0 17   heat-api-cfn node-79 0 0 0 UP 0 0 0 17   heat-api-cfn BACKEND 0 0 0 UP 0 0 17 heat-api-cloudwatch FRONTEND 0 0 OPEN 18 heat-api-cloudwatch node-76 0 0 0 UP 0 0 0 18 heat-api-cloudwatch node-77 0 0 0 UP 0 0 0 18 heat-api-cloudwatch node-79 0 0 0 UP 0 0 0 18 heat-api-cloudwatch BACKEND 0 0 0 UP 0 0 18 crm status http://paste.openstack.org/show/296170/ Steps to Reproduce: Os: Centos HA wit neutro gre: 1 controller + 2 controller with mongo 1 mongo 1 cinder 2 omputes Ceilometer enabled 1.Deploy cluster, when cluster is ready 2. Navigate to fuel health tab and run all ostf tests - ha, smoke. sanity, platfrom tests are passed (configuration may fail if you do not change default cread for ssh on master node and user cred to openstack cluster) 3. Shutdown primary controller 4. wait 5 minutes - run ostf ha suit (it passed, if not you may need to wait for a liitle bit more and run again) 5. run smoke, sanity OSTF tests - they are passed 6. Run platfrom tests - Actual result all heat test failed (update/ create/ delete stack) with 504 error 7. turn on controller - repeat step 4-6 - result is the same all heat tests are failed ssh to each controller and try to delete stack - failed with error listed about {"build_id": "2015-06-08_06-13-27", "build_number": "521", "release_versions": {"2014.2.2-6.1": {"VERSION": {"build_id": "2015-06-08_06-13-27", "build_number": "521", "api": "1.0", "fuel-library_sha": "f43c2ae1af3b493ee0e7810eab7bb7b50c986c7d", "nailgun_sha": "4340d55c19029394cd5610b0e0f56d6cb8cb661b", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha": "4fc55db0265bbf39c369df398b9dc7d6469ba13b", "astute_sha": "7766818f079881e2dbeedb34e1f67e517ed7d479", "fuel-ostf_sha": "7c938648a246e0311d05e2372ff43ef1eb2e2761", "release": "6.1", "fuelmain_sha": "bcc909ffc5dd5156ba54cae348b6a07c1b607b24"}}}, "auth_required": true, "api": "1.0", "fuel-library_sha": "f43c2ae1af3b493ee0e7810eab7bb7b50c986c7d", "nailgun_sha": "4340d55c19029394cd5610b0e0f56d6cb8cb661b", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha": "4fc55db0265bbf39c369df398b9dc7d6469ba13b", "astute_sha": "7766818f079881e2dbeedb34e1f67e517ed7d479", "fuel-ostf_sha": "7c938648a246e0311d05e2372ff43ef1eb2e2761", "release": "6.1", "fuelmain_sha": "bcc909ffc5dd5156ba54cae348b6a07c1b607b24"} Second env: UBUNTU 3 controllers with ceph + 1 compute + 2 mongo + 2 ceph with nova Flat 1. Deploy cluster 2. When cluster ready - run ostf ha, smoke, sanity, platfrom tests - tests are passed 3. shutdown non-primary controller 4. wait near 5-7 minutes and run ostf ha - passed 5. run sanity/ smoke - passed 6. run platform tests - heat tests are failed with 504 error 7. ssh to online controllers and try to create and delete stack - failed with 504 error Info: Add snapshot later according it is to big and to slow uploading in google drive Info: issue do not reproduce each time, for now 2 from 5
2015-06-17 03:27:09 Timur Nurlygayanov description Delete stack failed with next error: http://paste.openstack.org/show/296169/, at the same time other services (like nova on command nova delete instance_uuid works fine) haproxy status for heat:       # pxname svname stot ereq econ eresp status chkfail chkdown downtime iid       heat-api FRONTEND 0 0 OPEN 16       heat-api node-76 0 0 0 UP 0 0 0 16       heat-api node-77 0 0 0 UP 0 0 0 16       heat-api node-79 0 0 0 UP 0 0 0 16       heat-api BACKEND 0 0 0 UP 0 0 16   heat-api-cfn FRONTEND 0 0 OPEN 17   heat-api-cfn node-76 0 0 0 UP 0 0 0 17   heat-api-cfn node-77 0 0 0 UP 0 0 0 17   heat-api-cfn node-79 0 0 0 UP 0 0 0 17   heat-api-cfn BACKEND 0 0 0 UP 0 0 17 heat-api-cloudwatch FRONTEND 0 0 OPEN 18 heat-api-cloudwatch node-76 0 0 0 UP 0 0 0 18 heat-api-cloudwatch node-77 0 0 0 UP 0 0 0 18 heat-api-cloudwatch node-79 0 0 0 UP 0 0 0 18 heat-api-cloudwatch BACKEND 0 0 0 UP 0 0 18 crm status http://paste.openstack.org/show/296170/ Steps to Reproduce: Os: Centos HA wit neutro gre: 1 controller + 2 controller with mongo 1 mongo 1 cinder 2 omputes Ceilometer enabled 1.Deploy cluster, when cluster is ready 2. Navigate to fuel health tab and run all ostf tests - ha, smoke. sanity, platfrom tests are passed (configuration may fail if you do not change default cread for ssh on master node and user cred to openstack cluster) 3. Shutdown primary controller 4. wait 5 minutes - run ostf ha suit (it passed, if not you may need to wait for a liitle bit more and run again) 5. run smoke, sanity OSTF tests - they are passed 6. Run platfrom tests - Actual result all heat test failed (update/ create/ delete stack) with 504 error 7. turn on controller - repeat step 4-6 - result is the same all heat tests are failed ssh to each controller and try to delete stack - failed with error listed about {"build_id": "2015-06-08_06-13-27", "build_number": "521", "release_versions": {"2014.2.2-6.1": {"VERSION": {"build_id": "2015-06-08_06-13-27", "build_number": "521", "api": "1.0", "fuel-library_sha": "f43c2ae1af3b493ee0e7810eab7bb7b50c986c7d", "nailgun_sha": "4340d55c19029394cd5610b0e0f56d6cb8cb661b", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha": "4fc55db0265bbf39c369df398b9dc7d6469ba13b", "astute_sha": "7766818f079881e2dbeedb34e1f67e517ed7d479", "fuel-ostf_sha": "7c938648a246e0311d05e2372ff43ef1eb2e2761", "release": "6.1", "fuelmain_sha": "bcc909ffc5dd5156ba54cae348b6a07c1b607b24"}}}, "auth_required": true, "api": "1.0", "fuel-library_sha": "f43c2ae1af3b493ee0e7810eab7bb7b50c986c7d", "nailgun_sha": "4340d55c19029394cd5610b0e0f56d6cb8cb661b", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha": "4fc55db0265bbf39c369df398b9dc7d6469ba13b", "astute_sha": "7766818f079881e2dbeedb34e1f67e517ed7d479", "fuel-ostf_sha": "7c938648a246e0311d05e2372ff43ef1eb2e2761", "release": "6.1", "fuelmain_sha": "bcc909ffc5dd5156ba54cae348b6a07c1b607b24"} Second env: UBUNTU 3 controllers with ceph + 1 compute + 2 mongo + 2 ceph with nova Flat 1. Deploy cluster 2. When cluster ready - run ostf ha, smoke, sanity, platfrom tests - tests are passed 3. shutdown non-primary controller 4. wait near 5-7 minutes and run ostf ha - passed 5. run sanity/ smoke - passed 6. run platform tests - heat tests are failed with 504 error 7. ssh to online controllers and try to create and delete stack - failed with 504 error Info: Add snapshot later according it is to big and to slow uploading in google drive Info: issue do not reproduce each time, for now 2 from 5 Delete stack failed with next error: http://paste.openstack.org/show/296169/, at the same time other services (like nova on command nova delete instance_uuid works fine) haproxy status for heat:       # pxname svname stot ereq econ eresp status chkfail chkdown downtime iid       heat-api FRONTEND 0 0 OPEN 16       heat-api node-76 0 0 0 UP 0 0 0 16       heat-api node-77 0 0 0 UP 0 0 0 16       heat-api node-79 0 0 0 UP 0 0 0 16       heat-api BACKEND 0 0 0 UP 0 0 16   heat-api-cfn FRONTEND 0 0 OPEN 17   heat-api-cfn node-76 0 0 0 UP 0 0 0 17   heat-api-cfn node-77 0 0 0 UP 0 0 0 17   heat-api-cfn node-79 0 0 0 UP 0 0 0 17   heat-api-cfn BACKEND 0 0 0 UP 0 0 17 heat-api-cloudwatch FRONTEND 0 0 OPEN 18 heat-api-cloudwatch node-76 0 0 0 UP 0 0 0 18 heat-api-cloudwatch node-77 0 0 0 UP 0 0 0 18 heat-api-cloudwatch node-79 0 0 0 UP 0 0 0 18 heat-api-cloudwatch BACKEND 0 0 0 UP 0 0 18 crm status http://paste.openstack.org/show/296170/ Steps To Reproduce: Os: CentOS HA with Neutron GRE: 1 controller + 2 controllers with mongo 1 mongo 1 cinder 2 computes Ceilometer enabled 1. Deploy cluster, when cluster is ready 2. Navigate to fuel health tab and run all ostf tests - ha, smoke. sanity, platfrom tests are passed (configuration may fail if you do not change default cread for ssh on master node and user cred to openstack cluster) 3. Shutdown primary controller 4. Wait 5 minutes - run ostf ha suit (it passed, if not you may need to wait for a liitle bit more and run again) 5. Run smoke, sanity OSTF tests - they are passed 6. Run platfrom tests - Actual result all heat test failed (update/ create/ delete stack) with 504 error 7. Turn on controller - repeat step 4-6 - result is the same all heat tests are failed ssh to each controller and try to delete stack - failed with error listed about {"build_id": "2015-06-08_06-13-27", "build_number": "521", "release_versions": {"2014.2.2-6.1": {"VERSION": {"build_id": "2015-06-08_06-13-27", "build_number": "521", "api": "1.0", "fuel-library_sha": "f43c2ae1af3b493ee0e7810eab7bb7b50c986c7d", "nailgun_sha": "4340d55c19029394cd5610b0e0f56d6cb8cb661b", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha": "4fc55db0265bbf39c369df398b9dc7d6469ba13b", "astute_sha": "7766818f079881e2dbeedb34e1f67e517ed7d479", "fuel-ostf_sha": "7c938648a246e0311d05e2372ff43ef1eb2e2761", "release": "6.1", "fuelmain_sha": "bcc909ffc5dd5156ba54cae348b6a07c1b607b24"}}}, "auth_required": true, "api": "1.0", "fuel-library_sha": "f43c2ae1af3b493ee0e7810eab7bb7b50c986c7d", "nailgun_sha": "4340d55c19029394cd5610b0e0f56d6cb8cb661b", "feature_groups": ["mirantis"], "openstack_version": "2014.2.2-6.1", "production": "docker", "python-fuelclient_sha": "4fc55db0265bbf39c369df398b9dc7d6469ba13b", "astute_sha": "7766818f079881e2dbeedb34e1f67e517ed7d479", "fuel-ostf_sha": "7c938648a246e0311d05e2372ff43ef1eb2e2761", "release": "6.1", "fuelmain_sha": "bcc909ffc5dd5156ba54cae348b6a07c1b607b24"} Second env: UBUNTU 3 controllers with ceph + 1 compute + 2 mongo + 2 ceph with nova Flat 1. Deploy cluster 2. When cluster ready - run ostf ha, smoke, sanity, platfrom tests - tests are passed 3. shutdown non-primary controller 4. wait near 5-7 minutes and run ostf ha - passed 5. run sanity/ smoke - passed 6. run platform tests - heat tests are failed with 504 error 7. ssh to online controllers and try to create and delete stack - failed with 504 error Info: Add snapshot later according it is to big and to slow uploading in google drive Info: issue do not reproduce each time, for now 2 from 5
2015-06-17 11:27:35 Dmitry Mescheryakov fuel: assignee MOS Heat (mos-heat) Sergey Kraynev (skraynev)
2015-06-17 12:04:31 Sergey Kraynev fuel: status New Incomplete
2015-06-17 15:14:51 Dmitry Mescheryakov fuel: status Incomplete Confirmed
2015-06-18 14:47:17 Timur Nurlygayanov fuel: assignee Sergey Kraynev (skraynev) Timur Nurlygayanov (tnurlygayanov)
2015-06-18 14:47:22 Timur Nurlygayanov fuel: importance High Critical
2015-06-18 14:47:46 Timur Nurlygayanov fuel: importance Critical High
2015-06-19 10:03:12 Timur Nurlygayanov nominated for series fuel/6.1.x
2015-06-19 10:03:12 Timur Nurlygayanov bug task added fuel/6.1.x
2015-06-19 10:03:12 Timur Nurlygayanov nominated for series fuel/7.0.x
2015-06-19 10:03:12 Timur Nurlygayanov bug task added fuel/7.0.x
2015-06-19 10:03:21 Timur Nurlygayanov fuel/6.1.x: importance Undecided High
2015-06-19 10:03:24 Timur Nurlygayanov fuel/6.1.x: status New Confirmed
2015-06-19 10:03:27 Timur Nurlygayanov fuel/6.1.x: assignee Timur Nurlygayanov (tnurlygayanov)
2015-06-19 10:03:28 Timur Nurlygayanov fuel/6.1.x: milestone 6.1
2015-06-19 10:03:31 Timur Nurlygayanov fuel/7.0.x: milestone 6.1 7.0
2015-06-19 10:04:19 OpenStack Infra fuel: status Confirmed In Progress
2015-06-19 10:49:38 Bogdan Dobrelya fuel/6.1.x: milestone 6.1 6.1-updates
2015-06-19 10:55:20 Bogdan Dobrelya fuel/6.1.x: importance High Critical
2015-06-19 10:55:22 Bogdan Dobrelya fuel/7.0.x: importance High Critical
2015-06-19 10:55:25 Bogdan Dobrelya fuel/6.1.x: milestone 6.1-updates 6.1
2015-06-19 10:56:44 Timur Nurlygayanov fuel/6.1.x: status Confirmed In Progress
2015-06-19 11:19:32 Bogdan Dobrelya fuel/6.1.x: status In Progress Invalid
2015-06-19 11:19:35 Bogdan Dobrelya fuel/7.0.x: status In Progress Invalid
2015-06-19 11:20:48 Bogdan Dobrelya fuel/7.0.x: assignee Timur Nurlygayanov (tnurlygayanov) Bogdan Dobrelya (bogdando)
2015-06-19 11:21:31 Bogdan Dobrelya fuel/7.0.x: status Invalid In Progress
2015-06-19 11:21:36 Bogdan Dobrelya fuel/6.1.x: status Invalid In Progress
2015-06-19 12:30:39 Vladimir Kuklin fuel/6.1.x: importance Critical High
2015-06-19 12:30:41 Vladimir Kuklin fuel/7.0.x: importance Critical High
2015-06-19 15:23:02 Timur Nurlygayanov tags heat heat release-notes
2015-06-19 15:32:03 Timur Nurlygayanov fuel/6.1.x: status In Progress Confirmed
2015-06-23 09:03:25 Olena Logvinova tags heat release-notes done heat release-notes
2015-06-25 06:19:54 OpenStack Infra fuel: status In Progress Fix Committed
2015-07-07 08:14:25 Timur Nurlygayanov fuel/6.1.x: milestone 6.1 6.0.1-mu-1
2015-07-07 08:14:31 Timur Nurlygayanov fuel/6.1.x: status Confirmed In Progress
2015-07-07 08:19:09 Vitaly Sedelnik fuel/6.1.x: milestone 6.0.1-mu-1 6.1-updates
2015-07-08 14:54:39 Maksym Strukov tags done heat release-notes done heat on-verification release-notes
2015-07-08 21:57:54 Maksym Strukov tags done heat on-verification release-notes done heat release-notes
2015-09-07 09:19:21 Tatyanka tags done heat release-notes done heat on-verification release-notes
2015-09-07 15:50:30 Tatyanka tags done heat on-verification release-notes done heat release-notes
2015-09-07 15:50:34 Tatyanka fuel/7.0.x: status Fix Committed Fix Released
2016-05-23 13:15:15 Rodion Tikunov tags done heat release-notes done heat non-release release-notes