Activity log for bug #1348839

Date Who What changed Old value New value Message
2014-07-25 23:12:21 Ryan Moe bug added bug
2014-07-25 23:14:12 Ryan Moe description "build_id": "2014-07-25_20-13-50" "ostf_sha": "8c328521b1444f22c50463b9432193e20ed33813" "build_number": "361" "auth_required": true "api": "1.0" "nailgun_sha": "83cc9ed44ebc8dd97248483b6d414ebbc4cff3c0" "production": "docker" "fuelmain_sha": "0111e138e328f1bbd4453f56cc178fafbd9c4e16" "astute_sha": "aa5aed61035a8dc4035ab1619a8bb540a7430a95" "feature_groups": ["mirantis"] "release": "5.1" "fuellib_sha": "448dee95b84f4f6585baf0d98f84e376854233eb" The load on the controller gets very high (> 50) and Fuel thinks the node is offline. Looking on the system I see cib with high cpu usage and mysqld using a very large amount of memory. From top: 10485 mysql -2 0 2859m 822m 4748 S 0.7 54.9 0:06.63 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib/mysql/plugin --user=mysql --init- "build_id": "2014-07-25_20-13-50" "ostf_sha": "8c328521b1444f22c50463b9432193e20ed33813" "build_number": "361" "auth_required": true "api": "1.0" "nailgun_sha": "83cc9ed44ebc8dd97248483b6d414ebbc4cff3c0" "production": "docker" "fuelmain_sha": "0111e138e328f1bbd4453f56cc178fafbd9c4e16" "astute_sha": "aa5aed61035a8dc4035ab1619a8bb540a7430a95" "feature_groups": ["mirantis"] "release": "5.1" "fuellib_sha": "448dee95b84f4f6585baf0d98f84e376854233eb" The load on the controller gets very high (> 50) and Fuel thinks the node is offline. Looking on the system I see cib with high cpu usage and mysqld using a very large amount of memory. From top: 10485 mysql -2 0 2859m 822m 4748 S 0.7 54.9 0:06.63 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib/mysql/plugin --user=mysql --init- On the console I see: INFO: task mysqld:10534 blocked for more than 120 seconds.
2014-07-27 09:10:52 Nastya Urlapova fuel: importance Undecided High
2014-07-27 09:11:02 Nastya Urlapova fuel: assignee Fuel Library Team (fuel-library)
2014-07-27 09:11:05 Nastya Urlapova fuel: milestone 5.1
2014-07-28 09:26:45 Vladimir Kuklin fuel: status New Incomplete
2014-07-28 16:01:27 Ryan Moe description "build_id": "2014-07-25_20-13-50" "ostf_sha": "8c328521b1444f22c50463b9432193e20ed33813" "build_number": "361" "auth_required": true "api": "1.0" "nailgun_sha": "83cc9ed44ebc8dd97248483b6d414ebbc4cff3c0" "production": "docker" "fuelmain_sha": "0111e138e328f1bbd4453f56cc178fafbd9c4e16" "astute_sha": "aa5aed61035a8dc4035ab1619a8bb540a7430a95" "feature_groups": ["mirantis"] "release": "5.1" "fuellib_sha": "448dee95b84f4f6585baf0d98f84e376854233eb" The load on the controller gets very high (> 50) and Fuel thinks the node is offline. Looking on the system I see cib with high cpu usage and mysqld using a very large amount of memory. From top: 10485 mysql -2 0 2859m 822m 4748 S 0.7 54.9 0:06.63 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib/mysql/plugin --user=mysql --init- On the console I see: INFO: task mysqld:10534 blocked for more than 120 seconds. "build_id": "2014-07-25_20-13-50" "ostf_sha": "8c328521b1444f22c50463b9432193e20ed33813" "build_number": "361" "auth_required": true "api": "1.0" "nailgun_sha": "83cc9ed44ebc8dd97248483b6d414ebbc4cff3c0" "production": "docker" "fuelmain_sha": "0111e138e328f1bbd4453f56cc178fafbd9c4e16" "astute_sha": "aa5aed61035a8dc4035ab1619a8bb540a7430a95" "feature_groups": ["mirantis"] "release": "5.1" "fuellib_sha": "448dee95b84f4f6585baf0d98f84e376854233eb" HA Ubuntu with nova-network. 3 controllers, 1 compute, 2 ceph OSD. The load on the controller gets very high (> 50) and Fuel thinks the node is offline. Looking on the system I see cib with high cpu usage and mysqld using a very large amount of memory. From top: 10485 mysql -2 0 2859m 822m 4748 S 0.7 54.9 0:06.63 /usr/sbin/mysqld --basedir=/usr --datadir=/var/lib/mysql --plugin-dir=/usr/lib/mysql/plugin --user=mysql --init- On the console I see: INFO: task mysqld:10534 blocked for more than 120 seconds.
2014-07-30 06:05:32 Mike Scherbakov fuel: status Incomplete Confirmed
2014-07-30 06:12:27 Mike Scherbakov attachment added fail_deploy_ha_vlan-2014_07_30__02_35_58.tar.gz https://bugs.launchpad.net/fuel/+bug/1348839/+attachment/4165652/+files/fail_deploy_ha_vlan-2014_07_30__02_35_58.tar.gz
2014-07-30 08:25:28 Bogdan Dobrelya tags corosync
2014-07-30 08:58:45 Bogdan Dobrelya tags corosync corosync galera ha
2014-07-31 10:45:24 Bogdan Dobrelya marked as duplicate 1350245
2014-07-31 19:09:34 Ryan Moe removed duplicate marker 1350245
2014-08-05 11:59:07 Sergii Golovatiuk marked as duplicate 1350245
2014-08-22 06:49:19 Sergii Golovatiuk changed duplicate marker 1350245 1354479
2014-08-22 06:49:38 Sergii Golovatiuk removed duplicate marker 1354479
2014-08-22 06:49:45 Sergii Golovatiuk marked as duplicate 1354479