Activity log for bug #1620268

Date Who What changed Old value New value Message
2016-09-05 11:32:40 Victor Ryzhenkin bug added bug
2016-09-05 11:33:54 Victor Ryzhenkin summary Murano can't delete package due MyAQL error Murano can't delete package due MySQL error
2016-09-05 11:34:37 Victor Ryzhenkin summary Murano can't delete package due MySQL error [Murano] Murano can't delete package due 503 error from glare
2016-09-05 11:36:24 Victor Ryzhenkin description Detailed bug description: Murano can't remove package due MySQL connection errors Steps to reproduce: 1. Deploy MOS 9.1 with box murano 2. Run Platform OSTF Expected results: Murano platform OSTF pass Actual result: Test "Check application deployment in Murano environment with GLARE" failed Reproducibility: It may be a race condition or connection problems. Workaround: Nope Impact: Test Impact Description of the environment: Operation system: Ubuntu Versions of components: 9.x Reference architecture: HA Network model: Neutron VXLAN Related projects installed: Murano, Mos, Fuel Additional information: OSTF log says for client: glanceclient.common.http: DEBUG: Request returned failure status 503. fuel_health.common.test_mixins: DEBUG: Traceback (most recent call last): File "/usr/lib/python2.7/site-packages/fuel_health/common/test_mixins.py", line 177, in verify result = func(*args, **kwargs) File "/usr/lib/python2.7/site-packages/fuel_health/muranomanager.py", line 459, in delete_package self.murano_art_client.packages.delete(package_id) File "/usr/lib/python2.7/site-packages/muranoclient/v1/artifact_packages.py", line 29, in inner raise exc.from_code(e.code) HTTPServiceUnavailable: HTTPServiceUnavailable (HTTP 503) There is no tracebacks in glance-glare logs. Additional murano packages cleanup raised this: part of the log: [SQL: u'SELECT 1']\n", "type": "DBConnectionError"}, "title": "Internal Server Error"} (HTTP 500) Reproduced only once and SWARM 9.x. https://product-ci.infra.mirantis.net/job/9.x.system_test.ubuntu.services_ha/49/console Detailed bug description:  Murano can't remove package due MySQL connection errors Steps to reproduce:  1. Deploy MOS 9.1 with box murano  2. Run Platform OSTF Expected results:  Murano platform OSTF pass Actual result:  Test "Check application deployment in Murano environment with GLARE" failed Reproducibility:  It may be a race condition or connection problems. Workaround:  Nope Impact:  Test Impact Description of the environment:  Operation system: Ubuntu  Versions of components: 9.x  Reference architecture: HA  Network model: Neutron VXLAN  Related projects installed: Murano, Mos, Fuel Additional information:   OSTF log says for client: glanceclient.common.http: DEBUG: Request returned failure status 503. fuel_health.common.test_mixins: DEBUG: Traceback (most recent call last):   File "/usr/lib/python2.7/site-packages/fuel_health/common/test_mixins.py", line 177, in verify     result = func(*args, **kwargs)   File "/usr/lib/python2.7/site-packages/fuel_health/muranomanager.py", line 459, in delete_package     self.murano_art_client.packages.delete(package_id)   File "/usr/lib/python2.7/site-packages/muranoclient/v1/artifact_packages.py", line 29, in inner     raise exc.from_code(e.code) HTTPServiceUnavailable: HTTPServiceUnavailable (HTTP 503) There is no tracebacks in glance-glare logs. Additional murano packages cleanup raised this: part of the log: [SQL: u'SELECT 1']\n", "type": "DBConnectionError"}, "title": "Internal Server Error"} (HTTP 500) Reproduced only once and SWARM 9.x. https://product-ci.infra.mirantis.net/job/9.x.system_test.ubuntu.services_ha/49/console Also, there is tracebacks from cinder also connected with mysql: 2016-09-05T00:46:58.039663+00:00 crit: 2016-09-05 00:46:58.001 7513 CRITICAL cinder [req-3c321312-7828-41ff-b136-3a6995c11a94 - - - - -] OperationalError: (_mysql_exceptions.Oper ationalError) (1054, "Unknown column 'services.rpc_current_version' in 'field list'") [SQL: u'SELECT services.created_at AS services_created_at, services.updated_at AS services_up dated_at, services.deleted_at AS services_deleted_at, services.deleted AS services_deleted, services.id AS services_id, services.host AS services_host, services.`binary` AS servic es_binary, services.topic AS services_topic, services.report_count AS services_report_count, services.disabled AS services_disabled, services.availability_zone AS services_availab ility_zone, services.disabled_reason AS services_disabled_reason, services.modified_at AS services_modified_at, services.rpc_current_version AS services_rpc_current_version, servi ces.object_current_version AS services_object_current_version, services.replication_status AS services_replication_status, services.active_backend_id AS services_active_backend_id , services.frozen AS services_frozen \nFROM services \nWHERE services.deleted = false AND services.`binary` = %s'] [parameters: ('cinder-scheduler',)]
2016-09-05 11:53:47 Victor Ryzhenkin attachment added The syslog with MySQL errors https://bugs.launchpad.net/fuel/+bug/1620268/+attachment/4734850/+files/syslog
2016-09-05 11:56:21 Victor Ryzhenkin summary [Murano] Murano can't delete package due 503 error from glare [Murano] MySQL unexpectedly crashed on primary controller
2016-09-05 11:58:35 Victor Ryzhenkin fuel: importance High Critical
2016-09-05 12:04:18 Timur Nurlygayanov fuel: assignee Fuel Sustaining (fuel-sustaining-team)
2016-09-06 17:21:39 Dmitry Pyzhov fuel: importance Critical High
2016-09-07 09:44:44 Maksim Malchuk fuel: status New Confirmed
2016-09-07 09:44:51 Maksim Malchuk tags area-murano murano area-library area-murano murano
2016-09-08 21:24:27 Maksim Malchuk fuel: assignee Fuel Sustaining (fuel-sustaining-team) Fuel QA Team (fuel-qa)
2016-09-09 10:03:44 Alexander Kurenyshev fuel: assignee Fuel QA Team (fuel-qa) MOS QA Team (mos-qa)
2016-09-09 10:08:41 Timur Nurlygayanov fuel: assignee MOS QA Team (mos-qa) Victor Ryzhenkin (vryzhenkin)
2016-09-09 10:18:57 Timur Nurlygayanov fuel: assignee Victor Ryzhenkin (vryzhenkin) Fuel Sustaining (fuel-sustaining-team)
2016-09-09 10:21:10 Timur Nurlygayanov fuel: assignee Fuel Sustaining (fuel-sustaining-team) MOS Puppet Team (mos-puppet)
2016-09-09 10:41:44 Timur Nurlygayanov fuel: assignee MOS Puppet Team (mos-puppet) Fuel Sustaining (fuel-sustaining-team)
2016-09-09 10:59:38 Victor Ryzhenkin summary [Murano] MySQL unexpectedly crashed on primary controller MySQL unexpectedly crashed on primary controller
2016-09-09 12:05:30 Maksim Malchuk fuel: assignee Fuel Sustaining (fuel-sustaining-team) Fuel QA Team (fuel-qa)
2016-09-09 12:37:55 Timur Nurlygayanov fuel: assignee Fuel QA Team (fuel-qa) MOS Murano (mos-murano)
2016-09-09 12:39:13 Timur Nurlygayanov fuel: assignee MOS Murano (mos-murano) Maksim Malchuk (mmalchuk)
2016-09-09 13:10:33 Timur Nurlygayanov fuel: assignee Maksim Malchuk (mmalchuk) Timur Nurlygayanov (tnurlygayanov)
2016-09-09 13:10:40 Timur Nurlygayanov fuel: status Confirmed Incomplete
2016-09-10 16:23:54 Maksim Malchuk fuel: status Incomplete Confirmed
2016-09-10 16:24:01 Maksim Malchuk fuel: assignee Timur Nurlygayanov (tnurlygayanov) Maksim Malchuk (mmalchuk)
2016-09-12 15:35:02 Maksim Malchuk summary MySQL unexpectedly crashed on primary controller MySQL split-brain issue after successful deploy
2016-09-12 17:18:00 Maksim Malchuk fuel: status Confirmed Triaged
2016-09-12 22:17:24 Maksim Malchuk fuel: status Triaged In Progress
2016-09-13 13:52:15 Maksim Malchuk fuel: assignee Maksim Malchuk (mmalchuk) Roman Vyalov (r0mikiam)
2016-09-13 13:57:38 Roman Vyalov fuel: assignee Roman Vyalov (r0mikiam) MOS Linux (mos-linux)
2016-09-13 13:57:41 Roman Vyalov fuel: status In Progress New
2016-09-13 14:34:44 Maksim Malchuk fuel: assignee MOS Linux (mos-linux) Ivan Suzdal (isuzdal)
2016-09-13 14:34:50 Maksim Malchuk bug added subscriber Maksim Malchuk
2016-09-13 15:21:52 Roman Vyalov fuel: assignee Ivan Suzdal (isuzdal) Dmitry Burmistrov (dburmistrov)
2016-09-13 15:21:56 Roman Vyalov fuel: status New In Progress
2016-09-13 15:26:03 Roman Vyalov fuel: status In Progress Fix Committed
2016-09-16 10:59:46 Nastya Urlapova marked as duplicate 1592420
2016-09-16 11:00:13 Nastya Urlapova removed duplicate marker 1592420
2016-09-16 13:57:38 Maksim Malchuk fuel: status Fix Committed New
2016-09-16 13:57:46 Maksim Malchuk fuel: assignee Dmitry Burmistrov (dburmistrov) Ivan Suzdal (isuzdal)
2016-09-16 16:15:18 Andrey Maximov fuel: importance High Critical
2016-09-16 16:15:24 Andrey Maximov fuel: status New Confirmed
2016-09-19 14:49:47 Ivan Suzdal fuel: status Confirmed Fix Committed
2016-09-21 10:39:41 Timur Nurlygayanov fuel: status Fix Committed Fix Released
2016-09-21 10:40:16 Timur Nurlygayanov fuel: status Fix Released Fix Committed
2016-09-21 10:45:37 Nastya Urlapova fuel: status Fix Committed Confirmed
2016-09-22 22:22:43 OpenStack Infra tags area-library area-murano murano area-library area-murano in-stable-mitaka murano
2016-09-23 12:23:50 Bogdan Dobrelya fuel: status Confirmed Fix Committed
2016-09-26 12:47:20 Mykola Stolyarenko fuel: status Fix Committed Fix Released
2016-09-29 11:26:04 Maksim Malchuk nominated for series fuel/mitaka
2016-09-29 11:26:04 Maksim Malchuk bug task added fuel/mitaka
2016-09-29 11:26:15 Maksim Malchuk fuel/mitaka: status New Fix Released
2016-09-29 11:26:21 Maksim Malchuk fuel: status Fix Released Fix Committed
2016-09-29 11:26:25 Maksim Malchuk fuel: importance Critical High
2016-09-29 11:26:28 Maksim Malchuk fuel/mitaka: importance Undecided Critical
2016-09-29 11:26:41 Maksim Malchuk fuel/mitaka: assignee Ivan Suzdal (isuzdal)
2016-09-29 11:26:47 Maksim Malchuk fuel/mitaka: milestone 9.1
2016-09-29 11:26:51 Maksim Malchuk fuel: milestone 9.1 10.0
2016-10-03 15:25:34 Alisa Tselovalnikova fuel/mitaka: status Fix Released Confirmed
2016-10-03 17:12:52 Sergey Philippov bug added subscriber Sergey Philippov
2016-10-03 17:32:23 Dmitry Teselkin fuel/mitaka: assignee Ivan Suzdal (isuzdal) Fuel QA Team (fuel-qa)
2016-10-04 10:06:29 Nastya Urlapova fuel/mitaka: assignee Fuel QA Team (fuel-qa) MOS Linux (mos-linux)
2016-10-04 10:27:17 Dmitry Teselkin fuel/mitaka: assignee MOS Linux (mos-linux) Fuel QA Team (fuel-qa)
2016-10-04 11:12:16 Nastya Urlapova fuel/mitaka: assignee Fuel QA Team (fuel-qa) MOS Linux (mos-linux)
2016-10-04 11:48:14 Dmitry Pyzhov fuel/mitaka: status Confirmed Fix Committed
2016-10-04 11:48:17 Dmitry Pyzhov fuel/mitaka: importance Critical High
2016-10-05 15:36:52 Dmitry Pyzhov fuel: status Fix Committed Fix Released
2016-10-05 15:37:06 Dmitry Pyzhov fuel: status Fix Released Fix Committed
2016-10-06 09:50:46 Dmitry Kalashnik fuel/mitaka: status Fix Committed Fix Released