[system_tests] Deploy ha flat on ubuntu fails on sync galera on controllers
Bug #1352945 reported by
Tatyanka
This bug report is a duplicate of:
Bug #1354479: Galera is not syncing on the slaves sometimes.
Edit
Remove
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Fuel for OpenStack |
In Progress
|
Medium
|
Sergii Golovatiuk |
Bug Description
VERSION:
feature_groups:
- mirantis
production: "docker"
release: "5.1"
api: "1.0"
build_number: "389"
build_id: "2014-08-
astute_sha: "ce86172e776610
fuellib_sha: "4e3fdd75f8dabd
ostf_sha: "a3fa823ea0e4e0
nailgun_sha: "bd0127be006102
fuelmain_sha: "e99879292cf6e9
Cluster in error state with error in puppet on galera exec wait sync
http://
Changed in fuel: | |
assignee: | Fuel Library Team (fuel-library) → Sergii Golovatiuk (sgolovatiuk) |
status: | Confirmed → In Progress |
To post a comment you must log in.
According to logs,
MySQL with Galera was not able to Initiate transfer on node-2
Here is the log from node-1 03T17:11: 17.120625+ 01:00 info: INFO: PIDFile /var/run/ mysqld/ mysqld. pid of MySQL server not found. Sleeping for 5 seconds. 2 retries left 03T17:11: 25.101678+ 01:00 info: INFO: MySQL started 03T17:11: 25.245771+ 01:00 info: INFO: GTID OK: ef86fc0c- 1b26-11e4- 8e83-eb36c97e0a 94:968 03T17:12: 25.302240+ 01:00 info: INFO: GTID OK: ef86fc0c- 1b26-11e4- 8e83-eb36c97e0a 94:998 03T17:13: 25.363481+ 01:00 info: INFO: GTID OK: ef86fc0c- 1b26-11e4- 8e83-eb36c97e0a 94:1028 03T17:14: 27.217568+ 01:00 info: INFO: GTID OK: ef86fc0c- 1b26-11e4- 8e83-eb36c97e0a 94:1059
2014-08-
2014-08-
2014-08-
2014-08-
2014-08-
2014-08-
It seems to be good
Logs from node-4
2014-08- 03T17:25: 22.330226+ 01:00 info: INFO: MySQL started 03T17:25: 22.448313+ 01:00 err: ERROR: GTID have wrong format: wsrep_local_ state_uuid: 184467440737095 51615 03T17:25: 22.449267+ 01:00 err: ERROR: Wrong GTID, not updating gtid attribute 03T17:27: 09.164154+ 01:00 err: ERROR: GTID have wrong format: wsrep_local_ state_uuid: 184467440737095 51615 03T17:27: 09.164154+ 01:00 err: ERROR: Wrong GTID, not updating gtid attribute 03T17:27: 23.411150+ 01:00 info: INFO: GTID OK: ef86fc0c- 1b26-11e4- 8e83-eb36c97e0a 94:1430
2014-08-
2014-08-
2014-08-
2014-08-
2014-08-
Logs from node-2 03T17:25: 14.335806+ 01:00 info: INFO: PIDFile /var/run/ mysqld/ mysqld. pid of MySQL server not found. Sleeping for 5 seconds. 2 retries left 03T17:25: 19.629571+ 01:00 info: INFO: PIDFile /var/run/ mysqld/ mysqld. pid of MySQL server not found. Sleeping for 5 seconds. 1 retries left 03T17:25: 27.391246+ 01:00 info: INFO: MySQL started 03T17:25: 32.156082+ 01:00 err: ERROR: GTID have wrong format: wsrep_local_ state_uuid: 184467440737095 51615 03T17:25: 32.157074+ 01:00 err: ERROR: Wrong GTID, not updating gtid attribute 03T17:26: 32.187558+ 01:00 err: ERROR: GTID have wrong format: wsrep_local_ state_uuid: 184467440737095 51615 03T17:26: 32.198079+ 01:00 err: ERROR: Wrong GTID, not updating gtid attribute 03T17:28: 48.345912+ 01:00 err: ERROR: GTID have wrong format: : 03T17:28: 48.345912+ 01:00 err: ERROR: Wrong GTID, not updating gtid attribute 03T17:28: 48.345912+ 01:00 info: INFO: MySQL failed to stop after 15s using SIGTERM. Trying SIGKILL... 03T17:28: 48.345912+ 01:00 info: INFO: MySQL stopped
014-08-
2014-08-
2014-08-
2014-08-
2014-08-
2014-08-
2014-08-
2014-08-
2014-08-
2014-08-
2014-08-
Since then there were attempts to transfer data but all of them were not successful.
I deleted everything from /var/log/mysql/*, generated a new structure and tried to start mysqld manually. It was not successful. It looks like it's a sporadic issue on Ubuntu and could be related to MySQL or galera packages themselves.