Comment 0 for bug 1623394

Revision history for this message
Timur Nurlygayanov (tnurlygayanov) wrote : The gates are broken: need to increase the size of RAM, MySQL crashed

The gates are broken, example:

https://review.openstack.org/#/c/369427/3/

in the logs we can see the following error:

2016-09-14T06:26:54.030000+00:00 warning: [ 2687.871970] nova-api invoked oom-killer: gfp_mask=0x24201ca, order=0, oom_score_adj=0
2016-09-14T06:26:54.030367+00:00 err: [ 2687.872346] Out of memory: Kill process 411 (mysqld) score 45 or sacrifice child
2016-09-14T06:26:54.030367+00:00 err: [ 2687.872419] Killed process 411 (mysqld) total-vm:2547180kB, anon-rss:115368kB, file-rss:0kB

The root of the issue:
We discussed the issue with Maksim Malchuk and he suggested to increase the size of RAM on controller nodes in this job to make gate more stable.