api tests polling for stack update failing intermittently

[Rabi Mishra]

This has become very frequent now, as noticed at:

http://logs.openstack.org/31/522031/1/gate/heat-functional-convg-mysql-lbaasv2-non-apache/31a46ac/job-output.txt.gz#_2017-11-27_07_41_18_337796

Looks like sync happened after 7 secs in this case which more than the time we poll for.

07:18:26.169368: http://logs.openstack.org/31/522031/1/gate/heat-functional-convg-mysql-lbaasv2-non-apache/31a46ac/logs/screen-h-eng.txt.gz#_Nov_27_07_18_26_169368

07:18:33.548370: http://logs.openstack.org/31/522031/1/gate/heat-functional-convg-mysql-lbaasv2-non-apache/31a46ac/logs/screen-h-eng.txt.gz#_Nov_27_07_18_33_548370

Not very sure what causes this (slow nodes?). But we can probably reduce the failures by increasing the poll count/delay.

traceback:

2017-11-27 07:41:18.316476 | primary | 2017-11-27 07:41:18.316 | Captured traceback:
2017-11-27 07:41:18.317953 | primary | 2017-11-27 07:41:18.317 | ~~~~~~~~~~~~~~~~~~~
2017-11-27 07:41:18.320887 | primary | 2017-11-27 07:41:18.320 | Traceback (most recent call last):
2017-11-27 07:41:18.322605 | primary | 2017-11-27 07:41:18.322 | File "/usr/local/lib/python2.7/dist-packages/gabbi/case.py", line 94, in wrapper
2017-11-27 07:41:18.325605 | primary | 2017-11-27 07:41:18.325 | func(self)
2017-11-27 07:41:18.327050 | primary | 2017-11-27 07:41:18.326 | File "/usr/local/lib/python2.7/dist-packages/gabbi/case.py", line 143, in test_request
2017-11-27 07:41:18.328870 | primary | 2017-11-27 07:41:18.328 | self._run_test()
2017-11-27 07:41:18.330814 | primary | 2017-11-27 07:41:18.330 | File "/usr/local/lib/python2.7/dist-packages/gabbi/case.py", line 530, in _run_test
2017-11-27 07:41:18.332788 | primary | 2017-11-27 07:41:18.332 | raise failure
2017-11-27 07:41:18.337796 | primary | 2017-11-27 07:41:18.337 | testtools.matchers._impl.MismatchError: 'UPDATE_COMPLETE' != u'UPDATE_IN_PROGRESS': Unable to match $.stack.stack_status as UPDATE_COMPLETE, got UPDATE_IN_PROGRESS

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: master
Review: https://review.openstack.org/523701

[OpenStack Infra (hudson-openstack)]

Change abandoned by Rabi Mishra (<email address hidden>) on branch: master
Review: https://review.openstack.org/523701

[Rabi Mishra (rabi)]

Should be fixed by https://review.openstack.org/#/c/521822/