Fix Galera-based cluster tests running in neutron gat
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
OpenStack DBaaS (Trove) |
Fix Released
|
High
|
Unassigned |
Bug Description
With the switch to neutron in the gate, Galera-based cluster tests (i.e. PXC, MariaDB) started to fail regularly and were disabled (at least PXC was, as MariaDB is still non-voting). The error is:
2016-11-25 16:36:44.396479 | 2016-11-25 16:36:44.396 | ERROR: proboscis.
2016-11-25 16:36:44.397838 | 2016-11-25 16:36:44.397 | -------
2016-11-25 16:36:44.399540 | 2016-11-25 16:36:44.399 | Traceback (most recent call last):
2016-11-25 16:36:44.402994 | 2016-11-25 16:36:44.402 | File "/usr/local/
2016-11-25 16:36:44.404376 | 2016-11-25 16:36:44.404 | compatability.
2016-11-25 16:36:44.406318 | 2016-11-25 16:36:44.405 | File "/usr/local/
2016-11-25 16:36:44.409304 | 2016-11-25 16:36:44.409 | func()
2016-11-25 16:36:44.411420 | 2016-11-25 16:36:44.411 | File "/usr/local/
2016-11-25 16:36:44.412751 | 2016-11-25 16:36:44.412 | func(test_
2016-11-25 16:36:44.414350 | 2016-11-25 16:36:44.413 | File "/opt/stack/
2016-11-25 16:36:44.415927 | 2016-11-25 16:36:44.415 | self.test_
2016-11-25 16:36:44.417736 | 2016-11-25 16:36:44.417 | File "/opt/stack/
2016-11-25 16:36:44.420361 | 2016-11-25 16:36:44.420 | expected_task_name, expected_
2016-11-25 16:36:44.422437 | 2016-11-25 16:36:44.421 | File "/opt/stack/
2016-11-25 16:36:44.423794 | 2016-11-25 16:36:44.423 | cluster_instances, expected_
2016-11-25 16:36:44.426114 | 2016-11-25 16:36:44.425 | File "/opt/stack/
2016-11-25 16:36:44.427378 | 2016-11-25 16:36:44.427 | self.fail(
2016-11-25 16:36:44.428716 | 2016-11-25 16:36:44.428 | File "/usr/local/
2016-11-25 16:36:44.430651 | 2016-11-25 16:36:44.429 | return self.wait()
2016-11-25 16:36:44.431858 | 2016-11-25 16:36:44.431 | File "/usr/local/
2016-11-25 16:36:44.433101 | 2016-11-25 16:36:44.432 | current.
2016-11-25 16:36:44.434854 | 2016-11-25 16:36:44.434 | File "/usr/local/
2016-11-25 16:36:44.436319 | 2016-11-25 16:36:44.436 | result = func(*self.args, **self.kw)
2016-11-25 16:36:44.437661 | 2016-11-25 16:36:44.437 | File "/opt/stack/
2016-11-25 16:36:44.439376 | 2016-11-25 16:36:44.439 | obj = retriever()
2016-11-25 16:36:44.441125 | 2016-11-25 16:36:44.440 | File "/opt/stack/
2016-11-25 16:36:44.443397 | 2016-11-25 16:36:44.443 | require_
2016-11-25 16:36:44.444788 | 2016-11-25 16:36:44.444 | File "/opt/stack/
2016-11-25 16:36:44.446711 | 2016-11-25 16:36:44.446 | time_out=
2016-11-25 16:36:44.448211 | 2016-11-25 16:36:44.447 | File "/opt/stack/
2016-11-25 16:36:44.449641 | 2016-11-25 16:36:44.449 | sleep_time=
2016-11-25 16:36:44.451617 | 2016-11-25 16:36:44.451 | File "/usr/local/
2016-11-25 16:36:44.453096 | 2016-11-25 16:36:44.452 | return hubs.get_
2016-11-25 16:36:44.455086 | 2016-11-25 16:36:44.454 | File "/usr/local/
2016-11-25 16:36:44.456471 | 2016-11-25 16:36:44.456 | return self.greenlet.
2016-11-25 16:36:44.457840 | 2016-11-25 16:36:44.457 | File "/usr/local/
2016-11-25 16:36:44.459335 | 2016-11-25 16:36:44.458 | result = func(*self.args, **self.kw)
2016-11-25 16:36:44.460880 | 2016-11-25 16:36:44.460 | File "/opt/stack/
2016-11-25 16:36:44.462213 | 2016-11-25 16:36:44.461 | obj = retriever()
2016-11-25 16:36:44.463589 | 2016-11-25 16:36:44.463 | File "/opt/stack/
2016-11-25 16:36:44.464963 | 2016-11-25 16:36:44.464 | fast_fail_
2016-11-25 16:36:44.467508 | 2016-11-25 16:36:44.467 | File "/opt/stack/
2016-11-25 16:36:44.469870 | 2016-11-25 16:36:44.468 | % (instance_id, instance.status))
2016-11-25 16:36:44.472961 | 2016-11-25 16:36:44.472 | RuntimeError: Instance '<Instance cluster_
This will need to be debugged (in the gate probably) and a fix submitted.
Changed in trove: | |
status: | New → Fix Released |
This may be related to the failure documented in https:/ /bugs.launchpad .net/trove/ +bug/1645775