volume backup tests timing out since 1/23
Bug #1745168 reported by
Matt Riedemann
This bug affects 1 person
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Cinder |
Fix Released
|
High
|
Gorka Eguileor |
Bug Description
We've been seeing a big spike in volume backup tests timing out since 1/23:
I'm guessing it's related to this change:
Changed in cinder: | |
status: | New → Confirmed |
importance: | Undecided → High |
Changed in cinder: | |
assignee: | nobody → Gorka Eguileor (gorka) |
Changed in cinder: | |
status: | Confirmed → In Progress |
To post a comment you must log in.
(9:48:27 AM) geguileo: Jan 24 15:04:16.031978 ubuntu- xenial- citycloud- sto2-0002119447 cinder- backup[ 11788]: Traceback (most recent call last): xenial- citycloud- sto2-0002119447 cinder- backup[ 11788]: File "/usr/local/ lib/python2. 7/dist- packages/ eventlet/ hubs/hub. py", line 457, in fire_timers xenial- citycloud- sto2-0002119447 cinder- backup[ 11788]: timer() xenial- citycloud- sto2-0002119447 cinder- backup[ 11788]: File "/usr/local/ lib/python2. 7/dist- packages/ eventlet/ hubs/timer. py", line 58, in __call__ xenial- citycloud- sto2-0002119447 cinder- backup[ 11788]: cb(*args, **kw) xenial- citycloud- sto2-0002119447 cinder- backup[ 11788]: File "/usr/local/ lib/python2. 7/dist- packages/ eventlet/ semaphore. py", line 145, in _do_acquire xenial- citycloud- sto2-0002119447 cinder- backup[ 11788]: waiter.switch() xenial- citycloud- sto2-0002119447 cinder- backup[ 11788]: error: cannot switch to a different thread /review. openstack. org/536119 /github. com/openstack/ cinder/ commit/ 1a569e15c35d772 a8ca236d75cd184 0a415983d3
(9:48:28 AM) geguileo: Jan 24 15:04:16.032126 ubuntu-
(9:48:30 AM) geguileo: Jan 24 15:04:16.032267 ubuntu-
(9:48:32 AM) geguileo: Jan 24 15:04:16.032404 ubuntu-
(9:48:35 AM) geguileo: Jan 24 15:04:16.032559 ubuntu-
(9:48:36 AM) geguileo: Jan 24 15:04:16.032703 ubuntu-
(9:48:38 AM) geguileo: Jan 24 15:04:16.032840 ubuntu-
(9:48:40 AM) geguileo: Jan 24 15:04:16.032990 ubuntu-
(9:48:44 AM) geguileo: jungleboyj: ^ that's happening because a native thread withing a greenthread is logging
(9:48:56 AM) geguileo: jungleboyj: I'll try to figure out now where is this happening
(9:49:22 AM) openstackgerrit: Aseel Awwad proposed openstack/cinder master: Add policy check for complete attachment API action https:/
(9:49:23 AM) mriedem: geguileo: nice spot, because this merged the same day https:/
(9:49:30 AM) mriedem: geguileo: something is logging where it shouldn't be