"Timed out waiting for thing ... to become in-use" causes tempest-dsvm-* failures

Bug #1273292 reported by Russell Bryant
20
This bug affects 4 people
Affects Status Importance Assigned to Milestone
OpenStack Compute (nova)
Confirmed
Critical
John Griffith

Bug Description

This is a spin-off of bug 1254890. That bug was originally covering failures for both timing out waiting for an instance to become ACTIVE, as well as waiting for a volume to become in-use or available.

It seems valuable to split out the cases of waiting for volumes to become in-use or available into its own bug.

message:"Details: Timed out waiting for thing" AND message:"to become" AND (message:"in-use" OR message:"available")

http://logstash.openstack.org/#eyJzZWFyY2giOiJtZXNzYWdlOlwiRGV0YWlsczogVGltZWQgb3V0IHdhaXRpbmcgZm9yIHRoaW5nXCIgQU5EIG1lc3NhZ2U6XCJ0byBiZWNvbWVcIiBBTkQgKG1lc3NhZ2U6XCJpbi11c2VcIiBPUiBtZXNzYWdlOlwiYXZhaWxhYmxlXCIpIiwiZmllbGRzIjpbXSwib2Zmc2V0IjowLCJ0aW1lZnJhbWUiOiI2MDQ4MDAiLCJncmFwaG1vZGUiOiJjb3VudCIsInRpbWUiOnsidXNlcl9pbnRlcnZhbCI6MH0sInN0YW1wIjoxMzkwODQwODI1MDkxfQ==

Changed in nova:
status: New → Confirmed
importance: Undecided → High
importance: High → Critical
milestone: none → icehouse-3
description: updated
Matt Riedemann (mriedem)
tags: added: testing volumes
description: updated
Revision history for this message
John Griffith (john-griffith) wrote :

I believe this is a duplicate of: https://bugs.launchpad.net/nova/+bug/1270608

Checking here in this instance of the failure: http://logs.openstack.org/36/69236/2/check/check-tempest-dsvm-full/8820082/logs/screen-n-cpu.txt.gz#_2014-01-26_22_03_48_841

You can see nova timed out after 15 seconds waiting for the iscsi mount to complete. Given the VERY heavy load caused by this test I think it fits with the theory that these ops are horribly slow under heavy load.

I'm marking this as a duplicate, it's the same root cause regardless of whether it ends up that waiting longer helps us or not.

no longer affects: cinder
Changed in nova:
assignee: nobody → John Griffith (john-griffith)
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.