ResourceFailure: in heat returns "unknown" error

Bug #1722470 reported by Cédric Jeanneret deactivated
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
tripleo
Incomplete
Wishlist
Unassigned

Bug Description

Dear Stackers,

While trying to add ceph nodes to my current tripleO deploy on Pike, I have the following issue in heat logs:
http://paste.openstack.org/show/623181/

This issue is reported to mistral as follow:
http://paste.openstack.org/show/623182/

I don't really know what to provide in addition, feel free to ask me.

The nodes were added using the following commands:
openstack overcloud node import baremetal.json
openstack overcloud node introspect --all-manageable --provide

one of the node is described as follow with `openstack baremetal node show ceph-storage-0'
http://paste.openstack.org/show/623183/

Deploy command includes the following specific configuration:
http://paste.openstack.org/show/623184/

Thank you!

Revision history for this message
Cédric Jeanneret deactivated (cjeanneret-c2c-deactivated) wrote :

I found something more in nova-conductor log:
http://paste.openstack.org/show/623186/

Revision history for this message
Cédric Jeanneret deactivated (cjeanneret-c2c-deactivated) wrote :

After some more digging, in nova-compute.log:
http://paste.openstack.org/show/623187/

Apparently, novajoin-server issue, although I didn't activate the novajoin thingy with the server metadata o_O

Revision history for this message
Cédric Jeanneret deactivated (cjeanneret-c2c-deactivated) wrote :

After more searches, it appears it's a disk space issue on the undercloud:
InstanceDeployFailure: Failed to provision instance 0cf68149-bae6-432c-93b2-6d58d2a48661: Failed to deploy. Error: Disk volume where '/var/lib/ironic/master_images/tmpjEgvzp' is located doesn't have enough disk space. Required 5211 MiB, only 4467 MiB available space present.

The undercloud we're running on had about 4.9G of free space, this matches the amount in the log. This log is from nova-compute, btw.

It would be good to raise that one into mistral so that it actually hit the user in the eye. Another idea would be to get a pre-check flight for that. Indeed, this issue is raised long, long after the start, when the deploy process actually starts the node provisionning: ironic wants to fetch the image from glance storage, and can't do so because it lacks the necessary space.

Cheers,

C.

Changed in tripleo:
importance: Undecided → High
status: New → Triaged
milestone: none → queens-2
Changed in tripleo:
milestone: queens-2 → queens-3
Changed in tripleo:
milestone: queens-3 → queens-rc1
Changed in tripleo:
milestone: queens-rc1 → rocky-1
Changed in tripleo:
milestone: rocky-1 → rocky-2
Changed in tripleo:
milestone: rocky-2 → rocky-3
Changed in tripleo:
milestone: rocky-3 → rocky-rc1
Changed in tripleo:
milestone: rocky-rc1 → stein-1
Changed in tripleo:
milestone: stein-1 → stein-2
Changed in tripleo:
milestone: stein-2 → stein-3
Changed in tripleo:
milestone: stein-3 → stein-rc1
Changed in tripleo:
milestone: stein-rc1 → train-1
Changed in tripleo:
milestone: train-1 → train-2
Changed in tripleo:
milestone: train-2 → train-3
Changed in tripleo:
milestone: train-3 → ussuri-1
Revision history for this message
Luke Short (ekultails) wrote :
Changed in tripleo:
milestone: ussuri-1 → ussuri-2
wes hayutin (weshayutin)
Changed in tripleo:
milestone: ussuri-2 → ussuri-3
wes hayutin (weshayutin)
Changed in tripleo:
status: Triaged → Incomplete
wes hayutin (weshayutin)
Changed in tripleo:
milestone: ussuri-3 → ussuri-rc3
wes hayutin (weshayutin)
Changed in tripleo:
milestone: ussuri-rc3 → victoria-1
Changed in tripleo:
milestone: victoria-1 → victoria-3
Changed in tripleo:
importance: High → Wishlist
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.