Failed to retrieve partition

[fupingxie]

When I create an instance with ironic driver( ironic node-set-provision-state node-id active...), It would be failed with error as follows. But it happened randomly, it would be suceess sometimes.

openstack:Pike
ironic:9.1.1
driver:pxe_ipmitool, PXE Boot and iSCSI Deploy

2017-10-27 08:56:28.302 42438 DEBUG oslo_concurrency.processutils [req-1b605a82-3aaa-4822-9e43-1c676ab7c14b - - - - -] u'sudo ironic-rootwrap /etc/ironic/rootwrap.conf partprobe /dev/disk/by-path/ip-10.0.203.135:3260-iscsi-iqn.2008-10.org.openstack:2c043f94-b09e-4c42-b841-c3749ba3b112-lun-1' failed. Not Retrying. execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:422
2017-10-27 08:56:28.303 42438 ERROR ironic_lib.disk_utils [req-1b605a82-3aaa-4822-9e43-1c676ab7c14b - - - - -] Failed to retrieve partition labels on disk /dev/disk/by-path/ip-10.0.203.135:3260-iscsi-iqn.2008-10.org.openstack:2c043f94-b09e-4c42-b841-c3749ba3b112-lun-1 for node 2c043f94-b09e-4c42-b841-c3749ba3b112. Error: Unexpected error while running command.
Command: sudo ironic-rootwrap /etc/ironic/rootwrap.conf partprobe /dev/disk/by-path/ip-10.0.203.135:3260-iscsi-iqn.2008-10.org.openstack:2c043f94-b09e-4c42-b841-c3749ba3b112-lun-1
Exit code: 1
Stdout: u''
Stderr: u"Error: Error informing the kernel about modifications to partition /dev/sdh1 -- Device or resource busy. This means Linux won't know about any changes you made to /dev/sdh1 until you reboot -- so you shouldn't mount it or use it in any way before rebooting.\nError: Failed to add partition 1 (Device or resource busy)\n"
2017-10-27 08:56:28.303 42438 DEBUG oslo_concurrency.processutils [req-1b605a82-3aaa-4822-9e43-1c676ab7c14b - - - - -] Running cmd (subprocess): sudo ironic-rootwrap /etc/ironic/rootwrap.conf iscsiadm -m node -p 10.0.203.135:3260 -T iqn.2008-10.org.openstack:2c043f94-b09e-4c42-b841-c3749ba3b112 --logout execute /usr/lib/python2.7/site-packages/oslo_concurrency/processutils.py:344

[Michael Turek (mjturek)]

Hello fupingxie,

Can you give more context? What were you trying to do that caused you to hit this error? Looks like it might be related to boot from volume. Were you using this cinder driver?

[fupingxie (fpxie)]

Hello Michael Turek,
I met this problem when I create a ironic instance with openstack Pike. The driver is pxe_ipmitool. Ironic version is 9.1.1. This Error cloud happen randomly, sometimes it would be success.

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/542035
Committed: https://git.openstack.org/cgit/openstack/ironic-lib/commit/?id=d2ade05278b25e020c5dd929e14133a14dc393f1
Submitter: Zuul
Branch: master

commit d2ade05278b25e020c5dd929e14133a14dc393f1
Author: fpxie <email address hidden>
Date: Thu Feb 8 14:15:08 2018 +0800

    Add retry attempts for the partprobe command

    The partprobe command may fail because the device is busy some
    times. Add retry attempts to resolve this problem.

    Closes-Bug: #1756760
    Change-Id: Ic888e7b6c93e83511a76bf8000619531b1eec9e1

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/ironic-lib 2.13.0 release.

[OpenStack Infra (hudson-openstack)]

Fix proposed to branch: stable/queens
Review: https://review.openstack.org/631787

[OpenStack Infra (hudson-openstack)]

Reviewed: https://review.openstack.org/631787
Committed: https://git.openstack.org/cgit/openstack/ironic-lib/commit/?id=87ea79ba97ed70bd43b60be0c828c942b45417ba
Submitter: Zuul
Branch: stable/queens

commit 87ea79ba97ed70bd43b60be0c828c942b45417ba
Author: fpxie <email address hidden>
Date: Thu Feb 8 14:15:08 2018 +0800

    Add retry attempts for the partprobe command

    The partprobe command may fail because the device is busy some
    times. Add retry attempts to resolve this problem.

    Closes-Bug: #1756760
    Change-Id: Ic888e7b6c93e83511a76bf8000619531b1eec9e1
    (cherry picked from commit d2ade05278b25e020c5dd929e14133a14dc393f1)

[OpenStack Infra (hudson-openstack)]

This issue was fixed in the openstack/ironic-lib 2.12.2 release.