Operation failed: No such file or directory at overcloud image building

Bug #1816017 reported by Quique Llorente on 2019-02-15
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
tripleo
Critical
Quique Llorente

Bug Description

Looks like the overcloud image building process is failing at OVB with the following error:
http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/83d0c8e/logs/undercloud/home/zuul/overcloud_image_build.log.txt.gz

2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-ironic-python-agent.noarch 0:3.5.1-0.20190213075135.e5da6d0.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-concurrency.noarch 0:3.29.0-0.20190115144635.0767ddf.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-config.noarch 2:6.8.0-0.20190124103752.8e17ded.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-context.noarch 0:2.22.0-0.20190114133604.f65408d.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-i18n.noarch 0:3.23.0-0.20190111180822.a5fde9a.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-log.noarch 0:3.42.2-0.20190118111346.1babd44.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-serialization.noarch 0:2.28.1-0.20190115052822.0371c1d.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-service.noarch 0:1.36.0-0.20190201143914.3c645a7.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-utils.noarch 0:3.40.2-0.20190204050744.4eb6194.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-pbr.noarch 0:5.1.2-2.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-stevedore.noarch 0:1.30.0-0.20190111130314.5b39123.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 |
2019-02-15 07:44:39 | 2019-02-15 07:44:39.424 | Complete!
2019-02-15 07:44:39 | 2019-02-15 07:44:39.454 | + '[' erase == install ']'
2019-02-15 07:44:39 | 2019-02-15 07:44:39.608 | Operation failed: No such file or directory
2019-02-15 07:44:40 | 2019-02-15 07:44:40.292 | INFO diskimage_builder.block_device.blockdevice [-] State already cleaned - no way to do anything here
2019-02-15 07:44:40 | 2019-02-15 07:44:40.519 | Unmount /tmp/dib_build.HE2VZowD/mnt/tmp/yum
2019-02-15 07:44:40 | 2019-02-15 07:44:40.582 | Unmount /tmp/dib_build.HE2VZowD/mnt/tmp/in_target.d
2019-02-15 07:44:40 | 2019-02-15 07:44:40.648 | Unmount /tmp/dib_build.HE2VZowD/mnt/sys
2019-02-15 07:44:40 | 2019-02-15 07:44:40.759 | Unmount /tmp/dib_build.HE2VZowD/mnt/proc
2019-02-15 07:44:40 | 2019-02-15 07:44:40.848 | Unmount /tmp/dib_build.HE2VZowD/mnt/dev/pts
2019-02-15 07:44:40 | 2019-02-15 07:44:40.900 | Unmount /tmp/dib_build.HE2VZowD/mnt/dev
2019-02-15 07:44:42 | Exception occured while running the command
2019-02-15 07:44:42 | Traceback (most recent call last):
2019-02-15 07:44:42 | File "/usr/lib/python2.7/site-packages/tripleoclient/command.py", line 29, in run
2019-02-15 07:44:42 | super(Command, self).run(parsed_args)
2019-02-15 07:44:42 | File "/usr/lib/python2.7/site-packages/osc_lib/command/command.py", line 41, in run
2019-02-15 07:44:42 | return super(Command, self).run(parsed_args)
2019-02-15 07:44:42 | File "/usr/lib/python2.7/site-packages/cliff/command.py", line 184, in run
2019-02-15 07:44:42 | return_code = self.take_action(parsed_args) or 0
2019-02-15 07:44:42 | File "/usr/lib/python2.7/site-packages/tripleoclient/v1/overcloud_image.py", line 94, in take_action
2019-02-15 07:44:42 | manager.build()
2019-02-15 07:44:42 | File "/usr/lib/python2.7/site-packages/tripleo_common/image/build.py", line 85, in build
2019-02-15 07:44:42 | elements, options, packages, extra_options)
2019-02-15 07:44:42 | File "/usr/lib/python2.7/site-packages/tripleo_common/image/image_builder.py", line 139, in build_image
2019-02-15 07:44:42 | raise subprocess.CalledProcessError(process.returncode, cmd)
2019-02-15 07:44:42 | CalledProcessError: Command '['disk-image-create', '-a', 'amd64', '-o', './ironic-python-agent', '-t', 'qcow2', '-p', 'yum-plugin-priorities,python-hardware-detect', '--min-tmpfs=7', 'centos7', 'selinux-permissive', 'ironic-agent', 'ironic-agent-multipath', 'dynamic-login', 'element-manifest', 'network-gateway', 'enable-packages-install', 'override-pip-and-virtualenv']' returned non-zero exit status 1
2019-02-15 07:44:42 | Command '['disk-image-create', '-a', 'amd64', '-o', './ironic-python-agent', '-t', 'qcow2', '-p', 'yum-plugin-priorities,python-hardware-detect', '--min-tmpfs=7', 'centos7', 'selinux-permissive', 'ironic-agent', 'ironic-agent-multipath', 'dynamic-login', 'element-manifest', 'network-gateway', 'enable-packages-install', 'override-pip-and-virtualenv']' returned non-zero exit status 1

It's failing here [1] trying to erase the packages

[1] https://github.com/openstack/diskimage-builder/blob/master/diskimage_builder/elements/ironic-agent/post-install.d/80-ironic-agent#L9

Last trace eraing the packages

https://github.com/openstack/diskimage-builder/blob/e796b3bc1884cbb0a7259be486d835ca114cca9e/diskimage_builder/elements/yum/bin/install-packages#L139

Looks like IPA is being removed

2019-02-15 00:57:01 | 2019-02-15 00:57:01.371 | Removing for dependencies:
2019-02-15 00:57:01 | 2019-02-15 00:57:01.371 | openstack-ironic-python-agent
2019-02-15 00:57:01 | 2019-02-15 00:57:01.371 | noarch 3.5.1-0.20190213075135.e5da6d0.el7 @delorean 13 k
2

description: updated
description: updated
Quique Llorente (quiquell) wrote :
Changed in tripleo:
status: Triaged → In Progress
wes hayutin (weshayutin) on 2019-02-15
Changed in tripleo:
milestone: none → stein-3
chandan kumar (chkumar246) wrote :

Add a temporary workaround in RDO https://review.rdoproject.org/r/#/c/18905/ to unblock promotion.

Changed in tripleo:
status: In Progress → Fix Released
Changed in tripleo:
status: Fix Released → In Progress
chandan kumar (chkumar246) wrote :

https://review.openstack.org/#/c/637162/ is merged now, so closing it.

Changed in tripleo:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  Edit
Everyone can see this information.

Duplicates of this bug

Other bug subscribers