Operation failed: No such file or directory at overcloud image building

Bug #1816017 reported by Quique Llorente
14
This bug affects 2 people
Affects Status Importance Assigned to Milestone
tripleo
Fix Released
Critical
Quique Llorente

Bug Description

Looks like the overcloud image building process is failing at OVB with the following error:
http://logs.rdoproject.org/openstack-periodic/git.openstack.org/openstack-infra/tripleo-ci/master/periodic-tripleo-ci-centos-7-ovb-3ctlr_1comp-featureset001-master/83d0c8e/logs/undercloud/home/zuul/overcloud_image_build.log.txt.gz

2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-ironic-python-agent.noarch 0:3.5.1-0.20190213075135.e5da6d0.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-concurrency.noarch 0:3.29.0-0.20190115144635.0767ddf.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-config.noarch 2:6.8.0-0.20190124103752.8e17ded.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-context.noarch 0:2.22.0-0.20190114133604.f65408d.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-i18n.noarch 0:3.23.0-0.20190111180822.a5fde9a.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-log.noarch 0:3.42.2-0.20190118111346.1babd44.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-serialization.noarch 0:2.28.1-0.20190115052822.0371c1d.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-service.noarch 0:1.36.0-0.20190201143914.3c645a7.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-oslo-utils.noarch 0:3.40.2-0.20190204050744.4eb6194.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-pbr.noarch 0:5.1.2-2.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 | python2-stevedore.noarch 0:1.30.0-0.20190111130314.5b39123.el7
2019-02-15 07:44:39 | 2019-02-15 07:44:39.423 |
2019-02-15 07:44:39 | 2019-02-15 07:44:39.424 | Complete!
2019-02-15 07:44:39 | 2019-02-15 07:44:39.454 | + '[' erase == install ']'
2019-02-15 07:44:39 | 2019-02-15 07:44:39.608 | Operation failed: No such file or directory
2019-02-15 07:44:40 | 2019-02-15 07:44:40.292 | INFO diskimage_builder.block_device.blockdevice [-] State already cleaned - no way to do anything here
2019-02-15 07:44:40 | 2019-02-15 07:44:40.519 | Unmount /tmp/dib_build.HE2VZowD/mnt/tmp/yum
2019-02-15 07:44:40 | 2019-02-15 07:44:40.582 | Unmount /tmp/dib_build.HE2VZowD/mnt/tmp/in_target.d
2019-02-15 07:44:40 | 2019-02-15 07:44:40.648 | Unmount /tmp/dib_build.HE2VZowD/mnt/sys
2019-02-15 07:44:40 | 2019-02-15 07:44:40.759 | Unmount /tmp/dib_build.HE2VZowD/mnt/proc
2019-02-15 07:44:40 | 2019-02-15 07:44:40.848 | Unmount /tmp/dib_build.HE2VZowD/mnt/dev/pts
2019-02-15 07:44:40 | 2019-02-15 07:44:40.900 | Unmount /tmp/dib_build.HE2VZowD/mnt/dev
2019-02-15 07:44:42 | Exception occured while running the command
2019-02-15 07:44:42 | Traceback (most recent call last):
2019-02-15 07:44:42 | File "/usr/lib/python2.7/site-packages/tripleoclient/command.py", line 29, in run
2019-02-15 07:44:42 | super(Command, self).run(parsed_args)
2019-02-15 07:44:42 | File "/usr/lib/python2.7/site-packages/osc_lib/command/command.py", line 41, in run
2019-02-15 07:44:42 | return super(Command, self).run(parsed_args)
2019-02-15 07:44:42 | File "/usr/lib/python2.7/site-packages/cliff/command.py", line 184, in run
2019-02-15 07:44:42 | return_code = self.take_action(parsed_args) or 0
2019-02-15 07:44:42 | File "/usr/lib/python2.7/site-packages/tripleoclient/v1/overcloud_image.py", line 94, in take_action
2019-02-15 07:44:42 | manager.build()
2019-02-15 07:44:42 | File "/usr/lib/python2.7/site-packages/tripleo_common/image/build.py", line 85, in build
2019-02-15 07:44:42 | elements, options, packages, extra_options)
2019-02-15 07:44:42 | File "/usr/lib/python2.7/site-packages/tripleo_common/image/image_builder.py", line 139, in build_image
2019-02-15 07:44:42 | raise subprocess.CalledProcessError(process.returncode, cmd)
2019-02-15 07:44:42 | CalledProcessError: Command '['disk-image-create', '-a', 'amd64', '-o', './ironic-python-agent', '-t', 'qcow2', '-p', 'yum-plugin-priorities,python-hardware-detect', '--min-tmpfs=7', 'centos7', 'selinux-permissive', 'ironic-agent', 'ironic-agent-multipath', 'dynamic-login', 'element-manifest', 'network-gateway', 'enable-packages-install', 'override-pip-and-virtualenv']' returned non-zero exit status 1
2019-02-15 07:44:42 | Command '['disk-image-create', '-a', 'amd64', '-o', './ironic-python-agent', '-t', 'qcow2', '-p', 'yum-plugin-priorities,python-hardware-detect', '--min-tmpfs=7', 'centos7', 'selinux-permissive', 'ironic-agent', 'ironic-agent-multipath', 'dynamic-login', 'element-manifest', 'network-gateway', 'enable-packages-install', 'override-pip-and-virtualenv']' returned non-zero exit status 1

It's failing here [1] trying to erase the packages

[1] https://github.com/openstack/diskimage-builder/blob/master/diskimage_builder/elements/ironic-agent/post-install.d/80-ironic-agent#L9

Last trace eraing the packages

https://github.com/openstack/diskimage-builder/blob/e796b3bc1884cbb0a7259be486d835ca114cca9e/diskimage_builder/elements/yum/bin/install-packages#L139

Looks like IPA is being removed

2019-02-15 00:57:01 | 2019-02-15 00:57:01.371 | Removing for dependencies:
2019-02-15 00:57:01 | 2019-02-15 00:57:01.371 | openstack-ironic-python-agent
2019-02-15 00:57:01 | 2019-02-15 00:57:01.371 | noarch 3.5.1-0.20190213075135.e5da6d0.el7 @delorean 13 k
2

description: updated
description: updated
Revision history for this message
Quique Llorente (quiquell) wrote :
description: updated
Revision history for this message
Quique Llorente (quiquell) wrote :
Changed in tripleo:
status: Triaged → In Progress
Revision history for this message
chandan kumar (chkumar246) wrote :
Revision history for this message
Quique Llorente (quiquell) wrote :
wes hayutin (weshayutin)
Changed in tripleo:
milestone: none → stein-3
Revision history for this message
chandan kumar (chkumar246) wrote :

Add a temporary workaround in RDO https://review.rdoproject.org/r/#/c/18905/ to unblock promotion.

Changed in tripleo:
status: In Progress → Fix Released
Changed in tripleo:
status: Fix Released → In Progress
Revision history for this message
chandan kumar (chkumar246) wrote :

https://review.openstack.org/#/c/637162/ is merged now, so closing it.

Changed in tripleo:
status: In Progress → Fix Released
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Duplicates of this bug

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.