Fuel for OpenStack

provisioning failed with ProcessExecutionError in fuel-agent

Bug #1413632 reported by Tatyanka on 2015-01-22

This bug report is a duplicate of: Bug #1410471: [image based provisioning] incorrect "device is busy" handling for non-RAID devices. Edit Remove

This bug affects 1 person

Affects		Status	Importance	Assigned to	Milestone
	Fuel for OpenStack	New	High	Alexander Gordeev	Fuel for OpenStack 6.1

Bug Description

[root@nailgun bootstrap]# cat /etc/fuel/version.yaml
VERSION:
  feature_groups:
    - mirantis
  production: "docker"
  release: "6.1"
  api: "1.0"
  build_number: "74"
  build_id: "2015-01-21_22-54-45"
  nailgun_sha: "22321c5529ef95ff6586079894916f8963f4079e"
  astute_sha: "f640780d1c7ebe89e4f343736500945525799ee0"
  fuellib_sha: "1050db4614a0ee347757bf5aa41308a319943758"
  ostf_sha: "c94d4dc4fde6fbd18bdfbb508f5e12e9188ad725"
  fuelmain_sha: ""
[root@nailgun bootstrap]#

Cetnos ha flat

2015-01-22T03:40:11.769754+00:00 info: 2015-01-22 03:38:09.684 1815 DEBUG fuel_agent.utils.utils [-] Trying to execute command: pvcreate --metadatacopies 2 --metadatasize 28m /dev/vdc4
2015-01-22T03:40:11.769754+00:00 info: 2015-01-22 03:38:09.689 1815 CRITICAL fuel-agent [-] ProcessExecutionError: Unexpected error while running command.
2015-01-22T03:40:11.769768+00:00 info: Command: pvcreate --metadatacopies 2 --metadatasize 28m /dev/vdc4
2015-01-22T03:40:11.769768+00:00 info: Exit code: 5
2015-01-22T03:40:11.769771+00:00 info: Stdout: ''
2015-01-22T03:40:11.769771+00:00 info: Stderr: 'File descriptor 3 (/var/lock/provision.lock) leaked on pvcreate invocation. Parent PID 1815: /usr/bin/python\nFile descriptor 4 (/var/log/fuel-agent.log) leaked on pvcreate invocation. Parent PID 1815: /usr/bin/python\n Device /dev/vdc4 not found (or ignored by filtering).\n'
2015-01-22T03:40:11.769777+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent Traceback (most recent call last):
2015-01-22T03:40:11.769777+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent File "/usr/bin/provision", line 10, in <module>
2015-01-22T03:40:11.769782+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent sys.exit(provision())
2015-01-22T03:40:11.769782+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent File "/usr/lib/python2.6/site-packages/fuel_agent/cmd/agent.py", line 37, in provision
2015-01-22T03:40:11.769812+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent main(['do_provisioning'])
2015-01-22T03:40:11.769812+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent File "/usr/lib/python2.6/site-packages/fuel_agent/cmd/agent.py", line 67, in main
2015-01-22T03:40:11.769817+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent getattr(mgr, action)()
2015-01-22T03:40:11.769817+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent File "/usr/lib/python2.6/site-packages/fuel_agent/manager.py", line 287, in do_provisioning
2015-01-22T03:40:11.769821+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent self.do_partitioning()
2015-01-22T03:40:11.769821+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent File "/usr/lib/python2.6/site-packages/fuel_agent/manager.py", line 116, in do_partitioning
2015-01-22T03:40:11.769828+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent metadatacopies=pv.metadatacopies)
2015-01-22T03:40:11.769913+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent File "/usr/lib/python2.6/site-packages/fuel_agent/utils/lvm_utils.py", line 62, in pvcreate
2015-01-22T03:40:11.770048+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent pvname, check_exit_code=[0])
2015-01-22T03:40:11.770172+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent File "/usr/lib/python2.6/site-packages/fuel_agent/utils/utils.py", line 82, in execute
2015-01-22T03:40:11.770312+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent cmd=command)
2015-01-22T03:40:11.770457+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent ProcessExecutionError: Unexpected error while running command.
2015-01-22T03:40:11.770603+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent Command: pvcreate --metadatacopies 2 --metadatasize 28m /dev/vdc4
2015-01-22T03:40:11.770747+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent Exit code: 5
2015-01-22T03:40:11.770907+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent Stdout: ''
2015-01-22T03:40:11.771059+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent Stderr: 'File descriptor 3 (/var/lock/provision.lock) leaked on pvcreate invocation. Parent PID 1815: /usr/bin/python\nFile descriptor 4 (/var/log/fuel-agent.log) leaked on pvcreate invocation. Parent PID 1815: /usr/bin/python\n Device /dev/vdc4 not found (or ignored by filtering).\n'
2015-01-22T03:40:11.771155+00:00 info: 2015-01-22 03:38:09.689 1815 TRACE fuel-agent
(END)

Tags:

Revision history for this message

Tatyanka (tatyana-leontovich) wrote on 2015-01-22:

fail_error_deploy_ha_flat-2015_01_22__03_42_31.tar.gz Edit (588.5 KiB, application/x-tar)

Changed in fuel:
assignee:	nobody → Vladimir Kozhukalov (kozhukalov)

Revision history for this message

Tatyanka (tatyana-leontovich) wrote on 2015-01-22:

http://jenkins-product.srt.mirantis.net:8080/view/6.1_swarm/job/6.1.system_test.centos.known_issues/9/consoleFull

Vladimir Kozhukalov (kozhukalov) on 2015-01-22

Changed in fuel:
assignee:	Vladimir Kozhukalov (kozhukalov) → Aleksandr Gordeev (a-gordeev)

Revision history for this message

Alexander Gordeev (a-gordeev) wrote on 2015-01-22:

the actual failure caused by:

2015-01-22T03:40:11.764785+00:00 info: 2015-01-22 03:38:09.326 1815 DEBUG fuel_agent.utils.partition_utils [-] Parted output:
2015-01-22T03:40:11.764785+00:00 info: Warning: WARNING: the kernel failed to re-read the partition table on /dev/vdc (Device or resource busy). As a result, it may not reflect all of your changes until after reboot.

sounds like https://bugs.launchpad.net/fuel/+bug/1410471 strikes back