Deploy fails with disks marked as RAID by mdadm

Bug #1481676 reported by Vyacheslav Struk
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Confirmed
Undecided
Unassigned

Bug Description

Fuel version: 6.1 (525 iso, release)

Server had two disks marked by mdadm as a part of the raid from previous installation. Looks like mdadm at bootstrap automatically assembled marked disks to MD device and then deploy failed.

2015-08-04T16:40:44.409841+00:00 info: UUID : 92922a7c:38198280:cb18edc3:ee51bac8
2015-08-04T16:40:44.409969+00:00 info: Events : 35
2015-08-04T16:40:44.410090+00:00 info:
2015-08-04T16:40:44.410211+00:00 info: Number Major Minor RaidDevice State
2015-08-04T16:40:44.410335+00:00 info: 0 8 1 0 active sync /dev/sda1
2015-08-04T16:40:44.410470+00:00 info: 1 8 17 1 active sync /dev/sdb1
2015-08-04T16:40:44.410568+00:00 info:
2015-08-04T16:40:44.410746+00:00 info: 2015-08-04 16:40:43.994 8644 DEBUG fuel_agent.utils.md_utils [-] Found md devices: [{'name': '/dev/md126', 'Raid Level': 'raid0', 'devices': ['/dev/sda2', '/dev/sdb2'], 'UUID': '09e17121:4754311e:3d8845a8:c9cb13bf', 'Failed Devices': '0', 'State': 'clean', 'Version': '1.2', 'Spare Devices': '0', 'Active Devices': '2', 'Raid Devices': '2'}, {'name': '/dev/md127', 'Raid Level': 'raid1', 'devices': ['/dev/sda1', '/dev/sdb1'], 'UUID': '92922a7c:38198280:cb18edc3:ee51bac8', 'Failed Devices': '0', 'State': 'clean', 'Version': '1.2', 'Spare Devices': '0', 'Active Devices': '2', 'Raid Devices': '2'}]
2015-08-04T16:40:44.410860+00:00 info: 2015-08-04 16:40:43.994 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: udevadm settle --quiet
2015-08-04T16:40:44.410996+00:00 info: 2015-08-04 16:40:43.997 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: mdadm --stop /dev/md126
2015-08-04T16:40:44.411125+00:00 info: 2015-08-04 16:40:44.001 8644 WARNING fuel_agent.utils.utils [-] Failed to execute command: Unexpected error while running command.
2015-08-04T16:40:44.411242+00:00 info: Command: mdadm --stop /dev/md126
2015-08-04T16:40:44.411363+00:00 info: Exit code: 1
2015-08-04T16:40:44.411483+00:00 info: Stdout: ''
2015-08-04T16:40:44.411611+00:00 info: Stderr: 'mdadm: Cannot get exclusive access to /dev/md126:Perhaps a running process, mounted filesystem or active volume group?\n'
2015-08-04T16:40:44.411727+00:00 info: 2015-08-04 16:40:44.001 8644 ERROR fuel_agent.cmd.agent [-] Unexpected error while running command.
2015-08-04T16:40:44.411848+00:00 info: Command: mdadm --stop /dev/md126
2015-08-04T16:40:44.412028+00:00 info: Exit code: 1
2015-08-04T16:40:44.412132+00:00 info: Stdout: ''
2015-08-04T16:40:44.412257+00:00 info: Stderr: 'mdadm: Cannot get exclusive access to /dev/md126:Perhaps a running process, mounted filesystem or active volume group?\n'
2015-08-04T16:40:44.412380+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent Traceback (most recent call last):
2015-08-04T16:40:44.412509+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent File "/usr/lib/python2.6/site-packages/fuel_agent/cmd/agent.py", line 95, in main
2015-08-04T16:40:44.412633+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent getattr(mgr, action)()
2015-08-04T16:40:44.412762+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent File "/usr/lib/python2.6/site-packages/fuel_agent/manager.py", line 468, in do_provisioning
2015-08-04T16:40:44.412885+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent self.do_partitioning()
2015-08-04T16:40:44.413032+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent File "/usr/lib/python2.6/site-packages/fuel_agent/manager.py", line 106, in do_partitioning
2015-08-04T16:40:44.413150+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent mu.mdclean_all()
2015-08-04T16:40:44.413284+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent File "/usr/lib/python2.6/site-packages/fuel_agent/utils/md_utils.py", line 161, in mdclean_all
2015-08-04T16:40:44.413407+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent mdremove(md['name'])
2015-08-04T16:40:44.413535+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent File "/usr/lib/python2.6/site-packages/fuel_agent/utils/md_utils.py", line 148, in mdremove
2015-08-04T16:40:44.413661+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent utils.execute('mdadm', '--stop', mdname, check_exit_code=[0])
2015-08-04T16:40:44.413789+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent File "/usr/lib/python2.6/site-packages/fuel_agent/utils/utils.py", line 129, in execute
2015-08-04T16:40:44.413913+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent stderr=stderr, cmd=command)
2015-08-04T16:40:44.414047+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent ProcessExecutionError: Unexpected error while running command.
2015-08-04T16:40:44.414181+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent Command: mdadm --stop /dev/md126
2015-08-04T16:40:44.414287+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent Exit code: 1
2015-08-04T16:40:44.414428+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent Stdout: ''
2015-08-04T16:40:44.414555+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent Stderr: 'mdadm: Cannot get exclusive access to /dev/md126:Perhaps a running process, mounted filesystem or active volume group?\n'
2015-08-04T16:40:44.414675+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent
[root@fuel tmp]# cat /tmp/fuel-agent.log
2015-08-04T16:40:43.885448+00:00 info: 2015-08-04 16:40:43.751 8644 DEBUG fuel_agent.cmd.agent [-] Input data: {u'profile': u'ubuntu_1404_x86_64', u'hostname': u'node-2.domain.tld', u'name_servers_search': u'"domain.tld"', u'uid': u'2', u'interfaces': {u'eth1': {u'static': u'0', u'mac_address': u'0c:c4:7a:31:bc:ef'}, u'eth0': {u'dns_name': u'node-2.domain.tld', u'netmask': u'255.255.255.0', u'mac_address': u'0c:c4:7a:31:bc:ee', u'ip_address': u'10.20.0.4', u'static': u'0'}}, u'interfaces_extra': {u'eth1': {u'onboot': u'no', u'peerdns': u'no'}, u'eth0': {u'onboot': u'yes', u'peerdns': u'no'}}, u'power_type': u'ssh', u'power_user': u'root', u'kernel_options': {u'udevrules': u'0c:c4:7a:31:bc:ee_eth0,0c:c4:7a:31:bc:ef_eth1', u'netcfg/choose_interface': u'0c:c4:7a:31:bc:ee'}, u'name': u'node-2', u'power_address': u'10.20.0.4', u'name_servers': u'"10.20.0.2"', u'slave_name': u'node-2', u'netboot_enabled': u'1', u'power_pass': u'/root/.ssh/bootstrap.rsa', u'ks_meta': {u'gw': u'10.20.0.2', u'mco_enable': 1, u'mlnx_iser_enabled': False, u'mco_user': u'mcollective', u'install_log_2_syslog': 1, u'image_data': {u'/boot': {u'container': u'gzip', u'uri': u'http://10.20.0.2:8080/targetimages/env_1_ubuntu_1404_amd64-boot.img.gz', u'format': u'ext2'}, u'/': {u'container': u'gzip', u'uri': u'http://10.20.0.2:8080/targetimages/env_1_ubuntu_1404_amd64.img.gz', u'format': u'ext4'}}, u'mco_password': u'9exilC9l', u'puppet_master': u'fuel.domain.tld', u'pm_data': {u'kernel_params': u'console=ttyS0,9600 console=tty0 net.ifnames=0 biosdevname=0 rootdelay=90 nomodeset', u'ks_spaces': [{u'name': u'sda', u'extra': [u'disk/by-id/wwn-0x55cd2e404b75acb6', u'disk/by-id/scsi-SATA_INTEL_SSDSC2BB4BTWL5021011L480QGN', u'disk/by-id/ata-INTEL_SSDSC2BB480G4_BTWL5021011L480QGN'], u'free_space': 457234, u'volumes': [{u'type': u'boot', u'size': 300}, {u'mount': u'/boot', u'type': u'raid', u'file_system': u'ext2', u'name': u'Boot', u'size': 200}, {u'type': u'lvm_meta_pool', u'size': 0}, {u'vg': u'os', u'type': u'pv', u'lvm_meta_size': 64, u'size': 84032}, {u'vg': u'vm', u'type': u'pv', u'lvm_meta_size': 64, u'size': 373330}], u'type': u'disk', u'id': u'sda', u'size': 457862}, {u'name': u'sdb', u'extra': [u'disk/by-id/wwn-0x55cd2e404b75a8b8', u'disk/by-id/scsi-SATA_INTEL_SSDSC2BB4BTWL5021005B480QGN', u'disk/by-id/ata-INTEL_SSDSC2BB480G4_BTWL5021005B480QGN'], u'free_space': 457234, u'volumes': [{u'type': u'boot', u'size': 300}, {u'mount': u'/boot', u'type': u'raid', u'file_system': u'ext2', u'name': u'Boot', u'size': 200}, {u'type': u'lvm_meta_pool', u'size': 64}, {u'vg': u'os', u'type': u'pv', u'lvm_meta_size': 0, u'size': 0}, {u'vg': u'vm', u'type': u'pv', u'lvm_meta_size': 64, u'size': 457298}], u'type': u'disk', u'id': u'disk/by-path/pci-0000:00:1f.2-scsi-0:0:0:0', u'size': 457862}, {u'_allocate_size': u'min', u'label': u'Base System', u'min_size': 83968, u'volumes': [{u'mount': u'/', u'type': u'lv', u'name': u'root', u'file_system': u'ext4', u'size': 51200}, {u'mount': u'swap', u'type': u'lv', u'name': u'swap', u'file_system': u'swap', u'size': 32768}], u'type': u'vg', u'id': u'os'}, {u'_allocate_size': u'all', u'label': u'Virtual Storage', u'min_size': 5120, u'volumes': [{u'mount': u'/var/lib/nova', u'type': u'lv', u'name': u'nova', u'file_system': u'xfs', u'size': 830500}], u'type': u'vg', u'id': u'vm'}]}, u'mlnx_plugin_mode': u'disabled', u'master_ip': u'10.20.0.2', u'timezone': u'Etc/UTC', u'mlnx_vf_num': u'16', u'admin_net': u'10.20.0.0/24', u'mco_host': u'10.20.0.2', u'authorized_keys': [u'"ssh-rsa AAAAB3NzaC1yc2EAAAABIwAAAQEAzqbCjjXjS7qjy2sUk1tIv3/YKSFQnfu7qaK+aseUz+LLQYezCKjseaoq7wqze6FBnVSVSpEAbBDsbxR+S4eiYh+zQ/5L5KHSlssrE1rq5sMcJCSz9qqNsrulVrAzkF/Sb8/Fo3ia3cqH5PjkQJ9UOfPVywVfMrOT9CtK1KqiA9GKvIO79YfkhVqYXFgoB8Gapym3OztIHx3RlT8zsRSxqBmpfUM6LD8RyXlZ4ynW5xkT3130Xlx9JbCQYV5/wIKnuwAw5TDLgGH4BNiPS6lXvzTb2ZnjQSY9sFORiVsMGsIwqmBHqYAX3Jqq9grFeJjwOLFqH7+Tx0n67vLbwlItLw== <email address hidden>"'], u'mco_vhost': u'mcollective', u'repo_setup': {u'installer_kernel': {u'local': u'/var/www/nailgun/ubuntu/x86_64/images/linux', u'remote_relative': u'dists/trusty/main/installer-amd64/current/images/netboot/ubuntu-installer/amd64/linux'}, u'repos': [{u'name': u'ubuntu', u'section': u'main universe multiverse', u'uri': u'http://archive.ubuntu.com/ubuntu/', u'priority': None, u'suite': u'trusty', u'type': u'deb'}, {u'name': u'ubuntu-updates', u'section': u'main universe multiverse', u'uri': u'http://archive.ubuntu.com/ubuntu/', u'priority': None, u'suite': u'trusty-updates', u'type': u'deb'}, {u'name': u'ubuntu-security', u'section': u'main universe multiverse', u'uri': u'http://archive.ubuntu.com/ubuntu/', u'priority': None, u'suite': u'trusty-security', u'type': u'deb'}, {u'name': u'mos', u'section': u'main restricted', u'uri': u'http://10.20.0.2:8080/2014.2.2-6.1/ubuntu/x86_64', u'priority': 1050, u'suite': u'mos6.1', u'type': u'deb'}, {u'name': u'mos-updates', u'section': u'main restricted', u'uri': u'http://mirror.fuel-infra.org/mos/ubuntu/', u'priority': 1050, u'suite': u'mos6.1-updates', u'type': u'deb'}, {u'name': u'mos-security', u'section': u'main restricted', u'uri': u'http://mirror.fuel-infra.org/mos/ubuntu/', u'priority': 1050, u'suite': u'mos6.1-security', u'type': u'deb'}, {u'name': u'mos-holdback', u'section': u'main restricted', u'uri': u'http://mirror.fuel-infra.org/mos/ubuntu/', u'priority': 1100, u'suite': u'mos6.1-holdback', u'type': u'deb'}, {u'name': u'Auxiliary', u'section': u'main restricted', u'uri': u'http://10.20.0.2:8080/2014.2.2-6.1/ubuntu/auxiliary', u'priority': 1150, u'suite': u'auxiliary', u'type': u'deb'}], u'installer_initrd': {u'local': u'/var/www/nailgun/ubuntu/x86_64/images/initrd.gz', u'remote_relative': u'dists/trusty/main/installer-amd64/current/images/netboot/ubuntu-installer/amd64/initrd.gz'}, u'metadata': {u'always_editable': True, u'weight': 50, u'label': u'Repositories'}}, u'mco_pskey': u'unset', u'puppet_enable': 0, u'fuel_version': u'6.1', u'puppet_auto_setup': 1, u'mco_auto_setup': 1, u'auth_key': u'""', u'mco_connector': u'rabbitmq'}}
2015-08-04T16:40:43.885448+00:00 info: 2015-08-04 16:40:43.752 8644 DEBUG fuel_agent.utils.utils [-] Trying to get driver: fuel_agent.drivers.nailgun
2015-08-04T16:40:43.885724+00:00 info: 2015-08-04 16:40:43.759 8644 DEBUG stevedore.extension [-] found extension EntryPoint.parse('nailgun = fuel_agent.drivers.nailgun:Nailgun')
2015-08-04T16:40:43.885724+00:00 info: 2015-08-04 16:40:43.771 8644 DEBUG stevedore.extension [-] found extension EntryPoint.parse('nailgun_build_image = fuel_agent.drivers.nailgun:NailgunBuildImage')
2015-08-04T16:40:43.885814+00:00 info: 2015-08-04 16:40:43.771 8644 DEBUG fuel_agent.utils.utils [-] Found driver: Nailgun
2015-08-04T16:40:43.885957+00:00 info: 2015-08-04 16:40:43.771 8644 DEBUG fuel_agent.drivers.nailgun [-] --- Preparing partition scheme ---
2015-08-04T16:40:43.886111+00:00 info: 2015-08-04 16:40:43.790 8644 DEBUG fuel_agent.drivers.nailgun [-] Looping over all disks in provision data
2015-08-04T16:40:43.886282+00:00 info: 2015-08-04 16:40:43.790 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing disk sda
2015-08-04T16:40:43.886410+00:00 info: 2015-08-04 16:40:43.790 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding gpt table on disk sda
2015-08-04T16:40:43.886553+00:00 info: 2015-08-04 16:40:43.790 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: udevadm info --export-db
2015-08-04T16:40:43.886732+00:00 info: 2015-08-04 16:40:43.859 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: udevadm info --query=property --export --name=/dev/sda
2015-08-04T16:40:43.886819+00:00 info: 2015-08-04 16:40:43.863 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: blockdev --getsz --getro --getss --getpbsz --getsize64 --getiomin --getioopt --getra --getalignoff --getmaxsect /dev/sda
2015-08-04T16:40:43.886954+00:00 info: 2015-08-04 16:40:43.866 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: udevadm info --query=property --export --name=/dev/sda1
2015-08-04T16:40:43.887173+00:00 info: 2015-08-04 16:40:43.870 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: blockdev --getsz --getro --getss --getpbsz --getsize64 --getiomin --getioopt --getra --getalignoff --getmaxsect /dev/sda1
2015-08-04T16:40:44.393062+00:00 info: 2015-08-04 16:40:43.873 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: udevadm info --query=property --export --name=/dev/sda2
2015-08-04T16:40:44.393062+00:00 info: 2015-08-04 16:40:43.877 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: blockdev --getsz --getro --getss --getpbsz --getsize64 --getiomin --getioopt --getra --getalignoff --getmaxsect /dev/sda2
2015-08-04T16:40:44.393271+00:00 info: 2015-08-04 16:40:43.880 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: udevadm info --query=property --export --name=/dev/sdb
2015-08-04T16:40:44.393438+00:00 info: 2015-08-04 16:40:43.884 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: blockdev --getsz --getro --getss --getpbsz --getsize64 --getiomin --getioopt --getra --getalignoff --getmaxsect /dev/sdb
2015-08-04T16:40:44.393583+00:00 info: 2015-08-04 16:40:43.887 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: udevadm info --query=property --export --name=/dev/sdb1
2015-08-04T16:40:44.393716+00:00 info: 2015-08-04 16:40:43.891 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: blockdev --getsz --getro --getss --getpbsz --getsize64 --getiomin --getioopt --getra --getalignoff --getmaxsect /dev/sdb1
2015-08-04T16:40:44.393854+00:00 info: 2015-08-04 16:40:43.894 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: udevadm info --query=property --export --name=/dev/sdb2
2015-08-04T16:40:44.394032+00:00 info: 2015-08-04 16:40:43.897 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: blockdev --getsz --getro --getss --getpbsz --getsize64 --getiomin --getioopt --getra --getalignoff --getmaxsect /dev/sdb2
2015-08-04T16:40:44.394156+00:00 info: 2015-08-04 16:40:43.900 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: udevadm info --query=property --export --name=/dev/dm-0
2015-08-04T16:40:44.394290+00:00 info: 2015-08-04 16:40:43.904 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: blockdev --getsz --getro --getss --getpbsz --getsize64 --getiomin --getioopt --getra --getalignoff --getmaxsect /dev/dm-0
2015-08-04T16:40:44.394422+00:00 info: 2015-08-04 16:40:43.907 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: udevadm info --query=property --export --name=/dev/dm-1
2015-08-04T16:40:44.394555+00:00 info: 2015-08-04 16:40:43.910 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: blockdev --getsz --getro --getss --getpbsz --getsize64 --getiomin --getioopt --getra --getalignoff --getmaxsect /dev/dm-1
2015-08-04T16:40:44.394699+00:00 info: 2015-08-04 16:40:43.913 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding bootloader stage0 on disk sda
2015-08-04T16:40:44.394828+00:00 info: 2015-08-04 16:40:43.914 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding bios_grub partition on disk sda: size=24
2015-08-04T16:40:44.394970+00:00 info: 2015-08-04 16:40:43.914 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding UEFI partition on disk sda: size=200
2015-08-04T16:40:44.395127+00:00 info: 2015-08-04 16:40:43.914 8644 DEBUG fuel_agent.drivers.nailgun [-] Looping over all volumes on disk sda
2015-08-04T16:40:44.395237+00:00 info: 2015-08-04 16:40:43.914 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing volume: name=None type=boot size=300 mount=None vg=None
2015-08-04T16:40:44.395370+00:00 info: 2015-08-04 16:40:43.914 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing volume: name=Boot type=raid size=200 mount=/boot vg=None
2015-08-04T16:40:44.395502+00:00 info: 2015-08-04 16:40:43.915 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding /boot partition on disk sda: size=200
2015-08-04T16:40:44.395634+00:00 info: 2015-08-04 16:40:43.915 8644 DEBUG fuel_agent.drivers.nailgun [-] Partition name: /dev/sda3
2015-08-04T16:40:44.395761+00:00 info: 2015-08-04 16:40:43.915 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding file system on partition: mount=/boot type=ext2
2015-08-04T16:40:44.395911+00:00 info: 2015-08-04 16:40:43.915 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing volume: name=None type=lvm_meta_pool size=0 mount=None vg=None
2015-08-04T16:40:44.396048+00:00 info: 2015-08-04 16:40:43.915 8644 DEBUG fuel_agent.drivers.nailgun [-] Volume size is zero. Skipping.
2015-08-04T16:40:44.396214+00:00 info: 2015-08-04 16:40:43.915 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing volume: name=None type=pv size=84032 mount=None vg=os
2015-08-04T16:40:44.396316+00:00 info: 2015-08-04 16:40:43.916 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding partition on disk sda: size=84032
2015-08-04T16:40:44.396444+00:00 info: 2015-08-04 16:40:43.916 8644 DEBUG fuel_agent.drivers.nailgun [-] Partition name: /dev/sda4
2015-08-04T16:40:44.396577+00:00 info: 2015-08-04 16:40:43.916 8644 DEBUG fuel_agent.drivers.nailgun [-] Creating pv on partition: pv=/dev/sda4 vg=os
2015-08-04T16:40:44.396711+00:00 info: 2015-08-04 16:40:43.916 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing volume: name=None type=pv size=373330 mount=None vg=vm
2015-08-04T16:40:44.396843+00:00 info: 2015-08-04 16:40:43.916 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding partition on disk sda: size=373330
2015-08-04T16:40:44.396982+00:00 info: 2015-08-04 16:40:43.916 8644 DEBUG fuel_agent.drivers.nailgun [-] Partition name: /dev/sda5
2015-08-04T16:40:44.397129+00:00 info: 2015-08-04 16:40:43.916 8644 DEBUG fuel_agent.drivers.nailgun [-] Creating pv on partition: pv=/dev/sda5 vg=vm
2015-08-04T16:40:44.397258+00:00 info: 2015-08-04 16:40:43.917 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding configdrive partition on disk sda: size=20
2015-08-04T16:40:44.397388+00:00 info: 2015-08-04 16:40:43.917 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing disk sdb
2015-08-04T16:40:44.397520+00:00 info: 2015-08-04 16:40:43.917 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding gpt table on disk sdb
2015-08-04T16:40:44.397652+00:00 info: 2015-08-04 16:40:43.917 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding bootloader stage0 on disk sdb
2015-08-04T16:40:44.397792+00:00 info: 2015-08-04 16:40:43.917 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding bios_grub partition on disk sdb: size=24
2015-08-04T16:40:44.397916+00:00 info: 2015-08-04 16:40:43.917 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding UEFI partition on disk sdb: size=200
2015-08-04T16:40:44.398057+00:00 info: 2015-08-04 16:40:43.918 8644 DEBUG fuel_agent.drivers.nailgun [-] Looping over all volumes on disk sdb
2015-08-04T16:40:44.398184+00:00 info: 2015-08-04 16:40:43.918 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing volume: name=None type=boot size=300 mount=None vg=None
2015-08-04T16:40:44.398328+00:00 info: 2015-08-04 16:40:43.918 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing volume: name=Boot type=raid size=200 mount=/boot vg=None
2015-08-04T16:40:44.398463+00:00 info: 2015-08-04 16:40:43.918 8644 DEBUG fuel_agent.drivers.nailgun [-] No need to create partition on disk sdb. Skipping.
2015-08-04T16:40:44.398596+00:00 info: 2015-08-04 16:40:43.918 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing volume: name=None type=lvm_meta_pool size=64 mount=None vg=None
2015-08-04T16:40:44.398730+00:00 info: 2015-08-04 16:40:43.918 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing volume: name=None type=pv size=0 mount=None vg=os
2015-08-04T16:40:44.398861+00:00 info: 2015-08-04 16:40:43.918 8644 DEBUG fuel_agent.drivers.nailgun [-] Volume size is zero. Skipping.
2015-08-04T16:40:44.399019+00:00 info: 2015-08-04 16:40:43.919 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing volume: name=None type=pv size=457298 mount=None vg=vm
2015-08-04T16:40:44.399140+00:00 info: 2015-08-04 16:40:43.919 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding partition on disk sdb: size=457298
2015-08-04T16:40:44.399268+00:00 info: 2015-08-04 16:40:43.919 8644 DEBUG fuel_agent.drivers.nailgun [-] Partition name: /dev/sdb3
2015-08-04T16:40:44.399393+00:00 info: 2015-08-04 16:40:43.919 8644 DEBUG fuel_agent.drivers.nailgun [-] Creating pv on partition: pv=/dev/sdb3 vg=vm
2015-08-04T16:40:44.399526+00:00 info: 2015-08-04 16:40:43.919 8644 DEBUG fuel_agent.drivers.nailgun [-] Looping over all volume groups in provision data
2015-08-04T16:40:44.399670+00:00 info: 2015-08-04 16:40:43.919 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing vg os
2015-08-04T16:40:44.399799+00:00 info: 2015-08-04 16:40:43.919 8644 DEBUG fuel_agent.drivers.nailgun [-] Looping over all logical volumes in vg os
2015-08-04T16:40:44.399937+00:00 info: 2015-08-04 16:40:43.920 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing lv root
2015-08-04T16:40:44.400072+00:00 info: 2015-08-04 16:40:43.920 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding lv to vg os: name=root, size=51200
2015-08-04T16:40:44.400203+00:00 info: 2015-08-04 16:40:43.920 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding file system on lv: mount=/ type=ext4
2015-08-04T16:40:44.400333+00:00 info: 2015-08-04 16:40:43.920 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing lv swap
2015-08-04T16:40:44.400466+00:00 info: 2015-08-04 16:40:43.920 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding lv to vg os: name=swap, size=32768
2015-08-04T16:40:44.400612+00:00 info: 2015-08-04 16:40:43.920 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding file system on lv: mount=swap type=swap
2015-08-04T16:40:44.400722+00:00 info: 2015-08-04 16:40:43.920 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing vg vm
2015-08-04T16:40:44.400872+00:00 info: 2015-08-04 16:40:43.921 8644 DEBUG fuel_agent.drivers.nailgun [-] Looping over all logical volumes in vg vm
2015-08-04T16:40:44.401025+00:00 info: 2015-08-04 16:40:43.921 8644 DEBUG fuel_agent.drivers.nailgun [-] Processing lv nova
2015-08-04T16:40:44.401143+00:00 info: 2015-08-04 16:40:43.921 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding lv to vg vm: name=nova, size=830500
2015-08-04T16:40:44.401272+00:00 info: 2015-08-04 16:40:43.921 8644 DEBUG fuel_agent.drivers.nailgun [-] Adding file system on lv: mount=/var/lib/nova type=xfs
2015-08-04T16:40:44.401403+00:00 info: 2015-08-04 16:40:43.921 8644 DEBUG fuel_agent.drivers.nailgun [-] --- Parse grub settings ---
2015-08-04T16:40:44.401540+00:00 info: 2015-08-04 16:40:43.921 8644 DEBUG fuel_agent.drivers.nailgun [-] Appending kernel parameters: console=ttyS0,9600 console=tty0 net.ifnames=0 biosdevnam2015-08-04T16:40:44.409243+00:00 info: Working Devices : 2
2015-08-04T16:40:44.409347+00:00 info: Failed Devices : 0
2015-08-04T16:40:44.409483+00:00 info: Spare Devices : 0
2015-08-04T16:40:44.409599+00:00 info:
2015-08-04T16:40:44.409717+00:00 info: Name : tpi93:0
2015-08-04T16:40:44.409841+00:00 info: UUID : 92922a7c:38198280:cb18edc3:ee51bac8
2015-08-04T16:40:44.409969+00:00 info: Events : 35
2015-08-04T16:40:44.410090+00:00 info:
2015-08-04T16:40:44.410211+00:00 info: Number Major Minor RaidDevice State
2015-08-04T16:40:44.410335+00:00 info: 0 8 1 0 active sync /dev/sda1
2015-08-04T16:40:44.410470+00:00 info: 1 8 17 1 active sync /dev/sdb1
2015-08-04T16:40:44.410568+00:00 info:
2015-08-04T16:40:44.410746+00:00 info: 2015-08-04 16:40:43.994 8644 DEBUG fuel_agent.utils.md_utils [-] Found md devices: [{'name': '/dev/md126', 'Raid Level': 'raid0', 'devices': ['/dev/sda2', '/dev/sdb2'], 'UUID': '09e17121:4754311e:3d8845a8:c9cb13bf', 'Failed Devices': '0', 'State': 'clean', 'Version': '1.2', 'Spare Devices': '0', 'Active Devices': '2', 'Raid Devices': '2'}, {'name': '/dev/md127', 'Raid Level': 'raid1', 'devices': ['/dev/sda1', '/dev/sdb1'], 'UUID': '92922a7c:38198280:cb18edc3:ee51bac8', 'Failed Devices': '0', 'State': 'clean', 'Version': '1.2', 'Spare Devices': '0', 'Active Devices': '2', 'Raid Devices': '2'}]
2015-08-04T16:40:44.410860+00:00 info: 2015-08-04 16:40:43.994 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: udevadm settle --quiet
2015-08-04T16:40:44.410996+00:00 info: 2015-08-04 16:40:43.997 8644 DEBUG fuel_agent.utils.utils [-] Trying to execute command: mdadm --stop /dev/md126
2015-08-04T16:40:44.411125+00:00 info: 2015-08-04 16:40:44.001 8644 WARNING fuel_agent.utils.utils [-] Failed to execute command: Unexpected error while running command.
2015-08-04T16:40:44.411242+00:00 info: Command: mdadm --stop /dev/md126
2015-08-04T16:40:44.411363+00:00 info: Exit code: 1
2015-08-04T16:40:44.411483+00:00 info: Stdout: ''
2015-08-04T16:40:44.411611+00:00 info: Stderr: 'mdadm: Cannot get exclusive access to /dev/md126:Perhaps a running process, mounted filesystem or active volume group?\n'
2015-08-04T16:40:44.411727+00:00 info: 2015-08-04 16:40:44.001 8644 ERROR fuel_agent.cmd.agent [-] Unexpected error while running command.
2015-08-04T16:40:44.411848+00:00 info: Command: mdadm --stop /dev/md126
2015-08-04T16:40:44.412028+00:00 info: Exit code: 1
2015-08-04T16:40:44.412132+00:00 info: Stdout: ''
2015-08-04T16:40:44.412257+00:00 info: Stderr: 'mdadm: Cannot get exclusive access to /dev/md126:Perhaps a running process, mounted filesystem or active volume group?\n'
2015-08-04T16:40:44.412380+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent Traceback (most recent call last):
2015-08-04T16:40:44.412509+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent File "/usr/lib/python2.6/site-packages/fuel_agent/cmd/agent.py", line 95, in main
2015-08-04T16:40:44.412633+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent getattr(mgr, action)()
2015-08-04T16:40:44.412762+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent File "/usr/lib/python2.6/site-packages/fuel_agent/manager.py", line 468, in do_provisioning
2015-08-04T16:40:44.412885+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent self.do_partitioning()
2015-08-04T16:40:44.413032+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent File "/usr/lib/python2.6/site-packages/fuel_agent/manager.py", line 106, in do_partitioning
2015-08-04T16:40:44.413150+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent mu.mdclean_all()
2015-08-04T16:40:44.413284+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent File "/usr/lib/python2.6/site-packages/fuel_agent/utils/md_utils.py", line 161, in mdclean_all
2015-08-04T16:40:44.413407+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent mdremove(md['name'])
2015-08-04T16:40:44.413535+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent File "/usr/lib/python2.6/site-packages/fuel_agent/utils/md_utils.py", line 148, in mdremove
2015-08-04T16:40:44.413661+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent utils.execute('mdadm', '--stop', mdname, check_exit_code=[0])
2015-08-04T16:40:44.413789+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent File "/usr/lib/python2.6/site-packages/fuel_agent/utils/utils.py", line 129, in execute
2015-08-04T16:40:44.413913+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent stderr=stderr, cmd=command)
2015-08-04T16:40:44.414047+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent ProcessExecutionError: Unexpected error while running command.
2015-08-04T16:40:44.414181+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent Command: mdadm --stop /dev/md126
2015-08-04T16:40:44.414287+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent Exit code: 1
2015-08-04T16:40:44.414428+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent Stdout: ''
2015-08-04T16:40:44.414555+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent Stderr: 'mdadm: Cannot get exclusive access to /dev/md126:Perhaps a running process, mounted filesystem or active volume group?\n'
2015-08-04T16:40:44.414675+00:00 info: 2015-08-04 16:40:44.001 8644 TRACE fuel_agent.cmd.agent

Changed in fuel:
status: New → Confirmed
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.