Fuel for OpenStack

Ceph OSD partition not properly aligned at creation

Bug #1366091 reported by Claude Durocher
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
Fuel for OpenStack
Fix Committed
Medium
Ryan Moe
Fuel for OpenStack 6.1
5.1.x
Fix Committed
Medium
Bartłomiej Piotrowski
Fuel for OpenStack 5.1.1-updates
6.0.x
Fix Committed
Medium
Bartłomiej Piotrowski
Fuel for OpenStack 6.0-updates

Bug Description

When creating a Ceph OSD, Fuel doesn't align partition to cylinder :

2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) executed successfully
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [ceph_deploy.osd][DEBUG ] Host node-1 is now ready for osd use.
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][WARNING] there is 1 OSD out
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][WARNING] there is 1 OSD down
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][INFO ] Running command: ceph --cluster=ceph osd stat --format=json
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][INFO ] checking OSD status...
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][WARNING] INFO:ceph-disk:Running command: /sbin/partprobe /dev/sdg2
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][WARNING] INFO:ceph-disk:Running command: /bin/umount -- /var/lib/ceph/tmp/mnt.CzVaJ1
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][WARNING] INFO:ceph-disk:Running command: /bin/mount -t xfs -o noatime -- /dev/sdg2 /var/lib/ceph/tmp/mnt.CzVaJ1
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][WARNING] warning: device is not properly aligned /dev/sdg2
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][WARNING] INFO:ceph-disk:Running command: /sbin/mkfs -t xfs -f -i size=2048 -- /dev/sdg2
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][WARNING] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=osd_journal_size
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][WARNING] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mount_options_xfs
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][WARNING] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mount_options_xfs
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][WARNING] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_fs_mkfs_options_xfs
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][WARNING] INFO:ceph-disk:Running command: /usr/bin/ceph-conf --cluster=ceph --name=osd. --lookup osd_mkfs_options_xfs
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][WARNING] INFO:ceph-disk:Running command: /usr/bin/ceph-osd --cluster=ceph --show-config-value=fsid
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][DEBUG ] realtime =none extsz=4096 blocks=0, rtextents=0
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][DEBUG ] = sectsz=512 sunit=64 blks, lazy-count=1
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][DEBUG ] log =internal log bsize=4096 blocks=143040, version=2
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][DEBUG ] naming =version 2 bsize=4096 ascii-ci=0
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][DEBUG ] = sunit=64 swidth=64 blks
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][DEBUG ] data = bsize=4096 blocks=292874240, imaxpct=5
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][DEBUG ] = sectsz=512 attr=2, projid32bit=0
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][DEBUG ] meta-data=/dev/sdg2 isize=2048 agcount=32, agsize=9152320 blks
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][INFO ] Running command: ceph-disk-prepare --fs-type xfs --cluster ceph -- /dev/sdg2
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [ceph_deploy.osd][DEBUG ] Preparing host node-1 disk /dev/sdg2 journal None activate False
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [ceph_deploy.osd][INFO ] Distro info: Ubuntu 12.04 precise
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][DEBUG ] detect machine type
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][DEBUG ] detect platform information from remote host
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][DEBUG ] connected to host: node-1
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [ceph_deploy.osd][DEBUG ] Host node-1 is now ready for osd use.
2014-09-03 20:55:36 NOTICE
 (/Stage[main]/Ceph::Osd/Exec[ceph-deploy osd prepare]/returns) [node-1][INFO ] Running command: ceph --cluster=ceph osd stat --format=json

It seem like a small change to the definition of the first partition (what is it used for?) should be modified :

root@node-1:~# gdisk /dev/sdb
GPT fdisk (gdisk) version 0.8.1

Partition table scan:
  MBR: protective
  BSD: not present
  APM: not present
  GPT: present

Found valid GPT with protective MBR; using GPT.

Command (? for help): p
Disk /dev/sdb: 2344160432 sectors, 1.1 TiB
Logical sector size: 512 bytes
Disk identifier (GUID): 0F5A3F4D-FCA2-48C7-BE29-D3012D5EF09A
Partition table holds up to 128 entries
First usable sector is 34, last usable sector is 2344160398
Partitions will be aligned on 8-sector boundaries
Total free space is 1107086 sectors (540.6 MiB)

Number Start (sector) End (sector) Size Code Name
   1 34 49152 24.0 MiB EF02 primary
   2 49153 2343053312 1.1 TiB FFFF primary

Expected behaviour : For optimum performance, partition should be aligned.

Nastya Urlapova (aurlapova)
Changed in fuel:
milestone: none → 5.1
assignee: nobody → Fuel Library Team (fuel-library)
Dmitry Borodaenko (angdraug)
Changed in fuel:
importance: Undecided → Medium
status: New → Confirmed
assignee: Fuel Library Team (fuel-library) → Ryan Moe (rmoe)
milestone: 5.1 → 6.0
Vladimir Kuklin (vkuklin)
Changed in fuel:
milestone: 6.0 → 6.1
Ryan Moe (rmoe)
tags: added: customer-found
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (master)

Fix proposed to branch: master
Review: https://review.openstack.org/157204

Changed in fuel:
status: Confirmed → In Progress
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (master)

Reviewed: https://review.openstack.org/157204
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=a15b59181ae880dc92398fd5085988915d664b64
Submitter: Jenkins
Branch: master

commit a15b59181ae880dc92398fd5085988915d664b64
Author: Ryan Moe <email address hidden>
Date: Wed Feb 18 15:52:41 2015 -0800

    Align partitions at creation time

    Aligning partitions is recommended for Ceph. This change
    also brings pmanager in line with how Fuel agent creates
    partitions.

    Change-Id: Ib203daa043d24960867af9882b0cc81facd314c8
    Closes-bug: #1366091

Changed in fuel:
status: In Progress → Fix Committed
Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/6.0)

Fix proposed to branch: stable/6.0
Review: https://review.openstack.org/161708

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix proposed to fuel-library (stable/5.1)

Fix proposed to branch: stable/5.1
Review: https://review.openstack.org/161715

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/6.0)

Reviewed: https://review.openstack.org/161708
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=dedccfda9032695025a11423bcedb884ec8445d5
Submitter: Jenkins
Branch: stable/6.0

commit dedccfda9032695025a11423bcedb884ec8445d5
Author: Ryan Moe <email address hidden>
Date: Wed Feb 18 15:52:41 2015 -0800

    Align partitions at creation time

    Aligning partitions is recommended for Ceph. This change
    also brings pmanager in line with how Fuel agent creates
    partitions.

    Change-Id: Ib203daa043d24960867af9882b0cc81facd314c8
    Closes-bug: #1366091
    (cherry picked from commit a15b59181ae880dc92398fd5085988915d664b64)

Revision history for this message
OpenStack Infra (hudson-openstack) wrote : Fix merged to fuel-library (stable/5.1)

Reviewed: https://review.openstack.org/161715
Committed: https://git.openstack.org/cgit/stackforge/fuel-library/commit/?id=ea2754b0dc71b61bf371bbc64b4f5b3f7f570fba
Submitter: Jenkins
Branch: stable/5.1

commit ea2754b0dc71b61bf371bbc64b4f5b3f7f570fba
Author: Ryan Moe <email address hidden>
Date: Wed Feb 18 15:52:41 2015 -0800

    Align partitions at creation time

    Aligning partitions is recommended for Ceph. This change
    also brings pmanager in line with how Fuel agent creates
    partitions.

    Change-Id: Ib203daa043d24960867af9882b0cc81facd314c8
    Closes-bug: #1366091
    (cherry picked from commit a15b59181ae880dc92398fd5085988915d664b64)

Roman Rufanov (rrufanov)
tags: added: support
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.
Subscribing...

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.