ceph osd's journal soft link need to be created

Bug #1744908 reported by ByungYeol Woo
6
This bug affects 1 person
Affects Status Importance Assigned to Milestone
kolla-ansible
Won't Fix
Undecided
Unassigned

Bug Description

I deployed openstack pike with 3 ceph nodes by kolla-ansible.

I used sdb as external journal disk, and sdc~sde as data disk.
After deployed, when I generated IO load, I think journal works well by iostat results.

When I issued 'ceph-disk list' in kolla-ansible deployed openstack, I could not find journal informations of data disks. But I cound found journal informations of data disks in manually deployed openstack/ceph.

I think some steps need to be added in ceph role, like adding link of osd journal disk.

Please see following informations:

=============================================
====== disk configuration
=============================================
[root@kolla ]# grep ceph /etc/kolla/globals.yml | grep -v ^#
enable_ceph: "yes"
enable_ceph_rgw: "yes"
ceph_pool_type: "replicated"
enable_ceph_rgw_keystone: "yes"
ceph_pool_pg_num: 128
ceph_pool_pgp_num: 128
glance_backend_ceph: "yes"
cinder_backend_ceph: "{{ enable_ceph }}"
cinder_backup_driver: "ceph"
nova_backend_ceph: "{{ enable_ceph }}"

[root@storage01 ~]# parted /dev/sdb -s -- mklabel gpt mkpart KOLLA_CEPH_OSD_BOOTSTRAP_sdc_J 1 50G \
mkpart KOLLA_CEPH_OSD_BOOTSTRAP_sdd_J 50G 100G \
mkpart KOLLA_CEPH_OSD_BOOTSTRAP_sde_J 100G 150G
[root@storage01 ~]# parted /dev/sdc -s -- mklabel gpt mkpart KOLLA_CEPH_OSD_BOOTSTRAP_sdc 1 -1
[root@storage01 ~]# parted /dev/sdd -s -- mklabel gpt mkpart KOLLA_CEPH_OSD_BOOTSTRAP_sdd 1 -1
[root@storage01 ~]# parted /dev/sde -s -- mklabel gpt mkpart KOLLA_CEPH_OSD_BOOTSTRAP_sde 1 -1

=============================================
====== After deployed
=============================================
[root@storage01 ~]# docker exec -it ceph_osd_6 ceph-disk list
/dev/dm-0 other, xfs, mounted on /usr/share/zoneinfo/UTC
/dev/dm-1 swap, swap
/dev/dm-10 other, xfs
/dev/dm-2 other, xfs
/dev/dm-3 other, xfs
/dev/dm-4 other, xfs
/dev/dm-5 other, xfs
/dev/dm-6 other, xfs
/dev/dm-7 other, xfs
/dev/dm-8 other, xfs, mounted on /
/dev/dm-9 other, xfs
/dev/loop0 other, xfs
/dev/loop1 other, unknown
/dev/sda :
 /dev/sda1 other, xfs
 /dev/sda2 other, LVM2_member
/dev/sdb :
 /dev/sdb1 ceph journal
 /dev/sdb2 ceph journal
 /dev/sdb3 ceph journal
/dev/sdc :
 /dev/sdc1 ceph data, prepared, cluster ceph, osd.0
/dev/sdd :
 /dev/sdd1 ceph data, prepared, cluster ceph, osd.3
/dev/sde :
 /dev/sde1 ceph data, active, cluster ceph, osd.6

=============================================
====== Another openstack without kolla-ansible
=============================================
[root@ceph01 ]# ceph-disk list
/dev/dm-0 other, ext4, mounted on /
/dev/dm-1 swap, swap
/dev/loop0 other, unknown
/dev/loop1 other, unknown
/dev/loop2 other, unknown
/dev/loop3 other, unknown
/dev/loop4 other, unknown
/dev/loop5 other, unknown
/dev/loop6 other, unknown
/dev/loop7 other, unknown
/dev/sda :
 /dev/sda1 other, ext2, mounted on /boot
 /dev/sda2 other, 0x5
 /dev/sda5 other, LVM2_member
/dev/sdb :
 /dev/sdb1 ceph journal, for /dev/sdc1
 /dev/sdb2 ceph journal, for /dev/sdd1
 /dev/sdb3 ceph journal, for /dev/sde1
 /dev/sdb4 ceph journal, for /dev/sdf1
 /dev/sdb5 ceph journal, for /dev/sdg1
 /dev/sdb6 ceph journal, for /dev/sdh1
 /dev/sdb7 ceph journal, for /dev/sdi1
 /dev/sdb8 ceph journal, for /dev/sdj1
/dev/sdc :
 /dev/sdc1 ceph data, active, cluster ceph, osd.0, journal /dev/sdb1
/dev/sdd :
 /dev/sdd1 ceph data, active, cluster ceph, osd.17, journal /dev/sdb2
/dev/sde :
 /dev/sde1 ceph data, active, cluster ceph, osd.18, journal /dev/sdb3
/dev/sdf :
 /dev/sdf1 ceph data, active, cluster ceph, osd.19, journal /dev/sdb4
/dev/sdg :
 /dev/sdg1 ceph data, active, cluster ceph, osd.20, journal /dev/sdb5
/dev/sdh :
 /dev/sdh1 ceph data, active, cluster ceph, osd.21, journal /dev/sdb6
/dev/sdi :
 /dev/sdi1 ceph data, active, cluster ceph, osd.22, journal /dev/sdb7
/dev/sdj :
 /dev/sdj1 ceph data, active, cluster ceph, osd.23, journal /dev/sdb8

Mark Goddard (mgoddard)
Changed in kolla-ansible:
status: New → Won't Fix
To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.