Wrong disk associated as Journal Disk

[Vinod Nair]

On one of the Storage nodes in the cluster , the Jounal disk that got associated / provisioned is not what was put in the testbed.py

Build used: 1.10 34
Fab based provisioning

The Journal Disk specified in testbed.py for host2 is sdl

storage_node_config = {
    host2 : { 'disks' : ['/dev/sdb', '/dev/sdc','/dev/sdd','/dev/sde','/dev/sdf','/dev/sdg','/dev/sdh','/dev/sdi','/dev/sdj','/dev/sdk','/dev/sdm','/dev/sdn'], ' journal' : ['/dev/sdl'] },
    host3 : { 'disks' : ['/dev/sdb','/dev/sdc','/dev/sdd','/dev/sde','/dev/sdf','/dev/sdg','/dev/sdh','/dev/sdi','/dev/sdj','/dev/sdk','/dev/sdl','/dev/sdn','/dev/sdp',], ' journal' : ['/dev/sdm'] },
    host4 : { 'disks' : ['/dev/sdb','/dev/sdc','/dev/sdd','/dev/sde','/dev/sdf','/dev/sdg','/dev/sdh','/dev/sdi','/dev/sdj','/dev/sdk','/dev/sdl','/dev/sdn','/dev/sdp'], ' journal' : ['/dev/sdm'] },
    host5 : { 'disks' : ['/dev/sdb','/dev/sdc','/dev/sdd'], 'journal' : ['/dev/sde'] },

}

Where as the dsk that provisioned is sdb

On host2:
pwd
/var/lib/ceph/osd/ceph-0

ls -ltr | grep journal
lrwxrwxrwx 1 root root 58 Sep 5 20:27 journal -> /dev/disk/by-partuuid/c474909e-4cb6-4770-a8d8-ccbc62645a71

root@cmbu-vxa2010-21:/var/lib/ceph/osd/ceph-0# ll /dev/disk/by-partuuid/ | grep a71
lrwxrwxrwx 1 root root 10 Sep 5 20:31 c474909e-4cb6-4770-a8d8-ccbc62645a71 -> ../../sdb2

[Jeya ganesh babu J (jjeya)]

Re-verify this after the fix commit to bug #1363524

[Vinod Nair (vinodnair)]

Verified that the Journal disk is referencing the correct disk .

/var/lib/ceph/osd# ls -lttR | grep part
lrwxrwxrwx 1 root root 58 Oct 7 17:35 journal -> /dev/disk/by-partuuid/1ea557b4-faf1-483f-9770-7592f8f5698d
lrwxrwxrwx 1 root root 58 Oct 7 17:35 journal -> /dev/disk/by-partuuid/38ad08a7-ca2d-4b98-ba53-bda0c8093a91
lrwxrwxrwx 1 root root 58 Oct 7 17:35 journal -> /dev/disk/by-partuuid/cff524c2-021b-42e5-96a8-3b7be69191a9
lrwxrwxrwx 1 root root 58 Oct 7 17:35 journal -> /dev/disk/by-partuuid/abf164ee-1616-4e72-a2e1-dc4238c57e6f
lrwxrwxrwx 1 root root 58 Oct 7 17:34 journal -> /dev/disk/by-partuuid/554ebb01-a948-4a5f-a69f-075008c8a422
lrwxrwxrwx 1 root root 58 Oct 7 17:34 journal -> /dev/disk/by-partuuid/cc3f272b-4317-4715-a415-1e42e019ee06
lrwxrwxrwx 1 root root 58 Oct 7 17:34 journal -> /dev/disk/by-partuuid/6833dc9e-ff2e-47b2-bf60-ed79ebe8ac08
lrwxrwxrwx 1 root root 58 Oct 7 17:34 journal -> /dev/disk/by-partuuid/0538ca80-46a5-44fc-a8c8-a2262ed1c97b
lrwxrwxrwx 1 root root 58 Oct 7 17:33 journal -> /dev/disk/by-partuuid/a366a033-1dfc-4f6f-ad33-09461fca6a91
lrwxrwxrwx 1 root root 58 Oct 7 17:33 journal -> /dev/disk/by-partuuid/ef1eaf3e-ff29-4f18-bd91-75cbbb7bedbf
lrwxrwxrwx 1 root root 58 Oct 7 17:33 journal -> /dev/disk/by-partuuid/c728bebe-d664-44fe-9a19-8f08e0028e40
lrwxrwxrwx 1 root root 58 Oct 7 17:33 journal -> /dev/disk/by-partuuid/bb9c053c-72fb-4856-9ebe-968a0b5a573e
lrwxrwxrwx 1 root root 58 Oct 7 17:33 journal -> /dev/disk/by-partuuid/a38901d1-3db6-4412-9376-8b06c7c920fd
lrwxrwxrwx 1 root root 58 Oct 7 17:32 journal -> /dev/disk/by-partuuid/f4bff8b2-c67c-4eca-814e-6d1ade4fafe7
root@cmbu-vxa2010-23:/var/lib/ceph/osd# ls -ltr /dev/disk/by-partuuid/ | grep sdm
lrwxrwxrwx 1 root root 10 Oct 7 17:35 c728bebe-d664-44fe-9a19-8f08e0028e40 -> ../../sdm4
lrwxrwxrwx 1 root root 11 Oct 7 17:35 cff524c2-021b-42e5-96a8-3b7be69191a9 -> ../../sdm12
lrwxrwxrwx 1 root root 10 Oct 7 17:35 a38901d1-3db6-4412-9376-8b06c7c920fd -> ../../sdm2
lrwxrwxrwx 1 root root 10 Oct 7 17:35 6833dc9e-ff2e-47b2-bf60-ed79ebe8ac08 -> ../../sdm8
lrwxrwxrwx 1 root root 11 Oct 7 17:35 554ebb01-a948-4a5f-a69f-075008c8a422 -> ../../sdm10
lrwxrwxrwx 1 root root 10 Oct 7 17:35 ef1eaf3e-ff29-4f18-bd91-75cbbb7bedbf -> ../../sdm5
lrwxrwxrwx 1 root root 10 Oct 7 17:35 cc3f272b-4317-4715-a415-1e42e019ee06 -> ../../sdm9
lrwxrwxrwx 1 root root 10 Oct 7 17:35 bb9c053c-72fb-4856-9ebe-968a0b5a573e -> ../../sdm3
lrwxrwxrwx 1 root root 10 Oct 7 17:35 0538ca80-46a5-44fc-a8c8-a2262ed1c97b -> ../../sdm7
lrwxrwxrwx 1 root root 10 Oct 7 17:35 f4bff8b2-c67c-4eca-814e-6d1ade4fafe7 -> ../../sdm1
lrwxrwxrwx 1 root root 10 Oct 7 17:35 a366a033-1dfc-4f6f-ad33-09461fca6a91 -> ../../sdm6
lrwxrwxrwx 1 root root 11 Oct 7 17:35 38ad08a7-ca2d-4b98-ba53-bda0c8093a91 -> ../../sdm13
lrwxrwxrwx 1 root root 11 Oct 7 17:35 abf164ee-1616-4e72-a2e1-dc4238c57e6f -> ../../sdm11
lrwxrwxrwx 1 root root 11 Oct 7 17:35 1ea557b4-faf1-483f-9770-7592f8f5698d -> ../../sdm14

[Michael Nishimoto (mnishimoto)]

We believe the fix went into github for bug #1363524. We are marking this bug as fix commited now because that bug has been marked "fix committed".