| 2014-10-03 12:55:14 |
Kick In |
description |
If you create a bcache device, you can't reuse all your disk/partitions without a reboot.
You can reproduce the case this way:
start a vm with 2 disks (caching must be bigger or equal to the backing cf bug :1377130) and an iso of utopic desktop amd64
create the bcache device:
make-bcache --writeback --discard -C /dev/sda -B /dev/sdb
UUID: b245150d-cfbe-4f90-836a-343e0e1a4c55
Set UUID: c990a31a-f531-4231-9603-d40230dc6504
version: 0
nbuckets: 16384
block_size: 1
bucket_size: 1024
nr_in_set: 1
nr_this_dev: 0
first_bucket: 1
UUID: cc31e0bb-db29-4115-a1b2-e9ff54e5f127
Set UUID: c990a31a-f531-4231-9603-d40230dc6504
version: 1
block_size: 1
data_offset: 16
******************************
command:
lsblk
result:
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 8G 0 disk
└─bcache0 251:0 0 16G 0 disk
sdb 8:16 0 16G 0 disk
└─bcache0 251:0 0 16G 0 disk
sr0 11:0 1 1,1G 0 rom /cdrom
loop0 7:0 0 1,1G 1 loop /rofs
******************************
All is good
lsmod | grep bcache:
bcache 227884 3
format the bcache device:
******************************
command:
mkfs.ext4 /dev/bcache0
result:
Rejet des blocs de périphérique : 4096/4194302 complété
Creating filesystem with 4194302 4k blocks and 1048576 inodes
Filesystem UUID: 587d2249-3eaf-4590-a00d-42939f257e99
Superblocs de secours stockés sur les blocs :
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
4096000
Allocation des tables de groupe : 0/128 complété
Écriture des tables d'i-noeuds : 0/128 complété
Création du journal (32768 blocs) : complété
Écriture des superblocs et de l'information de comptabilité du système de
fichiers : 0/128 2/128 complété
******************************
Now mount it:
mount /dev/bcache0 /mnt/
mkdir /mnt/test_dir
touch /mnt/test_file
state of: /sys/fs/bcache/
ls /sys/fs/bcache/
c990a31a-f531-4231-9603-d40230dc6504
register
register_quiet
bcache-super-show /dev/sda
sb.magic ok
sb.first_sector 8 [match]
sb.csum E6A8D9AC496B0B04 [match]
sb.version 3 [cache device]
dev.label (empty)
dev.uuid b245150d-cfbe-4f90-836a-343e0e1a4c55
dev.sectors_per_block 1
dev.sectors_per_bucket 1024
dev.cache.first_sector 1024
dev.cache.cache_sectors 16776192
dev.cache.total_sectors 16777216
dev.cache.ordered yes
dev.cache.discard yes
dev.cache.pos 0
dev.cache.replacement 0 [lru]
cset.uuid c990a31a-f531-4231-9603-d40230dc6504
******************************
bcache-super-show -f /dev/sdb
sb.magic ok
sb.first_sector 8 [match]
sb.csum 9600B159F36A67DD [match]
sb.version 1 [backing device]
dev.label (empty)
dev.uuid cc31e0bb-db29-4115-a1b2-e9ff54e5f127
dev.sectors_per_block 1
dev.sectors_per_bucket 1024
dev.data.first_sector 16
dev.data.cache_mode 1 [writeback]
dev.data.cache_state 2 [dirty]
cset.uuid c990a31a-f531-4231-9603-d40230dc6504
******************************
mount:
/dev/bcache0 on /mnt type ext4 (rw)
we will unregister the bcache:
echo 1 /sys/fs/bcache/c990a31a-f531-4231-9603-d40230dc6504/unregister
check the content of /sys/fs/bcache
ls /sys/fs/bcache/
register
register_quiet
So bcache is unregistered, but status of /dev/sda:
bcache-super-show -f /dev/sda
sb.magic ok
sb.first_sector 8 [match]
sb.csum E6A8D9AC496B0B04 [match]
sb.version 3 [cache device]
dev.label (empty)
dev.uuid b245150d-cfbe-4f90-836a-343e0e1a4c55
dev.sectors_per_block 1
dev.sectors_per_bucket 1024
dev.cache.first_sector 1024
dev.cache.cache_sectors 16776192
dev.cache.total_sectors 16777216
dev.cache.ordered yes
dev.cache.discard yes
dev.cache.pos 0
dev.cache.replacement 0 [lru]
cset.uuid c990a31a-f531-4231-9603-d40230dc6504
command:
bcache-super-show -f /dev/sdb
result:
sb.magic ok
sb.first_sector 8 [match]
sb.csum D41799F794675FA8 [match]
sb.version 1 [backing device]
dev.label (empty)
dev.uuid cc31e0bb-db29-4115-a1b2-e9ff54e5f127
dev.sectors_per_block 1
dev.sectors_per_bucket 1024
dev.data.first_sector 16
dev.data.cache_mode 1 [writeback]
dev.data.cache_state 0 [detached]
cset.uuid 00000000-0000-0000-0000-000000000000
******************************
Maybe I'm wrong, but I would expect the cahing device to be 000000000ed not the backing device, as we may still want to use the data on it.
But data is still accessible on the mount point.
So we wipe /dev/sda now:
******************************
command:
wipefs -a /dev/sda
result:
/dev/sda: 16 bytes were erased at offset 0x00001018 (bcache): c6 85 73 f6 4e 1a 45 ca 82 65 f5 7f 48 ba 6d 81
******************************
mount:
/dev/bcache0 on /mnt type ext4 (rw)
data still there:
******************************
command:
ls /mnt/
result:
lost+found
test_dir
test_file
******************************
******************************
command:
lsblk
result:
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 8G 0 disk
sdb 8:16 0 16G 0 disk
└─bcache0 251:0 0 16G 0 disk /mnt
sr0 11:0 1 1,1G 0 rom /cdrom
loop0 7:0 0 1,1G 1 loop /rofs
******************************
Ok now we can backup our data if we need to, next, we will umount:
umount /mnt/
ok no errors.
lsblk:
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 8G 0 disk
sdb 8:16 0 16G 0 disk
└─bcache0 251:0 0 16G 0 disk
sr0 11:0 1 1,1G 0 rom /cdrom
loop0 7:0 0 1,1G 1 loop /rofs
******************************
bcache0 is still there, ok, but how to delete to unregister it definitively?
ls /sys/fs/bcache/
result:
register
register_quiet
**************
lsmod
result:
Module Size Used by
bcache 227884 1
we can't wipefs -a /dev/sdb, device is in use, so we reboot machine (NOT OK)
in the vm:
ls /sys/fs/bcache/
result:
register
register_quiet
update packages and reinstall bcache-tools:
bcache-super-show -f /dev/sda
result:
Invalid superblock (bad magic)
sb.magic bad magic
bcache-super-show -f /dev/sdb
result:
sb.magic ok
sb.first_sector 8 [match]
sb.csum D41799F794675FA8 [match]
sb.version 1 [backing device]
dev.label (empty)
dev.uuid cc31e0bb-db29-4115-a1b2-e9ff54e5f127
dev.sectors_per_block 1
dev.sectors_per_bucket 1024
dev.data.first_sector 16
dev.data.cache_mode 1 [writeback]
dev.data.cache_state 0 [detached]
cset.uuid 00000000-0000-0000-0000-000000000000
Now we can wipe /dev/sdb because we rebooted, and bcache don't use the device anymore:
wipefs -a /dev/sdb
result:
/dev/sdb: 16 bytes were erased at offset 0x00001018 (bcache): c6 85 73 f6 4e 1a 45 ca 82 65 f5 7f 48 ba 6d 81
**********************************************************
Now I can re-use my device, but I needed a reboot. Maybe we must also have better bcache management tools also. |
If you create a bcache device, you can't reuse all your disk/partitions without a reboot.
You can reproduce the case this way:
start a vm with 2 disks (caching must be bigger or equal to the backing cf bug :1377130) and an iso of utopic desktop amd64
create the bcache device:
make-bcache --writeback --discard -C /dev/sda -B /dev/sdb
UUID: b245150d-cfbe-4f90-836a-343e0e1a4c55
Set UUID: c990a31a-f531-4231-9603-d40230dc6504
version: 0
nbuckets: 16384
block_size: 1
bucket_size: 1024
nr_in_set: 1
nr_this_dev: 0
first_bucket: 1
UUID: cc31e0bb-db29-4115-a1b2-e9ff54e5f127
Set UUID: c990a31a-f531-4231-9603-d40230dc6504
version: 1
block_size: 1
data_offset: 16
******************************
command:
lsblk
result:
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 8G 0 disk
└─bcache0 251:0 0 16G 0 disk
sdb 8:16 0 16G 0 disk
└─bcache0 251:0 0 16G 0 disk
sr0 11:0 1 1,1G 0 rom /cdrom
loop0 7:0 0 1,1G 1 loop /rofs
******************************
All is good
lsmod | grep bcache:
bcache 227884 3
format the bcache device:
******************************
command:
mkfs.ext4 /dev/bcache0
result:
Rejet des blocs de périphérique : 4096/4194302 complété
Creating filesystem with 4194302 4k blocks and 1048576 inodes
Filesystem UUID: 587d2249-3eaf-4590-a00d-42939f257e99
Superblocs de secours stockés sur les blocs :
32768, 98304, 163840, 229376, 294912, 819200, 884736, 1605632, 2654208,
4096000
Allocation des tables de groupe : 0/128 complété
Écriture des tables d'i-noeuds : 0/128 complété
Création du journal (32768 blocs) : complété
Écriture des superblocs et de l'information de comptabilité du système de
fichiers : 0/128 2/128 complété
******************************
Now mount it:
mount /dev/bcache0 /mnt/
mkdir /mnt/test_dir
touch /mnt/test_file
state of: /sys/fs/bcache/
ls /sys/fs/bcache/
c990a31a-f531-4231-9603-d40230dc6504
register
register_quiet
bcache-super-show /dev/sda
sb.magic ok
sb.first_sector 8 [match]
sb.csum E6A8D9AC496B0B04 [match]
sb.version 3 [cache device]
dev.label (empty)
dev.uuid b245150d-cfbe-4f90-836a-343e0e1a4c55
dev.sectors_per_block 1
dev.sectors_per_bucket 1024
dev.cache.first_sector 1024
dev.cache.cache_sectors 16776192
dev.cache.total_sectors 16777216
dev.cache.ordered yes
dev.cache.discard yes
dev.cache.pos 0
dev.cache.replacement 0 [lru]
cset.uuid c990a31a-f531-4231-9603-d40230dc6504
******************************
bcache-super-show -f /dev/sdb
sb.magic ok
sb.first_sector 8 [match]
sb.csum 9600B159F36A67DD [match]
sb.version 1 [backing device]
dev.label (empty)
dev.uuid cc31e0bb-db29-4115-a1b2-e9ff54e5f127
dev.sectors_per_block 1
dev.sectors_per_bucket 1024
dev.data.first_sector 16
dev.data.cache_mode 1 [writeback]
dev.data.cache_state 2 [dirty]
cset.uuid c990a31a-f531-4231-9603-d40230dc6504
******************************
mount:
/dev/bcache0 on /mnt type ext4 (rw)
we will unregister the bcache:
echo 1 /sys/fs/bcache/c990a31a-f531-4231-9603-d40230dc6504/unregister
check the content of /sys/fs/bcache
ls /sys/fs/bcache/
register
register_quiet
So bcache is unregistered, but status of /dev/sda:
bcache-super-show -f /dev/sda
sb.magic ok
sb.first_sector 8 [match]
sb.csum E6A8D9AC496B0B04 [match]
sb.version 3 [cache device]
dev.label (empty)
dev.uuid b245150d-cfbe-4f90-836a-343e0e1a4c55
dev.sectors_per_block 1
dev.sectors_per_bucket 1024
dev.cache.first_sector 1024
dev.cache.cache_sectors 16776192
dev.cache.total_sectors 16777216
dev.cache.ordered yes
dev.cache.discard yes
dev.cache.pos 0
dev.cache.replacement 0 [lru]
cset.uuid c990a31a-f531-4231-9603-d40230dc6504
command:
bcache-super-show -f /dev/sdb
result:
sb.magic ok
sb.first_sector 8 [match]
sb.csum D41799F794675FA8 [match]
sb.version 1 [backing device]
dev.label (empty)
dev.uuid cc31e0bb-db29-4115-a1b2-e9ff54e5f127
dev.sectors_per_block 1
dev.sectors_per_bucket 1024
dev.data.first_sector 16
dev.data.cache_mode 1 [writeback]
dev.data.cache_state 0 [detached]
cset.uuid 00000000-0000-0000-0000-000000000000
******************************
Maybe I'm wrong, but I would expect the cahing device to be 000000000ed not the backing device, as we may still want to use the data on it.
But data is still accessible on the mount point.
So we wipe /dev/sda now:
******************************
command:
wipefs -a /dev/sda
result:
/dev/sda: 16 bytes were erased at offset 0x00001018 (bcache): c6 85 73 f6 4e 1a 45 ca 82 65 f5 7f 48 ba 6d 81
******************************
mount:
/dev/bcache0 on /mnt type ext4 (rw)
data still there:
******************************
command:
ls /mnt/
result:
lost+found
test_dir
test_file
******************************
******************************
command:
lsblk
result:
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 8G 0 disk
sdb 8:16 0 16G 0 disk
└─bcache0 251:0 0 16G 0 disk /mnt
sr0 11:0 1 1,1G 0 rom /cdrom
loop0 7:0 0 1,1G 1 loop /rofs
******************************
Ok now we can backup our data if we need to, next, we will umount:
umount /mnt/
ok no errors.
lsblk:
NAME MAJ:MIN RM SIZE RO TYPE MOUNTPOINT
sda 8:0 0 8G 0 disk
sdb 8:16 0 16G 0 disk
└─bcache0 251:0 0 16G 0 disk
sr0 11:0 1 1,1G 0 rom /cdrom
loop0 7:0 0 1,1G 1 loop /rofs
******************************
bcache0 is still there, ok, but how to delete to unregister it definitively?
ls /sys/fs/bcache/
result:
register
register_quiet
**************
lsmod
result:
Module Size Used by
bcache 227884 1
we can't wipefs -a /dev/sdb, device is in use, so we reboot machine (NOT OK)
in the vm:
ls /sys/fs/bcache/
result:
register
register_quiet
update packages and reinstall bcache-tools:
bcache-super-show -f /dev/sda
result:
Invalid superblock (bad magic)
sb.magic bad magic
bcache-super-show -f /dev/sdb
result:
sb.magic ok
sb.first_sector 8 [match]
sb.csum D41799F794675FA8 [match]
sb.version 1 [backing device]
dev.label (empty)
dev.uuid cc31e0bb-db29-4115-a1b2-e9ff54e5f127
dev.sectors_per_block 1
dev.sectors_per_bucket 1024
dev.data.first_sector 16
dev.data.cache_mode 1 [writeback]
dev.data.cache_state 0 [detached]
cset.uuid 00000000-0000-0000-0000-000000000000
Now we can wipe /dev/sdb because we rebooted, and bcache don't use the device anymore:
wipefs -a /dev/sdb
result:
/dev/sdb: 16 bytes were erased at offset 0x00001018 (bcache): c6 85 73 f6 4e 1a 45 ca 82 65 f5 7f 48 ba 6d 81
**********************************************************
Now I can re-use my device, but I needed a reboot. Maybe we also must have better bcache management tools. |
|
