hi, Dose new ZFS allow just removeing FAULTED device, so I have old clean disk alone, scrub that,... then REPARTITIONING FAULTED device ( i had incorrect size, there is boot area also ), and then attach FAULTED DEVICE AS NEW MIRROR DISK as it was intented ??? zfs remove old-rpool  -d  faulted zfs scrub zfs add old-rpool old new |???| |Then I do not have to copy anyyhing ??? | || joni Richard Laager kirjoitti 3.12.2020 klo 23.29: > device_removal only works if you can import the pool normally. That is > what you should have used after you accidentally added the second disk > as another top-level vdev. Whatever you have done in the interim, > though, has resulted in the second device showing as FAULTED. Unless you > can fix that, device_removal is not an option. I had hoped that you just > had the second drive unplugged or something. But since the import is > showing "corrupted data" for the second drive, that's probably not what > happened. > > This works for me on Ubuntu 20.04: > echo 1 >> /sys/module/zfs/parameters/zfs_max_missing_tvds > > That setting does not exist on Ubuntu 18.04 (which you are running), so > I get the same "Permission denied" error (because bash is trying to > create that file, which you cannot do). > > I now see this is an rpool. Is your plan to reinstall? With 18.04 or > 20.04? > > If 18.04, then: > 1. Download the 20.04.1 live image. Write it to a USB disk and boot into that. > 2. In the live environment, install the ZFS tools: sudo apt install zfsutils-linux > 3. echo 1 >> /sys/module/zfs/parameters/zfs_max_missing_tvds > 4. mkdir /old > 5. Import the old pool renaming it to rpool-old and mount filesystems: > zpool import -o readonly=on -N -R /old rpool rpool-old > zfs mount rpool-old/ROOT/ubuntu > zfs mount -a > 6. Confirm you can access your data. Take another backup, if desired. If you don't have space to back it up besides the new/second disk, then read on... > 7. Follow the 18.04 Root-on-ZFS HOWTO using (only) the second disk. Be very careful not to partition or zpool create the disk with your data!!! For example, partition the second disk for the mirror scenario. But obviously you can't do zpool create with "mirror" because you have only one disk. > 8. Once the new system is installed (i.e. after step 6.2), but before rebooting, copy data from /old to /mnt as needed. > 9. Shut down. Disconnect the old disk. Boot up again. > 9. Continue the install as normal. > 10. When you are certain that everything is good and that new disk is working properly (maybe do a scrub) and you have all your data, then you can connect the old disk and do the zpool attach (ATTACH, not add) to attach the old disk to the new pool as a mirror > > If 20.04, then I'd do this instead: > 1. Unplug the disk with your data. > 2. Follow the 20.04 Root-on-ZFS HOWTO using only the second disk. Follow the steps as if you were mirroring (since that is the ultimate goal) where possible. For example, partition the second disk for the mirror scenario. But obviously you can't do zpool create with "mirror" because you have only one disk. > 3. Once the new, 20.04 system is working on the second disk and booting normally, connect the other, old drive. (This assumes you can connect it while the system is running.) > 4. echo 1 >> /sys/module/zfs/parameters/zfs_max_missing_tvds > 5. Import the old pool using its GUID renaming it to rpool-old and mount filesystems: > zpool import -o readonly -N -R /mnt 5077426391014001687 rpool-old > zfs mount rpool-old/ROOT/ubuntu > zfs mount -a > 6. Copy over data. > 7. zpool export rpool-old > 8. When you are certain that everything is good and that new disk is working properly (maybe do a scrub) and you have all your data, then you can do the zpool attach (ATTACH, not add) to attach the old disk to the new pool as a mirror. > -- joni