ntfs: unsupported reparse point

[Winfried PLappert]

I recently updated my Windows-10 to the 1709 edition. Scanning the file system with Ubuntu, I get "unsupported reparse point" errors. Searching the web indicates that ntfs cannot handle certain files.

I am running Ubutu-Mate 17.10:

uname -r: 4.13.0-16-generic

lsb_release -rcid:
Distributor ID: Ubuntu
Description: Ubuntu 17.10
Release: 17.10
Codename: artful

I include a file which runs ntfsinfo on a file where I get the "unsupported reparse point" message:
sudo ntfsinfo -F /Windows/hh.exe /dev/sda1 >unsupported_reparse_point.txt

while mounted: I issue ls -l <mount_point>/Windows/hh.exe
ls -l Windows/hh.exe
lrwxrwxrwx 2 .. .. 25 Sep 29 14:41 Windows/hh.exe -> unsupported reparse point

I expect to see either a resolved link or a length for the file in question.

[Jean-Pierre (jean-pierre-andre)]

Reparse points are a way to trigger some specific processing when accessing a file. For instance a reparse point can be used to define a new patch to the file or directory, which ntfs-3g emulates as a symbolic link.

Windows 10 makes use of new reparse points for new kinds of features, which ntfs-3g processes through plugins. Currently two plugins are available : one for decompressing system files and one for extracting deduplicated files. According to the ntfsinfo, you need the former one, made available by Eric Biggers on
https://github.com/ebiggers/ntfs-3g-system-compression

Ready-to-use plugins are available on
http://jp-andre.pagesperso-orange.fr/advanced-ntfs-3g.html#download

To make use of these plugins, you need ntfs-3g 2016.2.22AR.1 or more recent.

[Winfried PLappert (winfried-plappert)]

Hello Jean-Pierre, thank you for time analyzing the ntfs issue.

According to dpkg -l, my ntfs packages have the following versions:

libfsntfs1 20170315-1build1
libntfs-3g872 1:2016.2.22AR.2-2
ntfs-3g 1:2016.2.22AR.2-2

When I am trying to compile the ntfs-3g-system-compression package, configure complains that
libntfs-3g is not new enough: libntfs-3g >= 2017.3.23, so I am a bit stuck here.

Likewise the plugins have no deb pacakge version and want package levels newer than the ones available in Ubuntu 17.10.

[Jean-Pierre (jean-pierre-andre)]

> configure complains that libntfs-3g is not new enough: libntfs-3g >= 2017.3.23,

So, the system-compression package has been upgraded beyond what you have installed, nevertheless ntfs-3g 1:2016.2.22AR.2-2 is able to run the plugins, though probably not the latest version.

Then, you have to download systcomp.zip from http://jp-andre.pagesperso-orange.fr/advanced-ntfs-3g.html#download and extract the (binary) plugin which matches the cpu you are using. For instance, for an x86_64 cpu :
unzip -x systcomp.zip systcomp/linux-64/ntfs-plugin-80000017.so

Now, (as root), you have to relocate the file ntfs-plugin-80000017.so to the proper ntfs plugin directory. A simple way to find this directory, is to run the command :
strings $(which ntfs-3g) | grep ntfs-plugin
This will return something like "/usr/lib64/ntfs-3g/ntfs-plugin-%08lx.so" which is the pattern to locate the plugin (in this case, the plugin must be renamed as "/usr/lib64/ntfs-3g/ntfs-plugin-80000017.so"). Your actual plugin directory may be different, and you may have to create the directory.

Note : the file systcomp.zip contains the source file, which you may want to compile yourself.

[Winfried PLappert (winfried-plappert)]

Hello Jean-Pierre,
installing the plugin from http://jp-andre.pagesperso-orange.fr/advanced-ntfs-3g.html#download and installing it at the correct place did the trick! Thank you. You might consider this solution for general availability, since more and more people will have to face WIndows-10, if they want to face it at all. You may close this bug report.

[Launchpad Janitor (janitor)]

Status changed to 'Confirmed' because the bug affects multiple users.

[Nino Burini (elnigno)]

I am running into the same error message. In my case it's when I try to access the OneDrive folder from linux:

ls -la OneDrive
lrwxrwxrwx 1 root root 25 Nov 8 17:48 OneDrive -> unsupported reparse point

I installed the systcomp and dedup plugins, but the error is still there.

Running fsutil on Windows, I get the following:

D:\>fsutil reparsepoint query OneDrive
Valore tag di reparse: 0x9000301a
Valore tag: Microsoft

Lunghezza dati di reparse: 0x00000054
Dati di reparse:
0000: 01 00 54 00 46 65 52 70 bf 54 73 34 50 00 00 00 ..T.FeRp.Ts4P...
0010: 02 00 07 00 07 00 01 00 48 00 00 00 0a 00 04 00 ........H.......
0020: 4c 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 L...............
0030: 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 00 ................
0040: 00 00 00 00 00 00 00 00 00 00 00 00 01 00 00 00 ................
0050: 3e 00 00 00 >...

The interesing part is the value of the reparse tag, 0x9000301a. That should identify the type of reparse point. Searching for that number, the only mention with some meaning I find is from this file on github: https://github.com/jschicht/MftRcrd/blob/master/MFTRCRD.au3

Case $ReparseType = '0x9000301A'
    Return 'CLOUD_ROOT_ON_DEMAND'

So it might be a new type of reparse point, specific for OneDrive.

[Jean-Pierre (jean-pierre-andre)]

> Case $ReparseType = '0x9000301A'
> Return 'CLOUD_ROOT_ON_DEMAND'
> So it might be a new type of reparse point, specific for OneDrive.

Apparently yes, and accessing the cloud files must be done through some Microsoft proprietary network protocol controlled by your Microsoft account... More details welcome, but this is probably far beyond ntfs-3g scope.

[Nino Burini (elnigno)]

I've tried to run ls on the folder on Ubuntu bash on Windows 10, and in this case it works well.
The version is even an old one (1:2013.1.13.AR.1-2ubuntu2).

Can anyone suggest further investigations I can perform on both Windows and Linux to find out more?

[Jean-Pierre (jean-pierre-andre)]

> I've tried to run ls on the folder on Ubuntu bash on Windows 10

Of course this relies on the full Microsoft cloud library...

> Can anyone suggest further investigations I can perform on both
> Windows and Linux to find out more?

On Linux, can you please get the ntfsinfo output for the OneDrive directory :
 sudo ntfsinfo -F /full-path/OneDrive /dev/sda1 > reparse.txt
On Windows (or WSL), please try do determine whether there are locally cached files : can you access some subdirectories or files when the network cable is unplugged ?

[A B (r2737118)]

This coincides with addition of on-demand files (like in windows 8 onedrive). One, obvious, solution is to roll back to Windows 10 build 17.03 or earlier (where such feature is not present) but at some point security support will end.

https://support.office.com/en-us/article/Learn-about-OneDrive-Files-On-Demand-0e6860d3-d9f3-4971-b321-7092438fb38e?ui=en-US&rs=en-US&ad=US

By default on my onedrive on windows files on deman option was switched off and all files were available offline. However on linux this folder showed unsupported reparse point in ls.

[Jean-Pierre (jean-pierre-andre)]

Would you please do the following :

1) download and compile ntfs-3g-2017.3.23AR.1 from
http://jp-andre.pagesperso-orange.fr/advanced-ntfs-3g.html#download :
   tar -xf ntfs-3g_ntfsprogs-2017.3.23AR.1.tgz
   cd ntfs-3g_ntfsprogs-2017.3.23AR.1
   ./configure
   make
   (do not install, so you will not pollute your current installation)

2) download a test version of plugin for OneDrive :
   wget http://jp-andre.pagesperso-orange.fr/onedrive.zip
Extract the plugin matching your CPU, for instance :
   unzip -x onedrive.zip onedrive/linux-64/ntfs-plugin-9000301a.so
Relocate the plugin to /usr/local/lib/ntfs-3g (you may have to create this directory)
   sudo mv onedrive/linux-64/ntfs-plugin-9000301a.so /usr/local/lib/ntfs-3g

3) Unmount your Windows directory, and remount it read-only with ntfs-3g_ntfsprogs-2017.3.23AR.1 (from the directory used in step 1) :
   sudo ntfs-3g_ntfsprogs-2017.3.23AR.1/src/ntfs-3g -o ro /dev/your-windows-partition your-windows-mountpoint

4) List your OneDrive directory and try to access its contents (you may have to do it as root), and report. When done, unmount and remount the usual way.

[Nino Burini (elnigno)]

Same for me, I am not using on demand files.
But after following your steps I could list the files in the folder!

[A B (r2737118)]

Following your post, I was able to list and access files in my OneDrive directory. Please tell me if you need more information.

[Jean-Pierre (jean-pierre-andre)]

> Please tell me if you need more information.

There is an important point about synchronizing cloud files when using on demand mode : what happens when you log into Windows after having updated (through Linux) your local copy of some file ?

[John Markh (dragonsol)]

I have followed the steps in #13 and worked perfectly - i.e. I was able to access the files in OneDrive folder without the need to use root account.

Is there a way to make the change permanent?

[Jean-Pierre (jean-pierre-andre)]

> Is there a way to make the change permanent?

The clean way is to recompile and install ntfs-3g 2017.3.23AR.1 using the ./configure parameters recommended by Ubuntu (which I do not know), then move ntfs-plugin-9000301a.so to the ntfs-3g plugin directory (see post #4 above).

[John Markh (dragonsol)]

I have "installed" the module per #4 and #13 - i.e. copied onedrive/linux-64/ntfs-plugin-9000301a.so to the directory identified by:

strings $(which ntfs-3g) | grep ntfs-plugin

(I had to create the directory identified by the command).

For the last two days, I was able to access the OneDrive folder from Ubuntu as well as from the Windows 10 OS, and the OneDrive seems to be synchronizing the files without issue.

I did, noticed that when I update a file using LibreOffice and then open it using Microsoft Word 2016, Word complains that it can not synchronize the file. However, after saving the files (to a folder synchronized by OneDrive), the file ends up in the cloud. When I open the same file a moment after, Word does not complain...

[Jean-Pierre (jean-pierre-andre)]

> I have "installed" the module...
I assume you have also recompiled and installed ntfs-3g 2017.3.23AR.1 according to recommended Ubuntu settings.

> OneDrive seems to be synchronizing the files without issue.
Does this apply to text files created on Windows and updated by vi/emacs/nano on Ubuntu ? If not, please retry with only appending text on Ubuntu (e.g. "echo some text >> test-file")

> Word complains that it can not synchronize the file
So Word can synchronize new files but not those updated by LibreOffice on Ubuntu. It would be useful to have the ntfsinfo (with -v) output both before and after updating by Libreoffice to check the changes made,... but Word is known to use locking mechanisms which may be defeated by Libreoffice.

[John Markh (dragonsol)]

I haven't touched ntfs-3g, only copied/installed the plugin from onedrive.zip to the directory identified by strings $(which ntfs-3g) | grep ntfs-plugin.

I have created a file using LibreOffice and saved it in a folder synced by OneDrive (see the output of ntfsinfo in 1 - file created by LibreOffice).

Rebooted and switched to Windows 10. Allowed the file to sync - no problem. Opened the file in Word 2016 and saved as with a different name.

Rebooted back into Ubuntu and run ntfsinfo on the original file (now synced by OneDrive) and the file created by Word. Both files can be opened, updated and deleted within Ubuntu without problems (see the output of ntfsinfo in 2 - file created by LibreOffice - Synced and 3 - file updated by Word2016).

[Jean-Pierre (jean-pierre-andre)]

> I haven't touched ntfs-3g, only copied/installed the plugin

Good to know this is usable, though it was not part of the design. You probably cannot browse the OneDrive directory, but apparently you can access files (and browse subdirectories) when you know their path. Despite the inconvenience this should be safe.

In the test scenario, I wanted to see why LibreOffice defeats the synchronization, which I expected to be apparent by comparing the ntfsinfo before and after an update of a synchronized file by LibreOffice (with no further interference from Windows). Your second and your third ntfsinfo are about different files, so I cannot tell.

Expected scenario :
1) Create a file on Windows and get it synchronized.
2) Reboot to Ubuntu
3) Extract the ntfsinfo
4) Update the file using LibreOffice (and save it without creating a new file)
5) Extract again the ntfsinfo
6) (Optionally) Reboot to Windows, and check the file cannot be synchronized any more.

In your second ntfsinfo, I see that an object id has been added (probably to reference the cloud copy). I suspect it was removed by LibreOffice, and if its scenario for saving the updated file is to create a new file and then to rename it like the initial one, then the object id is lost and Windows cannot associate it with the cloud copy any more.

If LibreOffice removes the object id, I see no solution.

[John Markh (dragonsol)]

Followed the test scenario - result: OneDrive has no problem to sync after saving the file with LibreOffice.

[Jean-Pierre (jean-pierre-andre)]

> OneDrive has no problem to sync after saving the file with LibreOffice.

Which makes me wonder whether there is a problem at all...

Your posts #25 and #26 show that LibreOffice does not interfere with the object id assumed to be related to synchronization.

In the last paragraph of #19, I interpreted you were not able to synchronize files updated by LibreOffice, and you had to save into a new file to get it synchronized. This is what I rephrased in #20... But please describe again the steps in #19 which lead to Word not being able to synchronize.

[John Markh (dragonsol)]

I would say there is no problem using OneDrive folder (NTFS drive) after(!) importing the plugin from onedrive.zip.

[Jean-Pierre (jean-pierre-andre)]

Good news. Thanks for reporting.

[Khairul Aizat Kamarudzzaman (fenris)]

when can we expect the patch will be in the ntfs-3g packaging :)

[Khairul Aizat Kamarudzzaman (fenris)]

$ strings $(which ntfs-3g) | grep ntfs-plugin
/usr/lib/x86_64-linux-gnu/ntfs-3g/ntfs-plugin-%08lx.so

do i need to create the folder ntfs-3g since its not available.

I already download the onedrive.zip and copy the ntfs-plugin-9000301a.so into /usr/lib/x86_64-linux-gnu/ntfs-3g/

I didn't managed to list or open OneDrive folder after unmount my windows partition and re-mount it. please advise.

[Jean-Pierre (jean-pierre-andre)]

> do i need to create the folder ntfs-3g since its not available.
Yes, when using ntfs-3g packaged by Ubuntu, you have to move the plugin to /usr/lib/x86_64-linux-gnu/ntfs-3g/ntfs-plugin-9000301a.so

Also, this plugin is designed for ntfs-3g-2017.3.23AR.1 and you will not get its full feature from ntfs-3g-2016.2.22AR.n or ntfs-3g-2017.3.23 (and no use at all from earlier versions).

[Khairul Aizat Kamarudzzaman (fenris)]

I've tried to follow #4

getting confuse with ntfs-plugin-80000017.so

[Khairul Aizat Kamarudzzaman (fenris)]

I've tried to follow #4 , its doesn't working. I also tried to replace the package binary:

fenris@X240:/bin$ ls -al | grep ntfs-3g
-rwxr-xr-x 1 root root 6309 Dec 19 21:59 lowntfs-3g
-rwxr-xr-x 1 root root 109232 Dec 1 03:38 lowntfs-3g.ori
-rwxr-xr-x 1 root root 6279 Dec 19 22:00 ntfs-3g
-rwsr-xr-x 1 root root 146128 Dec 1 03:38 ntfs-3g.ori
-rwxr-xr-x 1 root root 6339 Dec 19 22:00 ntfs-3g.probe
-rwxr-xr-x 1 root root 10312 Dec 1 03:38 ntfs-3g.probe.ori
fenris@X240:/bin$ ls -al .libs/
total 1172
drwxr-xr-x 2 root root 4096 Dec 19 22:01 .
drwxr-xr-x 3 root root 12288 Dec 19 22:01 ..
-rwxr-xr-x 1 root root 475528 Dec 19 22:01 lowntfs-3g
-rwxr-xr-x 1 root root 668752 Dec 19 22:01 ntfs-3g
-rwxr-xr-x 1 root root 31576 Dec 19 22:01 ntfs-3g.probe
fenris@X240:/bin$

but getting confuse with systcomp.zip ntfs-plugin-80000017.so @ ntfs-plugin-9000301a.so to be put into

fenris@X240:/bin$ ls /usr/lib/x86_64-linux-gnu/ | grep ntfs
libfsntfs.so.1
libfsntfs.so.1.0.0
ntfs-3g
ntfs-plugin-80000017.so
ntfs-plugin-9000301a.so

fenris@X240:/bin$ ls /usr/lib/x86_64-linux-gnu/ntfs-3g/
ntfs-plugin-80000017.so

[Jean-Pierre (jean-pierre-andre)]

> I've tried to follow #4
> getting confuse with ntfs-plugin-80000017.so

Post #4 is about system compression, which needs the plugin ntfs-plugin-80000017.so, but according to your post #31 you are trying to access a OneDrive directory, which needs the plugin ntfs-plugin-9000301a.so (a different plugin to do a different job, though it has to be put in the same directory).

> fenris@X240:/bin$ ls /usr/lib/x86_64-linux-gnu/ | grep ntfs
> libfsntfs.so.1
> libfsntfs.so.1.0.0
> ntfs-3g
> ntfs-plugin-80000017.so
> ntfs-plugin-9000301a.so
>
> fenris@X240:/bin$ ls /usr/lib/x86_64-linux-gnu/ntfs-3g/
> ntfs-plugin-80000017.so

According to your post #31, your plugin directory is /usr/lib/x86_64-linux-gnu/ntfs-3g and apparently you have put ntfs-plugin-9000301a.so elsewhere, as your ls output only shows ntfs-plugin-80000017.so (which is for system compression).

Also, please be clear about the ntfs-3g version you are using (just type "ntfs-3g -help")

[Khairul Aizat Kamarudzzaman (fenris)]

fenris@X240:~$ ls /usr/lib/x86_64-linux-gnu/ntfs-3g/
ntfs-plugin-9000301a.so
fenris@X240:~$ ntfs-3g --help

ntfs-3g 2017.3.23AR.1 integrated FUSE 27 - Third Generation NTFS Driver
                Configuration type 1, XATTRS are on, POSIX ACLS are off

Copyright (C) 2005-2007 Yura Pakhuchiy
Copyright (C) 2006-2009 Szabolcs Szakacsits
Copyright (C) 2007-2017 Jean-Pierre Andre
Copyright (C) 2009 Erik Larsson

Usage: ntfs-3g [-o option[,...]] <device|image_file> <mount_point>

Options: ro (read-only mount), windows_names, uid=, gid=,
          umask=, fmask=, dmask=, streams_interface=.
          Please see the details in the manual (type: man ntfs-3g).
                                                           ...

[Jean-Pierre (jean-pierre-andre)]

So, you have compiled ntfs-3g 2017.3.23AR.1, but probably without using the Ubuntu recommended configure options. Hence the plugins are expected in a default directory, not the one defined by Ubuntu.

You have again to run :
strings $(which ntfs-3g) | grep ntfs-plugin
and relocate the plugins.

If you ran ./configure with no arguments, the destination will probably be :
/usr/local/lib/ntfs-3g/ntfs-plugin-9000301a.so

[Khairul Aizat Kamarudzzaman (fenris)]

fenris@X240:~$ ntfs-3g --help

ntfs-3g 2017.3.23AR.1 integrated FUSE 27 - Third Generation NTFS Driver
                Configuration type 1, XATTRS are on, POSIX ACLS are off

Copyright (C) 2005-2007 Yura Pakhuchiy
Copyright (C) 2006-2009 Szabolcs Szakacsits
Copyright (C) 2007-2017 Jean-Pierre Andre
Copyright (C) 2009 Erik Larsson

Usage: ntfs-3g [-o option[,...]] <device|image_file> <mount_point>

Options: ro (read-only mount), windows_names, uid=, gid=,
          umask=, fmask=, dmask=, streams_interface=.
          Please see the details in the manual (type: man ntfs-3g).

Example: ntfs-3g /dev/sda1 /mnt/windows

News, support and information: http://tuxera.com
fenris@X240:~$ ls /usr/local/lib/ntfs-3g/
ntfs-plugin-9000301a.so

fenris@X240:~$ ls -al /media/fenris/746A024C6A020C14/Users/fenris/OneDrive
lrwxrwxrwx 1 fenris fenris 25 Dec 21 05:11 /media/fenris/746A024C6A020C14/Users/fenris/OneDrive -> unsupported reparse point

[Khairul Aizat Kamarudzzaman (fenris)]

fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1/src/.libs$ strings ntfs-3g | grep ntfs-plugin
/usr/local/lib/ntfs-3g/ntfs-plugin-%08lx.so

[Jean-Pierre (jean-pierre-andre)]

> fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1/src/.libs$ strings ntfs-3g | grep ntfs-plugin

In the above command, you are examining what you have compiled, but the meaningful file is the one you are executing, and this is still not clear to me as your posts come from different situations.

Well, I have to check everything you did...

1) please post the ntfsinfo for the OneDrive directory :
sudo ntfsinfo -fvF /Users/fenris/OneDrive /dev/sdxx
(replace sdxx by the partition name, like sda1)

2) post your system parameters, your PATH and the md5 of the plugin you are using :
uname -a
echo $PATH
md5sum /usr/local/lib/ntfs-3g/ntfs-plugin-9000301a.so

3) did you install ntfs-3g 2017.3.23AR.1 ?

4a) If you installed ntfs-3g 2017.3.23AR.1 (see #4 replacing 80000017.so by 9000301a.so) post the result of
which ntfs-3g
and mount using the usual mount command.

4b) If you did not install, apply #13 stay in the compile directory (~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1) then post the result of
ls -l src/ntfs-3g
and mount using src/ntfs-3g (not src/.libs/ntfs-3g !)

5) Post both your mount command (depends on 4a or 4b) and the ls output for OneDrive.

[Khairul Aizat Kamarudzzaman (fenris)]

> > fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1/src/.libs$
> strings ntfs-3g | grep ntfs-plugin
>
> In the above command, you are examining what you have compiled, but the
> meaningful file is the one you are executing, and this is still not
> clear to me as your posts come from different situations.
>
> Well, I have to check everything you did...
>
> 1) please post the ntfsinfo for the OneDrive directory :
> sudo ntfsinfo -fvF /Users/fenris/OneDrive /dev/sdxx
> (replace sdxx by the partition name, like sda1)

*fenris@X240*:*~*$ sudo ntfsinfo -fvF /media/fenris/746A024C6A020C14/Users/fenris/OneDrive /dev/sda2

>
> 2) post your system parameters, your PATH and the md5 of the plugin you are using :
> uname -a
> echo $PATH
> md5sum /usr/local/lib/ntfs-3g/ntfs-plugin-9000301a.so
>
*fenris@X240*:*~*$ uname -a
*fenris@X240*:*~*$ echo $PATH
*fenris@X240*:*~*$ md5sum /usr/local/lib/ntfs-3g/ntfs-plugin-9000301a.so
> 3) did you install ntfs-3g 2017.3.23AR.1 ?
>
no , i just ./configure then make

> 4a) If you installed ntfs-3g 2017.3.23AR.1 (see #4 replacing 80000017.so by 9000301a.so) post the result of
> which ntfs-3g
> and mount using the usual mount command.
nope, i just configure n make only
>
> 4b) If you did not install, apply #13 stay in the compile directory (~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1) then post the result of
> ls -l src/ntfs-3g
> and mount using src/ntfs-3g (not src/.libs/ntfs-3g !)
*fenris@X240*:*~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1*$ ls -l src/ntfs-3g
*src/ntfs-3g*
>
> 5) Post both your mount command (depends on 4a or 4b) and the ls output
> for OneDrive.
>
*fenris@X240*:*~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1*$ sudo src/ntfs-3g -o ro /dev/sda2 /media/fenris
*fenris@X240*:*~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1*$ ls -al /media/fenris/Users/fenris/OneDrive
*/media/fenris/Users/fenris/OneDrive* -> *unsupported reparse point*

[Khairul Aizat Kamarudzzaman (fenris)]

Sorry, its was my mail client with html. Resent as below:

fenris@X240:~$ sudo ntfsinfo -fvF /media/fenris/746A024C6A020C14/Users/fenris/OneDrive /dev/sda2
Forced to continue.
Error loading node: No such file or directory

fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ uname -a
Linux X240 4.14.0-13-generic #15-Ubuntu SMP Mon Dec 18 19:08:44 UTC 2017 x86_64 x86_64 x86_64 GNU/Linux

fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ echo $PATH
/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/home/fenris/bin

fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ md5sum /usr/local/lib/ntfs-3g/ntfs-plugin-9000301a.so
ffb020aa8c7752965e56e0caf03a5698 /usr/local/lib/ntfs-3g/ntfs-plugin-9000301a.so

[Jean-Pierre (jean-pierre-andre)]

> fenris@X240:~$ sudo ntfsinfo -fvF /media/fenris/746A024C6A020C14/Users/fenris/OneDrive /dev/sda2

What I asked for was :
sudo ntfsinfo -fvF /Users/fenris/OneDrive /dev/sda2

> i just ./configure then make

Then why did "ntfs-3g --help" return "ntfs-3g 2017.3.23AR.1" in post #38 with the PATH shown in #42.... Have you copied ntfs-3g in your ~/bin or elsewhere ?

Anyway, please go to directory ntfs-3g_ntfsprogs-2017.3.23AR.1, create a void directory there and mount, using the compiled ntfs-3g (staying on the said directory) :

sudo umount /dev/sda2
mkdir win
ls -l src/ntfs-3g
sudo src/ntfs-3g -o ro /dev/sda2 win
ls -li win/Users/fenris/OneDrive
sudo ntfsinfo -fvF /Users/fenris/OneDrive /dev/sda2
sudo umount win

If this still fails, mount the usual way, then do
ls -li /media/fenris/746A024C6A020C14/Users/fenris/OneDrive
this is supposed to return "unsupported reparse point", but the first item in the output is the inode number, use it for the command below and post its output :
sudo ntfsinfo -fvi inode-number /dev/sda2

[Khairul Aizat Kamarudzzaman (fenris)]

fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ mkdir win
fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ ls -l src/ntfs-3g
-rwxr-xr-x 1 fenris fenris 6279 Dec 19 21:33 src/ntfs-3g
fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ sudo src/ntfs-3g -o ro /dev/sda2 win
fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ ls -lo win/Users/fenris/OneDrive
ls: cannot access 'win/Users/fenris/OneDrive': Input/output error

ntfsinfo as per attached ntfsinfo.txt

[Jean-Pierre (jean-pierre-andre)]

> ntfsinfo as per attached ntfsinfo.txt

Ok, I see : "Reparse tag: 0x9000701a"

This means you use a OneDrive configuration different from the ones posted by other users... So I will have to do something about it.

Please be patient, I will be away next week.

[Jean-Pierre (jean-pierre-andre)]

> fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ ls -lo win/Users/fenris/OneDrive
> ls: cannot access 'win/Users/fenris/OneDrive': Input/output error

I do not understand why you get this error. Can you access the path components ?
(after having mounted with src/ntfs-3g from the directory ntfs-3g_ntfsprogs-2017.3.23AR.1)

ls -ldi win/Users
ls -ldi win/Users/fenris

Also try mounting with src/lowntfs-3g :

sudo umount /dev/sda2
sudo src/lowntfs-3g -o ro /dev/sda2 win
ls -ldi win/Users
ls -ldi win/Users/fenris
ls -ldi win/Users/fenris/OneDrive

Also I see your subdirectories of OneDrive also have a reparse tag and this in another new one (0x9000601a), so you have a complex configuration leaving a lot to guess and experiment.

Would you accept sharing a metadata copy of your ntfs partition, so that I can experiment myself ? This will likely be a big file (a few hundred MB) with no user data, though the file names will be visible.

To create the metadata copy, unmount /dev/sda2 and start
sudo ntfsclone -mst -O - /dev/sda2 | gzip > metadata.gz
Then upload metadata.gz to some server from which I can download it.

[Jean-Pierre (jean-pierre-andre)]

I have uploaded an update plugin version to
http://jp-andre.pagesperso-orange.fr/onedrive101-beta.zip
As this is experimental, only use it in read-only situations. It is quite possible that you have no file copy locally (they would only be in the cloud), in which case there is no much hope you could access them through ntfs-3g.

Please extract onedrive/linux-64/ntfs-plugin-9000301a.so and move it to /usr/local/lib/ntfs-3g

Moreover create two symlinks :
sudo ln -s ntfs-plugin-9000301a.so /usr/local/lib/ntfs-3g/ntfs-plugin-9000601a.so
sudo ln -s ntfs-plugin-9000301a.so /usr/local/lib/ntfs-3g/ntfs-plugin-9000701a.so

Then please mount as read-only, test and report.

And if you still get an "Input/output error", please restart all from the beginning (do a "make clean" and recompile).

[Khairul Aizat Kamarudzzaman (fenris)]

fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ sudo src/ntfs-3g -o ro /dev/sda2 win
fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ ls -ldi win/Users/
660673 drwxrwxrwx 1 root root 4096 Oct 20 09:26 win/Users/
fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ ls -ldi win/Users/fenris/
345397 drwxrwxrwx 1 root root 16384 Dec 4 13:55 win/Users/fenris/
fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ sudo umount /dev/sda2
fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ sudo src/lowntfs-3g -o ro /dev/sda2 win
fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ ls -ldi win/Users
660673 drwxrwxrwx 1 root root 4096 Oct 20 09:26 win/Users
fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ ls -ldi win/Users/fenris
345397 drwxrwxrwx 1 root root 16384 Dec 4 13:55 win/Users/fenris
fenris@X240:~/Downloads/ntfs-3g_ntfsprogs-2017.3.23AR.1$ ls -ldi win/Users/fenris/OneDrive
ls: cannot read symbolic link 'win/Users/fenris/OneDrive': Operation not supported
88997 lrwxrwxrwx 1 root root 25 Dec 21 23:19 win/Users/fenris/OneDrive

as for the metadata ... im so sorry .. :(

[Khairul Aizat Kamarudzzaman (fenris)]

after i tried #47, i managed to get OneDrive content listed ... \0/ but still in read-only

[Khairul Aizat Kamarudzzaman (fenris)]

hi Jean, any new advise / feedback you can share based on my feedback .. thanks & Happy New Year :)

[Jean-Pierre (jean-pierre-andre)]

> any new advise / feedback you can share based on my feedback
You are the only user I know, having a double level of reparse points, so the only feedback I can give now has to come from you.

- Can you access (local) files in OneDrive subdirectories ?
- can you update them ?
- can you create new files ?
- are new or updated files synchronized to cloud when booting subsequently to Windows ?

Note : creating new files or subdirectories on directories marked as reparse points is not possible now.

FYI Debian has packaged ntfs-3g 2017.3.23AR.1, and the packages are likely to be usable on Ubuntu (if dependencies are met).
https://packages.debian.org/experimental/libntfs-3g881
https://packages.debian.org/experimental/ntfs-3g

> Happy New Year
Thanks, and same to you.

[Khairul Aizat Kamarudzzaman (fenris)]

hi Jean,
I've tried to installed the debian package experimental. The result/output are remained the same.

$ ls -ldi OneDrive
88997 lrwxrwxrwx 1 fenris fenris 25 Jan 20 00:39 OneDrive -> 'unsupported reparse point'

[Khairul Aizat Kamarudzzaman (fenris)]

I found another sync software also having the same problem with win 10 reparse point - https://github.com/syncthing/syncthing/issues/4542

[Jean-Pierre (jean-pierre-andre)]

> I've tried to installed the debian package experimental.

So you can confirm it is compatible with Ubuntu.

> The result/output are remained the same.

This is expected.

> 'unsupported reparse point'

This is also expected, if you did not install the plugin at the location which the installed ntfs-3g expects.

[Alexander Sashoga (sashoga84)]

Hi.
I've already install ALL ntfs-3g plugins. But many errors exists.
I've load Windows 10 now, and I can't write errors log to you now.
It's something like that:

...something file C:\Program Files\internet explorer\xxx.dat is bigger than 64k... oper_save.c###. xxx.dat is 65k... and more and more like that...

all plugins are installed.

but BACKUP program can't save all files in NTFS partitions. Backup program wrote me "Not all files has been saved...."

I think you are clever. And No need to send you all my errors.log because I haven't that HDD now.
What do you think?
I need stability and need to do 100% backup of my Windows 10 system!
There are have many programs which no need a ntfs-3g that can save my NTFS partition!!!
Do something!!!! All data are need me!

[Jean-Pierre (jean-pierre-andre)]

> ...something file C:\Program Files\internet explorer\xxx.dat is
> bigger than 64k... oper_save.c###. xxx.dat is 65k... and more
> and more like that...

This does not look like a reparse point error.

> but BACKUP program can't save all files in NTFS partitions.

To backup a Windows system partition you should use a program which takes an image of it, rather than extract its files. By extracting system files you lose several of their attributes (compression, hard links, short file names, integrity markers, etc.), with some attributes not translatable to Linux.

> There are have many programs which no need a ntfs-3g that
> can save my NTFS partition!!!

I agree, and using ntfs-3g is not the right way to save a system partition.

> No need to send you all my errors.log

Some details would however be useful for doing something about the errors. At least, please post the metadata of a file which could not be read :

sudo ntfsinfo -fv -F "/Program Files/internet explorer/xxx.dat" /dev/sdxx

Replace "xxx.dat" by the name of a file which could not be read, and "sdxx" by the name of the Windows partition.

[Alexander Sashoga (sashoga84)]

> To backup a Windows system partition you should use a program which takes an image of it
Can you say me what the program is it? What is her name?

> I agree, and using ntfs-3g is not the right way to save a system partition.
What way are right? How to do it?

There is error log:

[Alexander Sashoga (sashoga84)]

> sudo ntfsinfo -fv -F "/Program Files/internet explorer/xxx.dat" /dev/sdxx

Replace "xxx.dat" by the name of a file which could not be read, and "sdxx" by the name of the Windows partition.

THAT IS IT:

root@sashoga:/home/alexander# ntfsinfo -fv -F "/Windows/WinSxS/x86_system.printing_31bf3856ad364e35_10.0.17134.1_none_fca2539126e9425b/System.Printing.dll" /dev/sda4
Forced to continue.
Dumping Inode 317848 (0x4d998)
Upd. Seq. Array Off.: 48 (0x30)
Upd. Seq. Array Count: 3 (0x3)
Upd. Seq. Number: 21 (0x15)
LogFile Seq. Number: 0x14b4862a6
MFT Record Seq. Numb.: 3 (0x3)
Number of Hard Links: 4 (0x4)
Attribute Offset: 56 (0x38)
MFT Record Flags: IN_USE
Bytes Used: 664 (0x298) bytes
Bytes Allocated: 1024 (0x400) bytes
Next Attribute Instance: 19 (0x13)
MFT Padding: 00 00
Dumping attribute $STANDARD_INFORMATION (0x10) from mft record 317848 (0x4d998)
 Attribute length: 96 (0x60)
 Resident: Yes
 Name length: 0 (0x0)
 Name offset: 0 (0x0)
 Attribute flags: 0x0000
 Attribute instance: 0 (0x0)
 Data size: 72 (0x48)
 Data offset: 24 (0x18)
 Resident flags: 0x00
 ReservedR: 0 (0x0)
 File Creation Time: Fri Jun 15 17:59:47 2018 UTC
 File Altered Time: Mon Mar 5 13:07:00 2018 UTC
 MFT Changed Time: Fri Jun 15 18:00:22 2018 UTC
 Last Accessed Time: Fri Jun 15 18:00:06 2018 UTC
 File attributes: ARCHIVE SPARSE_FILE REPARSE_POINT UNKNOWN: 0x00040000 (0x00040620)
 Maximum versions: 0
 Version number: 0
 Class ID: 0
 User ID: 0 (0x0)
 Security ID: 543 (0x21f)
 Quota charged: 0 (0x0)
 Update Sequence Number: 1910294072 (0x71dcc638)
Dumping attribute $ATTRIBUTE_LIST (0x20) from mft record 317848 (0x4d998)
 Attribute length: 376 (0x178)
 Resident: Yes
 Name length: 0 (0x0)
 Name offset: 0 (0x0)
 Attribute flags: 0x0000
 Attribute instance: 17 (0x11)
 Data size: 352 (0x160)
 Data offset: 24 (0x18)
 Resident flags: 0x00
 ReservedR: 0 (0x0)
 Dumping attribute list:
  Attribute type: 0x10
  Record length: 32 (0x20)
  Name length: 0 (0x0)
  Name offset: 26 (0x1a)
  Starting VCN: 0 (0x0)
  MFT reference: 317848 (0x4d998)
  Instance: 0 (0x0)
  Name: unnamed
  Padding: 44 43 00 00 00 00

  Attribute type: 0x30
  Record length: 32 (0x20)
  Name length: 0 (0x0)
  Name offset: 26 (0x1a)
  Starting VCN: 0 (0x0)
  MFT reference: 325707 (0x4f84b)
  Instance: 0 (0x0)
  Name: unnamed
  Padding: 00 00 00 00 00 00

  Attribute type: 0x30
  Record length: 32 (0x20)
  Name length: 0 (0x0)
  Name offset: 26 (0x1a)
  Starting VCN: 0 (0x0)
  MFT reference: 325707 (0x4f84b)
  Instance: 1 (0x1)
  Name: unnamed
  Padding: 00 00 00 00 00 00

  Attribute type: 0x30
  Record length: 32 (0x20)
  Name length: 0 (0x0)
  Name offset: 26 (0x1a)
  Starting VCN: 0 (0x0)
  MFT reference: 325707 (0x4f84b)
  Instance: 2 (0x2)
  Name: unnamed
  Padding: 00 00 00 00 00 00

  Attribute type: 0x30
  Record length: 32 (0x20)
  Name length: 0 (0x0)
  Name offset: 26 (0x1a)
  Starting VCN: 0 (0x0)
  MFT reference: 317848 (0x4d998)
  Instance: 18 (0x12)
  Name: unnamed
  Padding: 00 00 00 00 00 00

  Attribute type: 0x80
  Record length: 32 (0x20)
  Name length: 0 (0x0)
  Name offset: 26 (0x1a)
  Starting VCN: 0 (0x0)
  MFT refe...

[Jean-Pierre (jean-pierre-andre)]

This file is "system compressed", so you need the systcomp plugin to read it. It is a system dll which has three symlinks and a short name, and it also has an integrity tag.

Most file-level backup programs will decompress the file, and lose its special attributes, so you will not be able to restore it.

Which error do you get when you copy this file by a regular cp command ?

>> To backup a Windows system partition you should use a program
>> which takes an image of it
> Can you say me what the program is it? What is her name?

I usually use ntfsclone to save an ntfs partition. For instance :
(the partition /dev/sdxx has to be unmounted beforehand)

sudo ntfsclone -s -O - /dev/sdxx | gzip > saved-image.gz

and you can restore it by (notice the isolated final "-") :

gzip -cd saved-image.gz | sudo ntfsclone -r -O /dev/sdxx -

In your case, most of the files are already compressed, so you will save time by not processing through gzip.

[Alexander Sashoga (sashoga84)]

> This file is "system compressed", so you need the systcomp plugin to read it.
Already installed.

> Which error do you get when you copy this file by a regular cp command ?
There is no errors. Copying of this file is successfull. But FSArchiver can't save all files. The full log above.

> I usually use ntfsclone to save an ntfs partition.
The repositories with this program is not exists. I can't find it. However I'm searching a universal program which can work with many types of filesystems (ext3,ext4,ntfs,vfat) for make backup of my system. I have success working with partimage, but it not support ext4 and ReiserFS.

[Jean-Pierre (jean-pierre-andre)]

>> Which error do you get when you copy this file by a regular cp command ?
> There is no errors. Copying of this file is successfull. But FSArchiver can't save all files. The full log above.

So ntfs-3g and the plugin are fine, but saving individual Windows system files is not the way to go.

>> I usually use ntfsclone to save an ntfs partition.
>The repositories with this program is not exists.

You must have it already installed. It is in the same package as ntfsinfo which you have used.

> I have success working with partimage, but it not support ext4 and ReiserFS.

AFAIK partimage can also image a Windows system partition.

[Alexander Sashoga (sashoga84)]

> but saving individual Windows system files is not the way to go.
You want to say what I can't use FSarchiver backup program for making backup of my Windows 10 system and be better to use partimage for this action?

In theory this two backup programs can make to do backup of NTFS partitions.

Than looks like this programs are different!
I'm confused ;-(

[Khairul Aizat Kamarudzzaman (fenris)]

any update or progress?

[Jean-Pierre (jean-pierre-andre)]

> any update or progress?

You may want to try ntfs-3g-2017.3.23AR.3
Please see http://jp-andre.pagesperso-orange.fr/junctions.html#other

[walterclozet (walterclozet-u)]

I have compiled and installed ntfs-3g-2017.3.23AR.3, by default, i can access all directories in one drive folder, but all files are not valid, trying ls -al, shows like:
lrwxrwxrwx 1 root root 25 3月 16 2017 layout.txt -> 'unsupported reparse point'

sudo ntfsinfo -fv -F ~/data/云/OneDrive/layout.txt /dev/sdb2
Forced to continue.
Error loading node: 没有那个文件或目录
the Chinese text above means no such file or directory.

[walterclozet (walterclozet-u)]

and here's the plugin info
strings $(which ntfs-3g) | grep ntfs-plugin
/usr/local/lib/ntfs-3g/ntfs-plugin-%08lx.so

ls -al /usr/local/lib/ntfs-3g/
总用量 52
drwxr-xr-x 2 root root 4096 10月 25 09:58 .
drwxr-xr-x 6 root root 4096 10月 25 09:44 ..
-rwxr-xr-x 1 root root 16680 8月 20 23:45 ntfs-plugin-80000013.so
-rwxr-xr-x 1 root root 21562 9月 10 2016 ntfs-plugin-80000017.so

[Jean-Pierre (jean-pierre-andre)]

> but all files are not valid

Can you access some files (those with an on-disk copy) ? You are expected to not be able to access files which have no local copy.

> sudo ntfsinfo -fv -F ~/data/云/OneDrive/layout.txt /dev/sdb2

ntfsinfo expects a path from the root directory of the designated partition (/dev/sdb2). For user files on a Windows system directory, the path beginning is usually /Users.
Anyway, I am not sure ntfsinfo will be able to descend into a OneDrive directory, so please retry and get the inode first, then get the attributes by inode number.

By doing :
ls -li some-path/layout.txt
you will get the inode number shown at the beginning of line, then you get the attributes by doing :
sudo ntfsinfo -fvi the-inode-number /dev/sdb2

[Norbert Preining (preining)]

Chiming in with some answers in the last document:
* running Windows 10 latest (retracted) update (I got it somehow)
* Debian/unstable
* ntfs-3g 1:2017.3.23-2
* files should be all available offline (not on-demand)
```
# ls -l /usr/lib/x86_64-linux-gnu/ntfs-3g/
total 60
-rwxr-xr-x 1 root root 16680 Oct 29 15:16 ntfs-plugin-80000013.so
-rwxr-xr-x 1 root root 21562 Oct 29 15:16 ntfs-plugin-80000017.so
-rwxr-xr-x 1 root root 7202 Oct 29 15:08 ntfs-plugin-9000301a.so
lrwxrwxrwx 1 root root 23 Oct 29 15:12 ntfs-plugin-9000601a.so -> ntfs-plugin-9000301a.so
lrwxrwxrwx 1 root root 23 Oct 29 15:12 ntfs-plugin-9000701a.so -> ntfs-plugin-9000301a.so
```

With these files in place, I can access the OneDrive folder now (before it was not possible), but the files in OneDrive are not accessible (unsupported reparse point).

For one file (TeXLaTeXcourse.pdf, inode 330476) I did ntfsinfo -fvi 330476 /dev/sda3 and got the attached ntfsinfo.txt

Any suggestions what else is necessary?

[Jean-Pierre (jean-pierre-andre)]

> Chiming in with some answers in the last document

Thank you for your help trying to get this right, which I cannot do when users reporting issues do not answer my questions.

> * ntfs-3g 1:2017.3.23-2

This is unclear to me, what is the output of :
$(which ntfs-3g) -help 2>&1 | grep ration

> For one file (TeXLaTeXcourse.pdf, inode 330476) I did ntfsinfo -fvi 330476

This file has a local copy, which should be able to access through ntfs-3g,... when I am get a correct picture. It would be useful if you also display the parent directory, which is apparently inode 462099 :
sudo ntfsinfo -fvi 462099

[Norbert Preining (preining)]

Hi Jean-Pierre,
thanks for your quick response.
I realized that I was not completely correct with what I wrote. I had the files on the local drive *I*BELIEVE*, but checking the settings of OneDrive I saw that the option "Save Space blabla on demand" was turned on.

I then turned that option off, which resulted in hardly any activity because as I said I believe all the files were already there.

Then I rebooted into Linux and could access all files without any problems.

I tried to revert by going back to Windows, turning the "on demand" option on in the OneDrive settings, let OneDrive settle down a bit, and rebooted back into Linux again.

To my surprise, I could still read all the files. (and yes, I know, this is not what actually helps you, sorry).

Concerning the ntfs number:
ntfs-3g 2017.3.23 integrated FUSE 28 - Third Generation NTFS Driver
  Configuration type 7, XATTRS are on, POSIX ACLS are on

All the best

Norbert

[Jean-Pierre (jean-pierre-andre)]

> To my surprise, I could still read all the files.

I am surprised too, anyway if you get into a situation similar to #68, do not hesitate to report again.

> ntfs-3g 2017.3.23 integrated FUSE 28

This version is unsuitable for accessing OneDrive directories, you will probably have to compile a fix when available.

[Norbert Preining (preining)]

Hi Jean-Pierre,
I'll see whether it comes up again, and if yes, I'll not play around to fix it but try to send all the infos you need.

Concerning version number: I don't see any particular problems with this version, though? Do you think this version is insufficient, and if yes, in which respect?

All the best

Norbert

[Jean-Pierre (jean-pierre-andre)]

> Do you think this version is insufficient, and if yes, in which respect?

This version is a safe one, though it does not support some recent features from Windows 10. It can delegate accesses to "reparsed" files to a plugin, but it cannot delegate directories. So, with a fixed plugin, you might be able to access the file shown in #68 provided it was not in a "reparsed" directory.

However I suspect there have been changes in managing OneDrive files by Windows 10, and new plugin variants are required.

[geole0 (geole0)]

Hello
I discovered this problem after trying to duplicate the contents of the windows partition
with the RSYNC command

rsync -a --delete --filter "- .tmp" --filter "- lost+found/" --filter "- .Trash/" /Windows1 /mnt/sdc14 2>ERROR.txt

All files come from the "Program Files/WindowsApps" directory

However with windows, I found that these files had an attribute A.
Under windows, I launched a purification of unnecessary files and they all been eliminated.

[geole0 (geole0)]

For example under "Ubuntu 18.04.3 LTS"
ls -als "/Windows1/Program Files/WindowsApps/microsoft.windowscommunicationsapps_16005.11629.20316.0_x64__8wekyb3d8bbwe" >$HOME/ERROR1.txt

[geole0 (geole0)]

The same repository Under windows

[Jean-Pierre (jean-pierre-andre)]

> trying to duplicate the contents of the windows partition
> with the RSYNC command
>
> rsync -a --delete --filter "- .tmp" --filter "- lost+found/" --filter
> "- .Trash/" > /Windows1 /mnt/sdc14 2>ERROR.txt

I doubt you get anything useful this way wrt Windows 10 system files : these files have special attributes which rsync cannot process. You should restrict rsync to only process user files.

> For example under "Ubuntu 18.04.3 LTS"
> ls -als "/Windows1/Program
>Files/WindowsApps/microsoft.windowscommunicationsapps_16005.11629.20316.0_x64__8wekyb3d8bbwe" >$HOME/ERROR1.txt

I have examined one such file (HxAccounts.exe), it is system compressed and probably all files from the same directory also are. If you want to read them, you need the "system compressed" plugin (ntfs-plugin-80000017.so). With the plugin, rsync will copy them in uncompressed form, and it will lose the attributes $KERNEL.PURGE.ESBCACHE and $KERNEL.PURGE.APPXFICACHE which have some meaning (unknown to me) for Windows, so the copy cannot serve as a backup.

I do not know whether Ubuntu has packaged the system compression plugin. There are pointers in https://bugs.launchpad.net/ubuntu/+source/ntfs-3g/+bug/1728354/comments/2 above.

For reporting further, please follow
https://jp-andre.pagesperso-orange.fr/junctions.html#other


[suntao (suntaohn)]

I also met the same problems. My onedrive folder created in window 10 cannot be open cand accessed in Ubuntu18.04. I spent long time to solve this, finnaly, I find a way: 1) in widonw10, change onedrive setup, move the the destination folder of onedrive to other path, 2) in Ubuntu18.04, unintsall libntfs-3g88. Then the files and folder which created by "Onedrive software" can be accessed in Ubuntu. This way is work for me.

[Jean-Pierre (jean-pierre-andre)]

@suntao : Did you try the OneDrive plugin from https://jp-andre.pagesperso-orange.fr/junctions.html#other ?

[geole0 (geole0)]

Hello
Same problème with 22.04 Beta Jammy
"time sudo rsync -av --del --exclude=pagefile.sys --exclude=OneDrive --exclude=Edge* /media/$USER/$PART/* /media/$USER/$PART-SAVE >résultat-$PART"

[Jean-Pierre (jean-pierre-andre)]

> Same problème with 22.04 Beta Jammy

Which one ?

Your attachment is missing.

Please post the output of the commands described at the bottom of
https://github.com/tuxera/ntfs-3g/wiki/Junctions-Points,-Symbolic-Links-and-Reparse-Points#other-types-of-reparse-points

[geole0 (geole0)]

Hello
there are at least all files ending with .mui

getfattr -h -n system.ntfs_reparse_data -e hex "/media/a/W21H2B/Program Files/WindowsApps/Microsoft.LanguageExperiencePackfr-FR_19041.40.124.0_neutral__8wekyb3d8bbwe/Windows/System32/fr-FR/CompMgmtLauncher.exe.mui"
getfattr : Suppression des « / » en tête des chemins absolus
# file: media/a/W21H2B/Program Files/WindowsApps/Microsoft.LanguageExperiencePackfr-FR_19041.40.124.0_neutral__8wekyb3d8bbwe/Windows/System32/fr-FR/CompMgmtLauncher.exe.mui
system.ntfs_reparse_data=0x170000801000000001000000020000000100000002000000

$(which ntfs-3g) -help 2>&1 | grep ration
ntfs-3g 2021.8.22 integrated FUSE 28 - Third Generation NTFS Driver
  Configuration type 7, XATTRS are on, POSIX ACLS are on

file $(which ntfs-3g)
/usr/bin/ntfs-3g: ELF 64-bit LSB pie executable, x86-64, version 1 (SYSV), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, BuildID[sha1]=d6eead7b0c79cb65b47b4f8cb1c89108e3ffe0d5, for GNU/Linux 3.2.0, stripped

md5sum $(which ntfs-3g)
0516ddcc6b804b856b606ac2ed6ceab6 /usr/bin/ntfs-3g

ls -ld $(strings $(which ntfs-3g) | grep ntfs-plugin | sed -e 's/ntfs-plugin.*//')
ls: impossible d'accéder à '/usr/lib/x86_64-linux-gnu/ntfs-3g/': Aucun fichier ou dossier de ce type

ls /usr/lib/x86_64-linux-gnu/n*
/usr/lib/x86_64-linux-gnu/nautilus:
extensions-3.0

/usr/lib/x86_64-linux-gnu/nss:
libfreebl3.chk libfreebl3.so libfreeblpriv3.chk libfreeblpriv3.so libnssckbi.so libnssdbm3.chk libnssdbm3.so libsoftokn3.chk libsoftokn3.so

dpkg -l | grep ntfs
ii libntfs-3g89 1:2021.8.22-3ubuntu1 amd64 read/write NTFS driver for FUSE (runtime library)
ii ntfs-3g 1:2021.8.22-3ubuntu1 amd64 read/write NTFS driver for FUSE

 journalctl -b | grep BOOT_IMAGE
avril 11 12:18:57 a kernel: Command line: BOOT_IMAGE=/BOOT/ubuntu_b4yff9@/vmlinuz-5.15.0-25-generic root=ZFS=rpool/ROOT/ubuntu_b4yff9 ro
avril 11 12:18:57 a kernel: Kernel command line: BOOT_IMAGE=/BOOT/ubuntu_b4yff9@/vmlinuz-5.15.0-25-generic root=ZFS=rpool/ROOT/ubuntu_b4yff9 ro
avril 11 12:18:57 a kernel: Unknown kernel command line parameters "BOOT_IMAGE=/BOOT/ubuntu_b4yff9@/vmlinuz-5.15.0-25-generic", will be passed to user space.
avril 11 12:18:57 a kernel: BOOT_IMAGE=/BOOT/ubuntu_b4yff9@/vmlinuz-5.15.0-25-generic

Thank you

[geole0 (geole0)]

Hello.
I just found the reason.

The receiving partition was formatted in FAT32

sorry

[Jean-Pierre (jean-pierre-andre)]

@geole (post #82)

The file shown is "system compressed", which is the case for most Windows 10 system files. You need the "system-compressed" plugin to read it with ntfs-3g, and unfortunately Ubuntu has not packaged it yet.

You can get the source from :
https://github.com/ebiggers/ntfs-3g-system-compression
and compile it yourself the usual way (./configure; make), the move the generated file ntfs-plugin-80000017.so to /usr/lib/x86_64-linux-gnu/ntfs-3g/ntfs-plugin-80000017.so (after you have created the directory /usr/lib/x86_64-linux-gnu/ntfs-3g).

If you do not want to compile it yourself, you can download an earlier version from
https://jp-andre.pagesperso-orange.fr/systcomp.zip
just extract the linux-64 version of ntfs-plugin-80000017.so and move it to /usr/lib/x86_64-linux-gnu/ntfs-3g/ntfs-plugin-80000017.so