Ubuntu One deletes files if file names are too long

[Otto Kekäläinen]

I noticed one day that Rhythmbox complained about some 30 missing files from my Music collection, which I recently synced with U1. Common to all the files was that their filename was very long. Luckily I had a separate backup from where I was able to recover the missing files.

I did a little test to investigate what exactly happens:
1. I copied to directories of files with long filenames to my U1 folder.
2. U1 client started and finished uploading. Everything seemed OK at this moment:

./Le quattro stagioni, Op. 8 No. 1-4 (Musici di San Marco feat. conductor: Alberto Lizzio):
yhteensä 50M
-rwxrwxrwx 1 otto otto 4,3M 2009-02-07 22:02 Antonio Vivaldi - Concerto No. 1 in Mi maggiore, RV 269 "La primavera": I. Allegro.oga
-rwxrwxrwx 1 otto otto 5,5M 2009-02-07 22:03 Antonio Vivaldi - Concerto No. 1 in Mi maggiore, RV 269 "La primavera": III. Danza pastorale allegro.oga
-rwxrwxrwx 1 otto otto 3,3M 2009-02-07 22:03 Antonio Vivaldi - Concerto No. 1 in Mi maggiore, RV 269 "La primavera": II. Largo e pianissimo sempre.oga
-rwxrwxrwx 1 otto otto 6,8M 2009-02-07 22:03 Antonio Vivaldi - Concerto No. 2 in Sol minore, RV 315 "L'estate": I. Allegro non molto.oga
-rwxrwxrwx 1 otto otto 2,7M 2009-02-07 22:04 Antonio Vivaldi - Concerto No. 2 in Sol minore, RV 315 "L'estate": II. Adagio - Presto.oga
-rwxrwxrwx 1 otto otto 3,5M 2009-02-07 22:04 Antonio Vivaldi - Concerto No. 2 in Sol minore, RV 315 "L'estate": III. Presto.oga
-rwxrwxrwx 1 otto otto 6,2M 2009-02-07 22:04 Antonio Vivaldi - Concerto No. 3 in Fa maggiore, RV 293 "L'autunno": I. Allegro.oga
-rwxrwxrwx 1 otto otto 2,5M 2009-02-07 22:05 Antonio Vivaldi - Concerto No. 3 in Fa maggiore, RV 293 "L'autunno": II. Adagio.oga
-rwxrwxrwx 1 otto otto 4,0M 2009-02-07 22:05 Antonio Vivaldi - Concerto No. 3 in Fa maggiore, RV 293 "L'autunno": III. Allegro.oga
-rwxrwxrwx 1 otto otto 4,3M 2009-02-07 22:05 Antonio Vivaldi - Concerto No. 4 in Fa minore, RV 297 "L'inverno": I. Allegro non molto.oga
-rwxrwxrwx 1 otto otto 4,3M 2009-02-07 22:06 Antonio Vivaldi - Concerto No. 4 in Fa minore, RV 297 "L'inverno": III. Allegro.oga
-rwxrwxrwx 1 otto otto 2,6M 2009-02-07 22:05 Antonio Vivaldi - Concerto No. 4 in Fa minore, RV 297 "L'inverno": II. Largo.oga

./The Four Seasons and other Great Masterworks:
yhteensä 147M
-rwxrwxrwx 1 otto otto 8,4M 2009-02-07 18:17 Antonio Vivaldi - Concerto for 2 Trumpets and String Orchestra in C major RV 537.oga
-rwxrwxrwx 1 otto otto 5,4M 2009-02-07 18:20 Antonio Vivaldi - Concerto for 2 violins and String Orchestra No.4 in G major "Alla Rustica" RV 151.oga
-rwxrwxrwx 1 otto otto 13M 2009-02-07 18:24 Antonio Vivaldi - Concerto for Cello, String Orchestra and Basso Continuo in A minor RV 420.oga
-rwxrwxrwx 1 otto otto 14M 2009-02-07 18:23 Antonio Vivaldi - Concerto for Flute, Guitar and String Orchestra in G major.oga
-rwxrwxrwx 1 otto otto 12M 2009-02-07 18:21 Antonio Vivaldi - Concerto for Guitar and String Orchestra in D major.oga
-rwxrwxrwx 1 otto otto 10M 2009-02-07 18:18 Antonio Vivaldi - Concerto for Mandolin, String Orchestra and Cembalo in C major RV 425.oga
-rwxrwxrwx 1 otto otto 6,5M 2009-02-07 18:17 Antonio Vivaldi - Concerto for Organ and String Orchestra in D major Op. 12 No.3 RV 124.oga
-rwxrwxrwx 1 otto otto 13M 2009-02-07 18:22 Antonio Vivaldi - Concerto for Violin, Cello and String Orchestra in F major RV 544.oga
-rwxrwxrwx 1 otto otto 13M 2009-02-07 18:22 Antonio Vivaldi - Concerto grosso from "L'Estro armonico" Op. 3 No.11.oga
-rwxrwxrwx 1 otto otto 7,0M 2009-02-07 18:20 Antonio Vivaldi - Concerto No.1 for Flute and String Orchestra in F major Op. 10-1 "La Tempesta di Mare" RV 433.oga
-rwxrwxrwx 1 otto otto 12M 2009-02-07 18:14 Antonio Vivaldi - Concerto No.1: "Spring" RV 269.oga
-rwxrwxrwx 1 otto otto 12M 2009-02-07 18:15 Antonio Vivaldi - Concerto No.2: "Summer" RV 315.oga
-rwxrwxrwx 1 otto otto 14M 2009-02-07 18:16 Antonio Vivaldi - Concerto No.3: "Autumn" RV 293.oga
-rwxrwxrwx 1 otto otto 11M 2009-02-07 18:16 Antonio Vivaldi - Concerto No.4: "Winter" RV 297.oga

3. Two days later file listing showed:

./Le quattro stagioni, Op. 8 No. 1-4 (Musici di San Marco feat. conductor: Alberto Lizzio):
yhteensä 41M
-rwxrwxrwx 1 otto otto 4,3M 2009-02-07 22:02 Antonio Vivaldi - Concerto No. 1 in Mi maggiore, RV 269 "La primavera": I. Allegro.oga
-rwxrwxrwx 1 otto otto 6,8M 2009-02-07 22:03 Antonio Vivaldi - Concerto No. 2 in Sol minore, RV 315 "L'estate": I. Allegro non molto.oga
-rwxrwxrwx 1 otto otto 2,7M 2009-02-07 22:04 Antonio Vivaldi - Concerto No. 2 in Sol minore, RV 315 "L'estate": II. Adagio - Presto.oga
-rwxrwxrwx 1 otto otto 3,5M 2009-02-07 22:04 Antonio Vivaldi - Concerto No. 2 in Sol minore, RV 315 "L'estate": III. Presto.oga
-rwxrwxrwx 1 otto otto 6,2M 2009-02-07 22:04 Antonio Vivaldi - Concerto No. 3 in Fa maggiore, RV 293 "L'autunno": I. Allegro.oga
-rwxrwxrwx 1 otto otto 2,5M 2009-02-07 22:05 Antonio Vivaldi - Concerto No. 3 in Fa maggiore, RV 293 "L'autunno": II. Adagio.oga
-rwxrwxrwx 1 otto otto 4,0M 2009-02-07 22:05 Antonio Vivaldi - Concerto No. 3 in Fa maggiore, RV 293 "L'autunno": III. Allegro.oga
-rwxrwxrwx 1 otto otto 4,3M 2009-02-07 22:05 Antonio Vivaldi - Concerto No. 4 in Fa minore, RV 297 "L'inverno": I. Allegro non molto.oga
-rwxrwxrwx 1 otto otto 4,3M 2009-02-07 22:06 Antonio Vivaldi - Concerto No. 4 in Fa minore, RV 297 "L'inverno": III. Allegro.oga
-rwxrwxrwx 1 otto otto 2,6M 2009-02-07 22:05 Antonio Vivaldi - Concerto No. 4 in Fa minore, RV 297 "L'inverno": II. Largo.oga

./The Four Seasons and other Great Masterworks:
yhteensä 135M
-rwxrwxrwx 1 otto otto 8,4M 2009-02-07 18:17 Antonio Vivaldi - Concerto for 2 Trumpets and String Orchestra in C major RV 537.oga
-rwxrwxrwx 1 otto otto 13M 2009-02-07 18:24 Antonio Vivaldi - Concerto for Cello, String Orchestra and Basso Continuo in A minor RV 420.oga
-rwxrwxrwx 1 otto otto 14M 2009-02-07 18:23 Antonio Vivaldi - Concerto for Flute, Guitar and String Orchestra in G major.oga
-rwxrwxrwx 1 otto otto 12M 2009-02-07 18:21 Antonio Vivaldi - Concerto for Guitar and String Orchestra in D major.oga
-rwxrwxrwx 1 otto otto 10M 2009-02-07 18:18 Antonio Vivaldi - Concerto for Mandolin, String Orchestra and Cembalo in C major RV 425.oga
-rwxrwxrwx 1 otto otto 6,5M 2009-02-07 18:17 Antonio Vivaldi - Concerto for Organ and String Orchestra in D major Op. 12 No.3 RV 124.oga
-rwxrwxrwx 1 otto otto 13M 2009-02-07 18:22 Antonio Vivaldi - Concerto for Violin, Cello and String Orchestra in F major RV 544.oga
-rwxrwxrwx 1 otto otto 13M 2009-02-07 18:22 Antonio Vivaldi - Concerto grosso from "L'Estro armonico" Op. 3 No.11.oga
-rwxrwxrwx 1 otto otto 12M 2009-02-07 18:14 Antonio Vivaldi - Concerto No.1: "Spring" RV 269.oga
-rwxrwxrwx 1 otto otto 12M 2009-02-07 18:15 Antonio Vivaldi - Concerto No.2: "Summer" RV 315.oga
-rwxrwxrwx 1 otto otto 14M 2009-02-07 18:16 Antonio Vivaldi - Concerto No.3: "Autumn" RV 293.oga
-rwxrwxrwx 1 otto otto 11M 2009-02-07 18:16 Antonio Vivaldi - Concerto No.4: "Winter" RV 297.oga

Diff shows:
< -rwxrwxrwx 1 otto otto 5,5M 2009-02-07 22:03 Antonio Vivaldi - Concerto No. 1 in Mi maggiore, RV 269 "La primavera": III. Danza pastorale allegro.oga
< -rwxrwxrwx 1 otto otto 3,3M 2009-02-07 22:03 Antonio Vivaldi - Concerto No. 1 in Mi maggiore, RV 269 "La primavera": II. Largo e pianissimo sempre.oga
< -rwxrwxrwx 1 otto otto 5,4M 2009-02-07 18:20 Antonio Vivaldi - Concerto for 2 violins and String Orchestra No.4 in G major "Alla Rustica" RV 151.oga
< -rwxrwxrwx 1 otto otto 7,0M 2009-02-07 18:20 Antonio Vivaldi - Concerto No.1 for Flute and String Orchestra in F major Op. 10-1 "La Tempesta di Mare" RV 433.oga

Timestamps of the folder shows that they where changed 2011-01-24 08:55 GMT+3. This is the time I started my computer this morning and my conclusion is, that somehow the files where deleted on the server and then the deletion is synced locally, so that the files disappear permanently. (In this test I of course have backups in folders U1 does not touch.)

I can repeat this every time I try.

I'm running Lucid with all updates installed.

[Otto Kekäläinen (otto)]

Example of full path of a file the U1 deleted: /home/otto/Ubuntu One/U1 bug test Antonio Vivaldi/Le quattro stagioni, Op. 8 No. 1-4 (Musici di San Marco feat. conductor: Alberto Lizzio)/Antonio Vivaldi - Concerto No. 1 in Mi maggiore, RV 269 "La primavera": III. Danza pastorale allegro.oga

The path was ~/Music/Antonio Vivaldi/... when U1 deleted the files from my Music sync.

Note that the files are visible also at https://one.ubuntu.com/files/ for a few days until U1 deletes them.

[Otto Kekäläinen (otto)]

File name lengths:
104: Antonio Vivaldi - Concerto No. 1 in Mi maggiore, RV 269 "La primavera": III. Danza pastorale allegro.oga
105: Antonio Vivaldi - Concerto No. 1 in Mi maggiore, RV 269 "La primavera": II. Largo e pianissimo sempre.oga
103: Antonio Vivaldi - Concerto for 2 violins and String Orchestra No.4 in G major "Alla Rustica" RV 151.oga
115: Antonio Vivaldi - Concerto No.1 for Flute and String Orchestra in F major Op. 10-1 "La Tempesta di Mare" RV 433.oga

Max file name length on my system is 255 characters. I'm running ext4 (and no ecryptfs).

After uploading, I can download and listen to the file from https://one.ubuntu.com/files/ so the transfer phase works. I don't think it is related to bug #657195.

[Otto Kekäläinen (otto)]

However I have one laptop attached to my account that runs ecryptfs. On it the max file name length is 143 characters. After some testing I can conclude, that it can upload files < 143 characters but not download. So this bug is in fact a duplicate of #657195 after all. (Reason originating from bug #344878.)