Ubuntu One doesn't synchronize all files

[Maciej Czerwiński]

Binary package hint: ubuntuone-client

Hi,
My problem is that If i put a single file into Ubuntu One folder it usually works great (but sometimes it is not reacting), but if I put there folder that contains other files and other folders, it doesn't synchronize all of them. For example I put there folder that contains 5 other folders and 2 files, and it only put online 1 folder and one file.
If it may help, todays I had also two .u1confilict files created.

ProblemType: Bug
.home.pumex..cache.ubuntuone.log.syncdaemon.exceptions.log:

.home.pumex..config.ubuntuone.ubuntuone.client.conf:
 [ubuntuone]
 connected = True
 connect = 0
 show_applet = 0
 bookmarked = True
Architecture: i386
Date: Tue Oct 20 21:58:28 2009
DistroRelease: Ubuntu 9.10
Package: ubuntuone-client 1.0.2-0ubuntu1
PackageArchitecture: all
ProcEnviron:
 LANG=pl_PL.UTF-8
 SHELL=/bin/bash
ProcVersionSignature: Ubuntu 2.6.31-14.48-generic
SourcePackage: ubuntuone-client
Uname: Linux 2.6.31-14-generic i686
XsessionErrors:
 (gnome-settings-daemon:1702): GLib-CRITICAL **: g_propagate_error: assertion `src != NULL' failed
 (gnome-settings-daemon:1702): GLib-CRITICAL **: g_propagate_error: assertion `src != NULL' failed
 (polkit-gnome-authentication-agent-1:1766): GLib-CRITICAL **: g_once_init_leave: assertion `initialization_value != 0' failed
 (nautilus:1760): Eel-CRITICAL **: eel_preferences_get_boolean: assertion `preferences_is_initialized ()' failed
 (nautilus:2205): Eel-CRITICAL **: eel_preferences_get_boolean: assertion `preferences_is_initialized ()' failed

[Joshua Hoover (joshuahoover)]

Hi Maciej,

I'm sorry to hear Ubuntu One isn't working properly for you. It's possible some of the issues you're seeing are related to server problems. Has this been an on-going problem? I did a test with folders that were 5 levels deep and each with files in them just now and they all showed up in the web UI.

If you can, please attach ~/.cache/ubuntuone/log/syncdaemon.log to this bug report. Note that attaching syncdaemon.log will show filenames you are attempting to sync with Ubuntu One. If you do not want this to be public, please mark the bug as private and this bug report will only be available to you and the Ubuntu One team.

Thank you,

Joshua

[Maciej Czerwiński (pumex90)]

Hi again,

if I understand it ok, an on-going problems are problems with managing files online with the UbuntuOne webpage? If so, I did have problems with it once (for example I wasn't able to delete some files from there) but the it all started to working properly.
I don't know if it is connected, but today my files are not synchronizing at all: i removed everything from Ubuntu One folder, than put something else there, and there was no reaction (nothing synchronized), although UbuntuOne icon says that it is connected and files are up-to-date.

Of course I'm attaching file you mentioned.

Thanks for all the good work you are doing :)

Maciej

[Maciej Czerwiński (pumex90)]

Just wanted to add, that now I'm having UbuntuOne.u1confilict folder creating all of the time.

[Joshua Hoover (joshuahoover)]

Hi Maciej, Thank you for the additional information. Can you attach your ~/.cache/ubuntuone/log/syncdaemon.log file once again since you're seeing the problem increase? Thank you, Joshua

[Maciej Czerwiński (pumex90)]

Sure, here you've got it :)

[Uli (uli-fohlenrolle)]

I have the same problem. Here is my syncdaemon.log

[Maciej Czerwiński (pumex90)]

And update from me:
Now it is not reacting at all if I put files into Ubuntu1 folder. What i tried to do is removing completly Ubuntu1 and installing it again (I used an instruction that Joshua posted on ubuntuforums)
I also attach my new syncdaemon.log

[Maciej Czerwiński (pumex90)]

Hi,
another update :)
Today after turning on my computer first i saw 'Ubuntu One is now synchronizing your files', but then it said "Cant match consistence with server" (I'm not sure if I transleted it ok)
New syncdaemon.log is attached of course :)

[Matt Griffin (mattgriffin)]

The "Capabilities Mismatch" message notes a current issue we're working through. You can follow our progress at bug 462828.

[robostrop (pogon)]

My problem is similar, Ubuntu One fails to download all files but says it is up to date.

Files on server: about 420 MB
Files on client: about 200 MB

see my log : "Connection was lost in an unclean fashion"

[Juan Melendez (juanmelendez)]

The issue for me is if I'm working on a file or more while sync tries to start. From that point on, sync no longer runs and I'd have to reboot for sync to re-initiate. I think sync is crashing or hanging indefinitely when files are being modified during or just prior to sync.

[Juan Melendez (juanmelendez)]

The syncdaemon just before reboot reads....

2009-11-21 09:25:19,837 - ubuntuone.SyncDaemon.sync - INFO - T:LOCAL:F 20424d95-aadd-47f6-964b-1c3e1d6f7b59 [root:20424d95-aadd-47f6-964b-1c3e1d6f7b59] ''Ubuntu One/Projects/CB-Robotics/cdb/CRCW12061K10FKE.cmp'' | Called put_file (In: T:NONE:F)
2009-11-21 09:25:19,862 - ubuntuone.SyncDaemon.sync - INFO - T:LOCAL:F 3e450959-f0f2-4e16-999d-ace73e6251cf [root:3e450959-f0f2-4e16-999d-ace73e6251cf] ''Ubuntu One/Projects/CB-Robotics/cdb/CRCW06032K40FKEA.cmp'' | Called put_file (In: T:NONE:F)
2009-11-21 09:25:19,885 - ubuntuone.SyncDaemon.sync - INFO - T:LOCAL:F fe006d8d-6a85-45fb-a380-e949b7a2dc4b [root:fe006d8d-6a85-45fb-a380-e949b7a2dc4b] ''Ubuntu One/Projects/CB-Robotics/cdb/LAT-2.cmp'' | Called put_file (In: T:NONE:F)
2009-11-21 09:25:19,909 - ubuntuone.SyncDaemon.sync - INFO - T:LOCAL:F a1b4ce68-ef92-479f-8a75-d4ca43e53dcc [root:a1b4ce68-ef92-479f-8a75-d4ca43e53dcc] ''Ubuntu One/Projects/CB-Robotics/cdb/FBSM-5.cmp'' | Called put_file (In: T:NONE:F)
2009-11-21 09:25:19,937 - ubuntuone.SyncDaemon.sync - INFO - T:LOCAL:F 95463384-f6f2-44e1-bb49-b4d94e5cb1d9 [root:95463384-f6f2-44e1-bb49-b4d94e5cb1d9] ''Ubuntu One/Projects/CB-Robotics/cdb/MCR03EZPFX2201.cmp'' | Called put_file (In: T:NONE:F)
2009-11-21 09:25:19,961 - ubuntuone.SyncDaemon.sync - INFO - T:LOCAL:F a2b76a5e-10dc-4851-889d-2555b37aebe8 [root:a2b76a5e-10dc-4851-889d-2555b37aebe8] ''Ubuntu One/Projects/CB-Robotics/cdb/104-8.cmp'' | Called put_file (In: T:NONE:F)
2009-11-21 09:25:19,988 - ubuntuone.SyncDaemon.sync - INFO - T:LOCAL:F 19afab8e-4fd2-4c17-806f-2f477994a7b1 [root:19afab8e-4fd2-4c17-806f-2f477994a7b1] ''Ubuntu One/Projects/CB-Robotics/cdb/646FY-331K.cmp'' | Called put_file (In: T:NONE:F)
2009-11-21 09:25:20,012 - ubuntuone.SyncDaemon.sync - INFO - T:LOCAL:F c0929e3a-a374-4f69-b779-d9e8d07ac35a [root:c0929e3a-a374-4f69-b779-d9e8d07ac35a] ''Ubuntu One/Projects/CB-Robotics/cdb/ERJ-3EKF2492V.cmp'' | Called put_file (In: T:NONE:F)
2009-11-21 09:25:20,036 - ubuntuone.SyncDaemon.sync - INFO - T:LOCAL:F 40784524-297c-423b-8c33-562d098db4ae [root:40784524-297c-423b-8c33-562d098db4ae] ''Ubuntu One/Projects/CB-Robotics/cdb/PDS1040CTL.cmp'' | Called put_file (In: T:NONE:F)
2009-11-21 09:25:20,060 - ubuntuone.SyncDaemon.sync - INFO - T:LOCAL:F af96c8fc-4453-445b-8482-5bd2d4ba899d [root:af96c8fc-4453-445b-8482-5bd2d4ba899d] ''Ubuntu One/Projects/CB-Robotics/cdb/DR340-5.cmp'' | Called put_file (In: T:NONE:F)
2009-11-21 09:25:20,084 - ubuntuone.SyncDaemon.sync - INFO - T:LOCAL:F 977c4eef-5a64-41d2-8d6e-076728b8d757 [root:977c4eef-5a64-41d2-8d6e-076728b8d757] ''Ubuntu One/Projects/CB-Robotics/cdb/MOCD207MR1.cmp'' | Called put_file (In: T:NONE:F)
2009-11-21 09:25:20,108 - ubuntuone.SyncDaemon.sync - INFO - T:LOCAL:F 5c582ae3-fb66-4a80-9e55-4304c7502724 [root:5c582ae3-fb66-4a80-9e55-4304c7502724] ''Ubuntu One/Projects/CB-Robotics/cdb/CR1206-J -000E.cmp'' | Called put_file (In: T:NONE:F)
2009-11-21 09:25:20,132 - ubuntuone.SyncDaemon.sync - INFO - T:LOCAL:F 7ed44a3b-77be-4fef-9d56-4143db1af81c [root:7ed44a3b-77be-4fef-9d56-4143db1af81c] ''Ubuntu One/Projects/CB-Robotics/cdb/CRCW08051001FR.cmp'' | Called put_file (In: T:NONE:F)
2009-11-21 09:25:20,156 -...

[ginalfa (ginalfa)]

In addittion:
it seems that attempting to manually resynch always causes a synch-daemon lock. The daemon does not responds and its CPU load goes to 40/60% .

[Joshua Hoover (joshuahoover)]

Hi Everyone,

Instead of adding more to this existing bug that may or may not be related to the problem your experiencing, please file a new bug and include all the relevant information you have. If you want to provide the best possible logs, please do the following:

1. Open (or create if it doesn't exist): ~/.config/ubuntuone/syncdaemon.conf
2. Add the following 2 lines to this file and save:

[__main__]
log_level = DEBUG

3. Restart the Ubuntu One client
4. Let the client try to sync (maybe even add a file to force it to sync)
5. Attach ~/.cache/ubuntuone/log/syncdaemon.log to the bug report

Note that attaching syncdaemon.log will show filenames you are attempting to sync with Ubuntu One. If you do not want this to be public, please mark the bug as private and this bug report will only be available to you and the Ubuntu One team.

Thank you,

Joshua

[Juan Melendez (juanmelendez)]

Ok... Will do.

[Levente Torok (toroklev)]

It applies me too.
I cannot make my daemon synchronize.
This probably due to error found in the log. (attached).
Lev

[Alvaro Aleman (alvaroaleman)]

I've this problem, too. Ubuntu One did only synchronize one file here from 1.352 (less than 14 MB). This synchronized file is in the main folder.

Some subfolders have a check on them, even if the files inside aren't checked and synchronized. Only all the folders themselves, without content, are synchronized.

All in all, the service is simply unusable.

[Alvaro Aleman (alvaroaleman)]

i forgot to mention: I am using Lucid.

[Levente Torok (toroklev)]

I use Karmik, but I have exactly the same experience.
I am wondering that ubuntu guys provide service (ever for money) and they
dont realize that this is a problem.
I made a little test with the log files and I found that the FSM (file state
monitor) subsystem doesn't recognize that there are changes under the the
main directory.

On Tue, Mar 23, 2010 at 8:27 PM, Alvaro Aleman <email address hidden> wrote:

> i forgot to mention: I am using Lucid.
>
> --
> Ubuntu One doesn't synchronize all files
> https://bugs.launchpad.net/bugs/456629
> You received this bug notification because you are a direct subscriber
> of the bug.
>
> Status in “ubuntuone-client” package in Ubuntu: Confirmed
>
> Bug description:
> Binary package hint: ubuntuone-client
>
> Hi,
> My problem is that If i put a single file into Ubuntu One folder it
> usually works great (but sometimes it is not reacting), but if I put there
> folder that contains other files and other folders, it doesn't synchronize
> all of them. For example I put there folder that contains 5 other folders
> and 2 files, and it only put online 1 folder and one file.
> If it may help, todays I had also two .u1confilict files created.
>
> ProblemType: Bug
> .home.pumex..cache.ubuntuone.log.syncdaemon.exceptions.log:
>
> .home.pumex..config.ubuntuone.ubuntuone.client.conf:
> [ubuntuone]
> connected = True
> connect = 0
> show_applet = 0
> bookmarked = True
> Architecture: i386
> Date: Tue Oct 20 21:58:28 2009
> DistroRelease: Ubuntu 9.10
> Package: ubuntuone-client 1.0.2-0ubuntu1
> PackageArchitecture: all
> ProcEnviron:
> LANG=pl_PL.UTF-8
> SHELL=/bin/bash
> ProcVersionSignature: Ubuntu 2.6.31-14.48-generic
> SourcePackage: ubuntuone-client
> Uname: Linux 2.6.31-14-generic i686
> XsessionErrors:
> (gnome-settings-daemon:1702): GLib-CRITICAL **: g_propagate_error:
> assertion `src != NULL' failed
> (gnome-settings-daemon:1702): GLib-CRITICAL **: g_propagate_error:
> assertion `src != NULL' failed
> (polkit-gnome-authentication-agent-1:1766): GLib-CRITICAL **:
> g_once_init_leave: assertion `initialization_value != 0' failed
> (nautilus:1760): Eel-CRITICAL **: eel_preferences_get_boolean: assertion
> `preferences_is_initialized ()' failed
> (nautilus:2205): Eel-CRITICAL **: eel_preferences_get_boolean: assertion
> `preferences_is_initialized ()' failed
>
> To unsubscribe from this bug, go to:
>
> https://bugs.launchpad.net/ubuntu/+source/ubuntuone-client/+bug/456629/+subscribe
>

[Alvaro Aleman (alvaroaleman)]

I think someone should fix this really fast. Lucid is already Beta and this is one of the core features. I also added some duplicated, I think all in all there must be really many people with this problem..

[Florian Stoll (flostoll)]

In Bug #565147 i could sync only folders:

u1sdtool -s
State: QUEUE_MANAGER
    connection: With User With Network
    description: processing queues
    is_connected: True
    is_error: False
    is_online: True
    queues: WORKING_ON_BOTH

$ u1sdtool --current-transfers
Current uploads: 0
Current downloads: 0

Ubuntu Lucid
Linux mobileibm 2.6.32-21-generic #32-Ubuntu SMP Fri Apr 16 08:09:38 UTC 2010 x86_64 GNU/Linux

-------------------------------------------

Suddenly it is synchronizing the files!
Perhaps due to update of client or fix of serverbug...

u1sdtool -s
State: QUEUE_MANAGER
    connection: With User With Network
    description: processing queues
    is_connected: True
    is_error: False
    is_online: True
    queues: WORKING_ON_CONTENT

[Facundo Batista (facundo)]

Hi all!

In all the cases mentioned here the ubuntone-client appears to be working ok, or with a problem that we already identified and fixed for Lucid.

Regarding the last comment, you should let the client go to idle (state: QUEUE_MANAGER, queues: IDLE).

Note that WORKING_ON_<something> means that it's actually working on something, so there may be the reason that you still don't see your files.

If after leaving the client to go idle, you still see any issue, we would need DEBUG logs to find the problem and fix it.

You should do the following:

1. stop the syncdaemon client and be sure it's fully stopped ("ps -eaf | grep ubuntuone-client" should give you nothing).

2. put a file named syncdaemon.conf in your $HOME/.config/ubuntuone directory with the following information:

[__main__]
log_level = DEBUG

3. restart the client.

4. attach here the logs, just zip you $HOME/.cache/ubuntuone/log/ folder and attach the zip here.

Thanks for your time and help!

[papukaija (papukaija)]

Why is this bug marked as incomplete?

[Jeff Stone (stone1343)]

Hi, not sure if you intended to send this just to me, or someone else, but
either way, I don't know the status of this bug. Jeff

On Wed, Apr 21, 2010 at 8:54 AM, papukaija
<<email address hidden><jamisnaka%<email address hidden>>
> wrote:

> Why is this bug marked as incomplete?
>
> --
> Ubuntu One doesn't synchronize all files
> https://bugs.launchpad.net/bugs/456629
> You received this bug notification because you are a direct subscriber
> of a duplicate bug.
>
> Status in “ubuntuone-client” package in Ubuntu: Incomplete
>
> Bug description:
> Binary package hint: ubuntuone-client
>
> Hi,
> My problem is that If i put a single file into Ubuntu One folder it
> usually works great (but sometimes it is not reacting), but if I put there
> folder that contains other files and other folders, it doesn't synchronize
> all of them. For example I put there folder that contains 5 other folders
> and 2 files, and it only put online 1 folder and one file.
> If it may help, todays I had also two .u1confilict files created.
>
> ProblemType: Bug
> .home.pumex..cache.ubuntuone.log.syncdaemon.exceptions.log:
>
> .home.pumex..config.ubuntuone.ubuntuone.client.conf:
> [ubuntuone]
> connected = True
> connect = 0
> show_applet = 0
> bookmarked = True
> Architecture: i386
> Date: Tue Oct 20 21:58:28 2009
> DistroRelease: Ubuntu 9.10
> Package: ubuntuone-client 1.0.2-0ubuntu1
> PackageArchitecture: all
> ProcEnviron:
> LANG=pl_PL.UTF-8
> SHELL=/bin/bash
> ProcVersionSignature: Ubuntu 2.6.31-14.48-generic
> SourcePackage: ubuntuone-client
> Uname: Linux 2.6.31-14-generic i686
> XsessionErrors:
> (gnome-settings-daemon:1702): GLib-CRITICAL **: g_propagate_error:
> assertion `src != NULL' failed
> (gnome-settings-daemon:1702): GLib-CRITICAL **: g_propagate_error:
> assertion `src != NULL' failed
> (polkit-gnome-authentication-agent-1:1766): GLib-CRITICAL **:
> g_once_init_leave: assertion `initialization_value != 0' failed
> (nautilus:1760): Eel-CRITICAL **: eel_preferences_get_boolean: assertion
> `preferences_is_initialized ()' failed
> (nautilus:2205): Eel-CRITICAL **: eel_preferences_get_boolean: assertion
> `preferences_is_initialized ()' failed
>
> To unsubscribe from this bug, go to:
>
> https://bugs.launchpad.net/ubuntu/+source/ubuntuone-client/+bug/456629/+subscribe
>

--
In 2008, the world created 31 billion tonnes of CO2 and the level of CO2 in
the atmosphere rose by 2 ppm, or 16 billion tonnes. Much of the remaining 14
billion tonnes went into making the oceans more acidic. We are changing our
environment too quickly and we are now 12% over the safe threshold of 350
ppm.

[Facundo Batista (facundo)]

Hi, papukaija, NeoRazorX, this bug is marked "incomplete" as for the request in comment #23.

Please read it, and if it applies to your current situation, please follow those instructions.

Thank you!

Regards,

[Florian Stoll (flostoll)]

At the moment it is synchronizing files. But after every sync it looks like they were not uploaded completely. A few minutes later it starts again...
I'm surprised because every time the situation seems to be a little bit different.

[papukaija (papukaija)]

This bug seems to be fixed in Lucid.

[axel (axel-as-online)]

I have the same problem since about lucid rc, now I installed the final lucid desktop i386 from scratch. the problem persists. the first synch happend to take about two hours, with 'let's say lucid alpha2' ... now the first synch took more then eight hours and it was only half the way trough (I then had to shutdown the box).

I have about 350 files on ubuntu one, which is 1.8 GB, I'm using a 1.6 MBit dsl line.

after restarting/relogin to the the system it takes several hours to rescan the metadata.
the syncdaemon.log shows that each metadata needs exactly 2 minutes (120 sec), for about 180 missing files that makes six hours to go, before synchronisation commences.

ruder

syncdaemon.log attached

[papukaija (papukaija)]

@axel: Please follow the instructions at comment 23 as you can confirm this bug.

[maroshka (melnyksergii)]

hi
I have a problem with Ubuntu One synchronization too.
log's zip in attachment.

[papukaija (papukaija)]

The requested information has been provided (by marosha).

[Facundo Batista (facundo)]

maroshka, papukaija, thanks!

You effectively had a problem: in some situations the server will give INTERNAL ERROR, and in those cases the file that was being handled stopped being synched until you fully stopped the client and started it again (you can see in your last syncdaemon.log that everything was correct there and the client reached IDLE quite fast).

So, I'm marking this as duplicate of other bug where we handled this case.