u1 syncdaemon fills up /tmp

[Martin Pool]

on current oneiric, u1-syncdaemon creates many gigabytes of binary files in /tmp.

Magicicadad shows it is in "doing local scan".

I have logs turned on but there's a huge amount of output; let me know which ones you want.

ProblemType: Bug
DistroRelease: Ubuntu 11.10
Package: ubuntuone-client 1.7.1-0ubuntu1
ProcVersionSignature: Ubuntu 3.0.0-8.10-generic 3.0.1
Uname: Linux 3.0.0-8-generic x86_64
Architecture: amd64
Date: Wed Aug 10 10:42:19 2011
EcryptfsInUse: Yes
PackageArchitecture: all
ProcEnviron:
 PATH=(custom, user)
 LANG=en_AU.UTF-8
 SHELL=/bin/zsh
SourcePackage: ubuntuone-client
UbuntuOneSyncdaemonExceptionsLog: 2011-08-10 10:42:13,188 - ubuntuone.SyncDaemon.Main - ERROR - Local rescan finished with error: Traceback (failure with no frames): <type 'exceptions.KeyError'>: '1312936576344576'
UbuntuOneUserSyncdaemonConfig:
 [bandwidth_throttling]
 read_limit = 2097152
 write_limit = 2097152
 on = False
UpgradeStatus: Upgraded to oneiric on 2011-08-04 (6 days ago)

[Martin Pool (mbp)]

magicicada shows it stopping and restarting somewhere after 'checking capabilities'.

The problem in syncdaemon.log seems to be this:

2011-08-10 11:25:39,846 - ubuntuone.SyncDaemon.ConnectionManager - DEBUG - Setting up the 'handshake' timer on 50 secs
2011-08-10 11:25:39,846 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: SYS_STATE_CHANGED, kwargs: {'state': SET_CAPABILITIES (error=False connected=True online=False) Queue: WORKING Connection: With User With Network}
2011-08-10 11:25:39,846 - ubuntuone.SyncDaemon.InteractionInterfaces - DEBUG - emitting state changed: SET_CAPABILITIES (error=False connected=True online=False) Queue: WORKING Connection: With User With Network
2011-08-10 11:25:39,847 - ubuntuone.SyncDaemon.InteractionInterfaces - DEBUG - called current_status
2011-08-10 11:25:40,190 - ubuntuone.SyncDaemon.ActionQueue - INFO - The request 'caps_raising_if_not_accepted' finished OK.
2011-08-10 11:25:40,538 - ubuntuone.SyncDaemon.ActionQueue - INFO - The request 'caps_raising_if_not_accepted' finished OK.
2011-08-10 11:25:40,538 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: SYS_SET_CAPABILITIES_OK, kwargs: {}
2011-08-10 11:25:40,538 - ubuntuone.SyncDaemon.StateManager - DEBUG - received event 'SYS_SET_CAPABILITIES_OK'
2011-08-10 11:25:40,539 - ubuntuone.SyncDaemon.StateManager - DEBUG - Transition SET_CAPABILITIES --[SYS_SET_CAPABILITIES_OK]--> AUTHENTICATE (queues: WORKING; connection: With User With Network)
2011-08-10 11:25:40,539 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: SYS_UNKNOWN_ERROR, kwargs: {}
2011-08-10 11:25:40,539 - ubuntuone.SyncDaemon.ActionQueue - INFO - The request 'oauth_authenticate' failed with the error: oauth_authenticate() takes exactly 3 arguments (4 given) and was handled with the event: SYS_UNKNOWN_ERROR
2011-08-10 11:25:40,540 - ubuntuone.SyncDaemon.ConnectionManager - DEBUG - Setting up the 'handshake' timer on 50 secs
2011-08-10 11:25:40,540 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: SYS_STATE_CHANGED, kwargs: {'state': AUTHENTICATE (error=False connected=True online=False) Queue: WORKING Connection: With User With Network}
2011-08-10 11:25:40,540 - ubuntuone.SyncDaemon.StateManager - DEBUG - received event 'SYS_UNKNOWN_ERROR'
2011-08-10 11:25:40,540 - ubuntuone.SyncDaemon.StateManager - DEBUG - Transition AUTHENTICATE --[SYS_UNKNOWN_ERROR]--> UNKNOWN_ERROR (queues: WORKING; connection: With User With Network)
2011-08-10 11:25:40,541 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: SYS_USER_DISCONNECT, kwargs: {}
2011-08-10 11:25:40,541 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: SYS_QUIT, kwargs: {}
2011-08-10 11:25:40,542 - ubuntuone.SyncDaemon.ConnectionManager - DEBUG - shutdown
2011-08-10 11:25:40,542 - ubuntuone.SyncDaemon.HQ - INFO - HashQueue: _hasher stopped
2011-08-10 11:25:40,543 - ubuntuone.SyncDaemon.DBus - INFO - Shuttingdown DBusInterface!
2011-08-10 11:25:41,633 - ubuntuone.SyncDaemon.tritcask - INFO - shutting down...
2011-08-10 11:25:41,701 - ubuntuone.SyncDaemon.EQ - DEBUG - push_event: SYS_STATE_CHANGED, kwargs: {'state': UNKNOWN_ERROR (error=True connected=False online=False) Queue: WORKING Connection: With User With Network}
2011-08-10 11:25:41,703 - u...

[dobey (dobey)]

Hi Martin, do you have a syncdaemon-exceptions.log as well in your ubuntuone log dir?

[dobey (dobey)]

Actually, nevermind. It seems there are two separate issues here. Another user has reported the issue in your second comment, as bug #824143. I'm using that bug for that issue. The original issue with /tmp may be a duplicate of another bug about invalid UTF-8 filenames, but I am not sure why it would make files in /tmp for those.

[Martin Pool (mbp)]

I do have those log files, but they're all empty (and very recent).
They might be like this because it was restarting in a loop and
rotating the log file every time.

I've had to remove the package because just stopping it from
magicicada didn't stop it looping. But I can put it back if you want
me to test something.

mbp@grace% ls -l syncdaemon-exceptions.log*
-rw-rw-r-- 1 mbp mbp 0 2011-08-10 14:48 syncdaemon-exceptions.log
-rw-rw-r-- 1 mbp mbp 0 2011-08-10 14:48
syncdaemon-exceptions.log.2011-08-10_14-48-31
-rw-rw-r-- 1 mbp mbp 0 2011-08-10 14:48
syncdaemon-exceptions.log.2011-08-10_14-48-35
-rw-rw-r-- 1 mbp mbp 0 2011-08-10 14:48
syncdaemon-exceptions.log.2011-08-10_14-48-39
-rw-rw-r-- 1 mbp mbp 0 2011-08-10 14:48
syncdaemon-exceptions.log.2011-08-10_14-48-43
-rw-rw-r-- 1 mbp mbp 0 2011-08-10 14:48
syncdaemon-exceptions.log.2011-08-10_14-48-48

[Martin Brook (martin.brook)]

I am seeing a similar behaviour on Natty, not sure if it's related.

I enabled syncing yesterday for a folder containing about 1.5 GB of files, and left it running overnight. Returned this morning to find my filesystem had been filled up (only 30 MB space remaining) with about 12 GB of files in /tmp (and most of my files had not been synced).

From reading related bugs I have figured out that this probably began because I had a file with an unreadable filename, which I have now renamed and hopefully this will solve the problem for me.

However the creation of massive amounts of temporary files is clearly not right...

If I can help by posting any of my log files, let me know.