Syncing experience on slow connections noticeable.

[Jorge Castro]

A friend of mine started using gwibber with the couch backend and he can notice when the machine replicates every 10 minutes due to the syncing of couchdb's with ubuntuone on his slow DSL line.

I don't know if this bug should be "Doesn't obey bandwidth restrictions a user sets in the U1 capplet" or "Couch is syncing too much stuff". Bandwidth graph is attached.

[Elliot Murphy (statik)]

thanks for reporting this!

couchdb sync definitely is not using the same bandwidth restricter as file sync, they are largely independent connections.

any idea what size the couchdb databases are locally? i'd love to get this reproduced so we can figure out whether to go after reducing the size of the DB or throttling the connection first.

[Craig Maloney (craig-decafbad)]

Hi. I'm said friend. :) What's the location of the couchdb databases?

[Craig Maloney (craig-decafbad)]

Got the location from Jorge:

craig@lister:~/.local/share/desktop-couch$ ls -al
total 12392
drwx------ 6 craig craig 4096 2010-02-02 15:31 .
drwxr-xr-x 24 craig craig 4096 2009-12-21 17:42 ..
-rw-r--r-- 1 craig craig 8283 2010-02-11 08:18 contacts.couch
-rw-r--r-- 1 craig craig 1368 2010-02-11 17:19 couchdb.html
-rw-r--r-- 1 craig craig 45147 2010-02-11 08:18 gwibber_accounts.couch
drwxr-xr-x 2 craig craig 4096 2010-02-02 15:30 .gwibber_accounts_design
-rw-r--r-- 1 craig craig 12431460 2010-02-11 16:42 gwibber_messages.couch
drwxr-xr-x 2 craig craig 4096 2010-02-09 17:47 .gwibber_messages_design
-rw-r--r-- 1 craig craig 118875 2010-02-11 16:17 gwibber_preferences.couch
drwxr-xr-x 2 craig craig 4096 2010-02-02 15:30 .gwibber_preferences_design
-rw-r--r-- 1 craig craig 8281 2009-11-02 07:59 management.couch
drwxr-xr-x 2 craig craig 4096 2009-11-02 07:59 .management_design
-rw-r--r-- 1 craig craig 8283 2010-02-11 08:18 notes.couch
-rw-r--r-- 1 craig craig 79 2009-10-22 23:29 users.couch

[Craig Maloney (craig-decafbad)]

Also:

37M .gwibber_messages_design

[Ryan Paul (segphault)]

In Futon, my gwibber_messages database is reported to be 90MB with roughly 12,000 messages. When I compact it, the size drops to about 20MB. Periodically compacting the db would certainly help.

[Launchpad Janitor (janitor)]

This bug was fixed in the package gwibber - 2.29.92-0ubuntu1

---------------
gwibber (2.29.92-0ubuntu1) lucid; urgency=low

  * new upstream release 2.29.92
    - Raise errors for auth failures
    - don't sync the gwibber_messages to ubuntuone (LP: #520687)
    - use dbus names to check for existing service (LP: #534922)
  * debian/gwibber.install
    - Added files needs for raising error dialogs
 -- Ken VanDine <email address hidden> Thu, 11 Mar 2010 12:20:52 -0500

[Eric Casteleijn (thisfred)]

In reply to:

"37M .gwibber_messages_design"

and:

"In Futon, my gwibber_messages database is reported to be 90MB with roughly 12,000 messages. When I compact it, the size drops to about 20MB. Periodically compacting the db would certainly help."

What couchdb-replication sends over the wire, are individual documents, and not the entire db. Compaction has no impact on replication traffic, as it gets rid of old versions of documents, which are never replicated. (What's being sent is any documents with changes since the last successful replication.)

.gwibber_messages_design contains stored view indexes, which are (re)computed on each node when they are called, and so also never sent over the wire.

So, while periodic compaction is a very good idea to save disk space, it will not have an effect on repliction.

[Tom Goh (tomgohj)]

4.2GB and growing on 10.04 and I hardly even use it. It should keep a maximum of 1 week of data.

Version: 2.30.3-0ubuntu1

I don't think this is fixed.

[Tom Goh (tomgohj)]

hrmm, 7GB + with some other couchDB stuff. I don't think I am using any other couchDB apps. Gwibber being the only one I know of.

[Arthur Lutz (arthur-lutz)]

I have a 2G file and a 520M file in ~/.local/share/desktop-couch/.gwibber_messages_design

and am using version : 2.30.3-0ubuntu1 ...