very high CPU usage, 'ubuntuone-syncd'

Bug #396770 reported by Sleeping_menace

This bug report was converted into a question: question #155415: very high CPU usage, 'ubuntuone-syncd'.

86
This bug affects 18 people
Affects Status Importance Assigned to Milestone
Ubuntu One Client
Invalid
Undecided
Unassigned

Bug Description

whilst transferring a single directory, with 200 or so files, my CPU usage was 93%?? This seems VERY high. Even if there were a real time compression going on, I'd not expect that kind of consumption.
With single files, even medium sized ones, the CPU usage is light, but with a directory, it seems to go straight into the 90%'s and stay there for 2 mins or so.

Log is far too large (>20MB) to paste in here, is there an email way to submit it?

Tags: foundations+
Revision history for this message
Rick McBride (rmcbride) wrote :

Thanks for your bug report. Depending on what the client is doing it may indeed use quite a bit of CPU. We probably don't need ALL of the log, but some would help to determine what is happening. You could try gzipping the log to attach, perhaps?

alternately, 'apport-collect -p ubuntuone-client 396770' would attach multiple logs, gzipped as well as other diagnostic data (package version, etc) that would be helpful.

Changed in ubuntuone-client:
status: New → Incomplete
Revision history for this message
Peter Anselmo (peter-anselmo) wrote :

I'm running Karmic with all the latest updates, and experiencing a similar thing. The ubuntuone-syncdaemon pegs my CPU at 100% for only a single 10MB file transfer. It doesn't let up after 2 minutes, It'll be there until I stop it. What's more, the Network History show almost zero bandwith; as if ubuntu one isn't doing anything.

Revision history for this message
Ken Pratt (kenpratt) wrote :

Same thing for me. I bet much of the CPU is being used to create the log file. I have placed an encrypted file system into the Ubuntu One file structure. (Using ecryptfs). Tailing the log (tail -f) file whilst the sync daemon is running shows that the log file is growing at an alarming rate. This is due to the daemon running in debug mode and the fact that ecryptfs uses very long filenames. How can I turn off the debug level output? This would let me see if it is indeed the log file generation that is taking up so much CPU. My log file is now at 115 M and growing...

Revision history for this message
Ken Pratt (kenpratt) wrote :

Oops, I wrote 115 M above. That is the current rotation. The previous file is 9.9 Gigabytes... No wonder my filesystem is hitting 100%.

Revision history for this message
Joshua Hoover (joshuahoover) wrote :

Hi Ken,

Good catch! We definitely need to default to a less verbose log level. I'm going to attach this bug to another one that we have to limit the size on logs. I think you're right, the level of logging (and amount of logging) we're doing is causing some users such as yourself serious CPU issues. That's not to say all CPU related issues with Ubuntu One are logging related, but this is a good one to eliminate.

Thank you,

Joshua

tags: added: foundations+
Revision history for this message
Dimitrios Ntoulas (ntoulasd) wrote :

Same here, ubuntu 9.10 very high cpu load in ubuntuone-syncd.
When I close the cloud icon from the applets the cpu load returns to normal.

Revision history for this message
Roman Yepishev (rye) wrote :

Dimitrios,

Could you please run the diagnose client described @ https://wiki.ubuntu.com/RomanYepishev/UbuntuOne/Diagnostics

It may be possible that you have incorrect permissions in your directory that cause such high CPU load.

Revision history for this message
hugo (hugo-zanker) wrote :

I have this problem too in 10.04 LTS 32 bit.
High CPU with the Ubuntu one Syncd operation using 99% of my CPU indefinitely. Only happens occasionally. Quick log out/in fixes it. Raises concerns though for me about reliability and accessibility of all my data in the clous.

Revision history for this message
Paul Coleman (alwaysinthedark) wrote :

My 64 bit 10.04 is working fine with Ubuntu One. My 32 bit machine (dell B130) also running 10.04 is having the same issues described above. To stop it I must click the restart button for the host.

The host was able to make the connection to Ubuntu One only on the first attempt to use the service last week. Recently I noted that the 2.8GB I have there were still not synced on the 32 bit box, nor could I connect to U1. I removed the host and cleared the keys as indicated on the U1 help files and then re-added it. All was well for about an hour and then it all started again. I have removed it from the account again and am out of time for the next couple of days to look at it any further.

Revision history for this message
Hasse Bylov (hassebylov) wrote :

In my case I was running Ubuntu Maverick and tried out Ubuntu One without any problems. Then I upgraded to Kubuntu Natty, for trying out the more slick KDE 4 interface and to compare it with the more limiting Gnome and Unity interfaces.

After each restart ubuntuone-syncd uses all resources that are left on my machine. Sometimes, when running development IDE together with multiple browser tabs for example, it even goes to 200% of my two processing cores and makes the system totally freeze - not even switching to a terminal (CTRL+ALT+F1-12) works.

It also happens that the ubuntuone-syncd process restarts after being shut down.

Any ideas on how to solve this problem without removing UbuntuOne?

Changed in ubuntuone-client:
status: Incomplete → Invalid
Revision history for this message
isatis39871 (isatis39871) wrote :

This bug is NOT a duplicate of bug #435137. This bug is about high CPU consumption while bug #435137 is about disk space consumption.

I can confirm this bug is still affecting Ubuntu Natty and Oneiric RC1.

The asked some Gb of files to be sync and the ubuntuone daemon took immidiatly 100% of the CPU, making the computer so slow it was unusable. I had to kill the daemon (and it's very hard to kill) then remove it from the applications that launch at start up to be able to use my laptop again.

Not only it makes one of the commercial features of Ubuntu unuseable, but it can have a strong impact on the beginers perspective, that will have no way to know why suddenly his computer is becoming unusable. And no way to solve the problem but to drop Ubuntu. Remember than a clic on the box 'sync this folder' can trigger this.

It seems a high priority bug to me, and is probably complicated to solve given that:

- I reported this problem to the team one year ago and we exhanged dozen of mails with my logs but the problem remains while I changed my machine and my distro.
- My current computer is a brand new samsung 9 series with a core i5 and a SSD drive. It's still hanging under the daemon load!
- Dropbox with the same files is almost unoticeable while syncing.

Revision history for this message
Hung Tran (hungtran) wrote :

I think this bug is not the same with bug #435137, and it still exists in 12.04. My Ubuntu One use 100% CPU and I have to disconnect, not start it when computer powers on. Now I only sync when I'm away from the computer.

Revision history for this message
Leo Arias (elopio) wrote :

Hi Hung Tran,

Could you please add your logs to a separate report so we can diagnose it better?

Please, do the following:
1. Open Applications->Accessories->Terminal and run: echo -e "[logging]\nlevel = DEBUG" > ~/.config/ubuntuone/logging.conf; u1sdtool -q; u1sdtool -c
2. Report a bug running on the same terminal: ubuntu-bug ubuntuone-client
3. Connect to Ubuntu One and copy files into your ~/Ubuntu One folder, or do whatever you do to reproduce your problem.
4. On the bug report, explain what you did and attach ~/.cache/ubuntuone/log/syncdaemon.log and ~/.cache/ubuntuone/log/syncdaemon-exception.log.

thanks,
pura vida.

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Related questions

Remote bug watches

Bug watches keep track of this bug in other bug trackers.