"Sending of message failed" dialog needs 100% of one CPU as long as it is open.

[PeterPall]

Priority: Low
How to reproduce:
 - Attach a large file to a message to make the sending process need enough time for the third step.
 - press the "send" button
 - Interrupt the internet connection before the sending of the message can be completed
Problem:
 The Dialog that pops up now telling the message could not be sent creates 100% CPU load for one CPU.
What was to be expected:
 The dialog pops up and does not need any CPU power until a button is clicked.

ProblemType: Bug
DistroRelease: Ubuntu 12.10
Package: thunderbird 14.0~b1+build2-0ubuntu1
ProcVersionSignature: Ubuntu 3.4.0-5.11-generic 3.4.0
Uname: Linux 3.4.0-5-generic x86_64
ApportVersion: 2.2.2-0ubuntu2
Architecture: amd64
Date: Wed Jun 13 22:49:39 2012
EcryptfsInUse: Yes
ExecutablePath: /usr/lib/thunderbird/thunderbird-bin
LocalLibraries: /<email address hidden>/lib/tray_x86_64-gcc3.so
SourcePackage: thunderbird
UpgradeStatus: No upgrade log present (probably fresh install)

[Marek-nos (marek-nos)]

User Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:11.0) Gecko/20100101 Firefox/11.0
Build ID: 20120312181643

Steps to reproduce:

1) Set SMTP server to one that timeout, particularly my network doesn't allow pings or more specific limitation. The SMTP definitely works outside this network.
2) Try to send an email

Actual results:

3) Message that connection to SMTP timeouted
4) CPU usage is raised to 50% (one core) until the message is clicked

Expected results:

3) Message that connection to SMTP timeouted
4) CPU usage is standard

[hashemmasoud (wraithlike)]

(In reply to Marek Nos from comment #0)
Found 2 similar bugs: bug 311663 & bug 189738.

[Ludovic-mozilla (ludovic-mozilla)]

Marek can you follow the instructions at https://developer.mozilla.org/en/How_to_get_a_stacktrace_with_WinDbg and get us a stack trace of your issue ?

[Marek-nos (marek-nos)]

Created attachment 613600
stacktrace

Running this tool for the first time. Excuse any incompleteness. This is what I got.

[Acelists (acelists)]

Is that SMTP server public so that you could tell us the host name? We do NOT need any username/password. We can try to connect to it and wait for the timeout.

[Marek-nos (marek-nos)]

smtp.centrum.cz:25

[Marek-nos (marek-nos)]

note: CPU usage is raised right after Thunderbird starts connecting to SMTP server, not after timeout message is shown.

[Dbienvenu (dbienvenu)]

nothing useful in that stack trace, unfortunately.

[Acelists (acelists)]

I got the raised CPU usage just after pressing Send, but I assume that is the spinning progressbar about "Connected to server XXX". It was just about 25% of a 3Ghz core.

I could not get the timeout from the server. I connected to it but did not provide any password. I let TB hang in the dialog requesting the password. After several minutes I gave a wrong password. The dialog closed and the send failed. But I didn't get any high CPU usage.

What should I try next?

[Marek-nos (marek-nos)]

Created attachment 614146
Steps to reproduce

To be correct it took 50% on my machine. Now I checked per core and it took more or less equally around 50% from each core. So maybe its natural load. But the load is there since I clicked send [1], then timeout message appeared. Load was still there until I clicked either cancel sending [2] or OK on timeout message [3] which in turn cancels sending. But when cancel sending [2] is clicked then timeout message is still there, but load drops. So it's definitely not caused by timeout message, but the connecting part, and it takes load (quite high) even timeout message is there. See attached image for more explanation on steps.

From user perspective, this SMTP is supposed to be available and should require log in. Don't know why it timeouts for me or if the error is somewhere else. Try at different networks with same result. It might be related to this high load.

Secure connection is none, authentication is set to password.

C:\Users\Marek Nos>telnet smtp.centrum.cz 25
Connecting To smtp.centrum.cz...Could not open connection to the host, on port 25: Connect failed

It does work for you?

[Acelists (acelists)]

Yes, I can connect to the server via telnet. Also TB log file shows it talked to the server.

Maybe that is the problem, that you do not even connect to the server and get the timeout. I used a nonexistent server now. I got timeout immediately and the progressbar still spinning.
Also notice there is another small progress bar in the bottom right corner of the compose window. So all those animations could be quite heavy, maybe they are redrawing too frequently. I can confirm this part of the bug.

Just for reference, what is your CPU?

[Marek-nos (marek-nos)]

Intel Core2 duo U9400, 1.4 ghz

[PeterPall (peterpall)]

User Agent: Mozilla/5.0 (X11; Ubuntu; Linux x86_64; rv:14.0) Gecko/20100101 Firefox/14.0
Build ID: 20120613200924

Steps to reproduce:

 - Attach a large file to a message to make the sending process need enough time for the third step.
 - press the "send" button
 - Interrupt the internet connection before the sending of the message can be completed

Actual results:

The Dialog that pops up now telling the message could not be sent creates 100% CPU load for one CPU.
The same thing seems to happen on mac computers with thunderbird version 16, too, even if I currently have none available to double-check.

Expected results:

The dialog pops up and does not need any CPU power until a button is pressed.

Detailled infos about my system can be found at:
http://bugs.launchpad.net/ubuntu/+source/thunderbird/+bug/1012858

[Acelists (acelists)]

*** Bug 764701 has been marked as a duplicate of this bug. ***

[Micah Gersten (micahg)]

Thanks for upstreaming this, marking it triaged.

[Acelists (acelists)]

I'll see if there aren't too many updates of the progress bar in http://mxr.mozilla.org/comm-central/source/mailnews/compose/content/sendProgress.js.

[Vseerror (vseerror)]

(In reply to :aceman from comment #13)
> I'll see if there aren't too many updates of the progress bar in
> http://mxr.mozilla.org/comm-central/source/mailnews/compose/content/
> sendProgress.js.

here are some others https://bugzilla.mozilla.org/buglist.cgi?type1-0-0=substring;keywords=perf%2C%20;keywords_type=allwords;list_id=5083373;field0-0-0=short_desc;bug_severity=blocker;bug_severity=critical;bug_severity=major;bug_severity=normal;bug_severity=minor;short_desc_type=anywordssubstr;type0-0-0=anywordssubstr;short_desc=progress%20status;type0-0-1=substring;field0-0-1=keywords;type1-0-1=allwordssubstr;resolution=---;classification=Client%20Software;classification=Components;query_format=advanced;field1-0-0=short_desc;product=MailNews%20Core;product=Thunderbird;field1-0-1=short_desc

[Vseerror (vseerror)]

(In reply to :aceman from comment #13)
> I'll see if there aren't too many updates of the progress bar in
> http://mxr.mozilla.org/comm-central/source/mailnews/compose/content/
> sendProgress.js.

aceman, what were you able to determine?

Perhaps this is similar to what I'm seeing as high CPU with progress meter during stalled imap syncing, and most of the cpu is in Paint http://people.mozilla.com/~bgirard/cleopatra/?1354620938776#report=6210e70a7a1f640f9bcbb57e9af8c95997b58917

[Acelists (acelists)]

My findings are in bug 791535.

[Rsx11m-pub (rsx11m-pub)]

*** Bug 875298 has been marked as a duplicate of this bug. ***

[Rsx11m-pub (rsx11m-pub)]

FWIW, I see the CPU spike on Linux but can't reproduce on Windows 7...

[dvo (mueller8)]

This bug still exists. Until the connection timeouts, I get 12-13% CPU load in my i5 macbook.

[Ludovic-mozilla (ludovic-mozilla)]

Removing myslef on all the bugs I'm cced on. Please NI me if you need something on MailNews Core bugs from me.

[Vseerror (vseerror)]

David, thanks for reporting your results. Can you retest please and tell us if this reproduces with a curent beta?

If it reproduces, please run the performance profiler:
1. You must be using Thunderbird 68 or newer - betas from https://www.thunderbird.net/en-US/channel/ or current nightly build from https://archive.mozilla.org/pub/thunderbird/nightly/latest-comm-central/
2. Install profiler add-on into thunderbird 68 (or newer https://www.thunderbird.net/en-US/channel/ ) - get the add-on file from https://github.com/firefox-devtools/Gecko-Profiler-Addon/blob/master/gecko_profiler.xpi?raw=true and in Tools > add-ons click the gear to install add-on from file
3. Follow instructions at https://profiler.firefox.com/ (videos BASED ON FIREFOX at https://profiler.firefox.com/docs/#/./videos-intro )
4. Create a profiler URL and post it here.

[PeterPall (peterpall)]

- Updated my thunderbird to the newest Version (Thunderbird 68/Ubuntu)
- Set my "saved messages" folder to an imap one
- turned my Internet connection off
- Pressed Ctrl+S
- The progressbar went forth and back using 100% of one CPU
- Re-enabled my internet. The progressbar still goes haywire using 100% of one CPU as the message dialogue telling the message could not be saved is still active.
- Started the profiler
The profiler result should be downloadable here: https://perfht.ml/30UuI1F

[Acelists (acelists)]

Do I read the profile correctly that most of the time (80%) is used in the poll() function in libc.so.6 (Linux system C standard library)? That would seem to confirm the theory really the drawing/synchronizing on the screen of the progress bar.
There is also a similar bug specifically for Linux at bug 854093.

Is the disabling of network needed to reproduce the bug or is it only to get the progressbar visible for a extended amount of time to capture the profile?

[Nl0 (nl0)]

(In reply to Wayne Mery (:wsmwk) from comment #21)
> David, thanks for reporting your results. Can you retest please and tell us if this reproduces with a curent beta?

Wayne, as I wrote several times over several years at several places in this bug tracker:
The problem is easily reproducible, also on Linux, with any TB version (meanwhile including 78.4.2.).
Why is there apparently not a single TB developer trying this himself?

Again: just enter an IP address such as 1.2.3.4 as the server name/address.
Then try fetching emails. Until this timeouts,
the progress bar moves forth and back with significant CPU load (10% of one core on my current Linux machine).

[Bernie Innocenti (codewiz)]

I have experienced this bug for several years on multiple Linux machines.

It just happened to me today on Thunderbird 89.0b1 (beta): sending a message over SMTP hung for several minutes while the progressbar keeps on scanning left and right, eating ~60% CPU on a fast machine.

[Bernie Innocenti (codewiz)]

Created attachment 9218295
Screenshot of Thunderbird being hung while connecting to SMTP server

[Vseerror (vseerror)]

CPU usage goes away if you do View > toolbar > status bar to remove the status bar?

[rns (remotenonsense)]

Created attachment 9262260
Bug 742697 - Emit stop sending event before prompt failure message to dismiss progress bar. r=mkmelin

[rns (remotenonsense)]

The patch stops progress bar on SMTP connection timeout or other errors. For the progress bar during copying operation (usually through IMAP), I don't know how to fix it. Maybe there are other bugs tracking it.

[Pulsebot (pulsebot)]

Pushed by <email address hidden>:
https://hg.mozilla.org/comm-central/rev/e0962bae9283
Emit stop sending event before prompt failure message to dismiss progress bar. r=mkmelin

[K-it-m (k-it-m)]

Somewhat nice that after nearly 10 years something has been done about this.

Yet I strongly suspect that this "cures" just one of the symptoms of a deeper issue,
namely some busy waiting whenever a network connection is a attempted but the network or the addressed server is (temporarily) unavailable.

See also bug 1107251, bug 683651, bug 562977, and likely several more.