Calibre hangs/freezes several times

[Wim Hekken]

I tried both w32 and w64 version on W10 v1709, fully up to date.

Starting 3.17 and also 3.18 Calibre freezes after startup after every click or scroll for about a minute.
Typing, f.i. to look up a writer, is also hardly possible.
After at least 10 times freezing/hanging (the Calibre-window says "not reacting"(translated from Dutch)) the program is reacting normal and all lookes fine. In short; I have to struggle for about 15 minutes, then all is OK.

I have a rather big library, but that seems to be no problem after the freezes are gone, again, then all works fine.

I went back to version 3.16 and all problems are gone.

Any suggestions besides using 3.16?

[Kovid Goyal (kovid)]

Attach the metadata.db file from your calibre library folder and I will
see if I can reproduce this. Without being able to reproduce, it is hard
to guess what the problem is. I'm guessing it has something to do with
the split library view introduced in 3.17, but since it defaults to
hidden, I dont see how it should affect anything. Offhand, I'd guess it
is some kind of signal cascade between the two views.

[Firefox Fix (firefoxfix)]

ya, while doing this update I can understand we are facing many issues, your steps are work for me but I also have some freezing issue for which I go to https://notresponding.net/system-thread-exception/ that give me instant and easy solution of my problem.

[Wim Hekken (wim-hekken)]

@ Kovid Goyal:
As going back to 3.16 solved the problem I dont think anything is wrong with the library.
And after about 15 minutes of clicking and scrolling and hanging Calibre 3.17/3.18
works fine and keeps working fine......till I close it.
3.17/3.18 is not installed at the moment,is that a problem?
I attach the metadata.db, as you requested.

Hope to hear from you soon, Thanks!!!!

[Wim Hekken (wim-hekken)]

@ Firefox Fix

Thanks, but I dont understand what that page you send me to has to do with Calibre.
It looks extremely complicated, or is it a kind of advertisement?

[Kovid Goyal (kovid)]

Hmm I tried it with that metadata.db on my W10 machine, with no issues. Try running calibre in debug mode (right click the preferences button and run in debug mode) and post the log, of course, to do that you will have to upgrade to 3.18 again.

[Wim Hekken (wim-hekken)]

@ Kovid Goyal:

OK, here we go. I installed 3.18(64) I found a log about the installation in Temp, I wil send it.
If it is not of any value, please ignore.

I started 3.18 and made a screenshot of it freezing/hanging.
The window says (reageert niet), that mean "responds not".

After several tries (hanging) I got Calibre to restart in debug mode.
In debug mode everything takes more time, but I guess that is normal.
I kept fiddeling around with Calbre till it reacted more or less normal, after about 30 minutes.
I searched, added, edited and removed books.

I hope the debug makes clear what is happening.

OhOh, I see that I can add only 1 attachment. I made a zipfile. That should be no problem.

Thanks in advance!!

[Kovid Goyal (kovid)]

calibre appears to be trying to connect to some android phone (or at least some USB device that has the same device ids as an Xperia android phone). Disconnect that and you should be fine.

[Wim Hekken (wim-hekken)]

@ Kovid Goyal:

Sorry, but there is no phone connected.
And for sure no Vperia.

And why are there no problems from Calibre version 0 to 3.16?

If you have no other idea I have to stay with that version. . . . . . . . . . . . . . . . . .

[Kovid Goyal (kovid)]

from the debug log you posted it is very clear that there is some USB
connected device on your system that has the same USB ids as a SONY
Xperia android phone, what that device may be, I have no idea.

[Wim Hekken (wim-hekken)]

@ Kovid Goyal:

OK, I read the notice about a Android Phone in the 3.18 log.

I used USBDview from Nirsoft and removed al unknown/removed usb devices.

I made a debug log using 3.16 64 and the same appeared. BUT the 3.16 worked fine and fast even during the debugging.
IF there is a unknown or wrong discribed device (it could be my Samsung S5 Phone?)that Calibre tries to reach, and as can be read in the 3.16 debug, gives up after a few tries, why would that influence the working of 3.17 and 3.18 and NOT influence ALL previous versions?
Is it because the previous versions give up after a few tries, as you can see in the 3.16 debugging I send you now, and 3.17 and 3.18 dont give up and keep trying?

At this point I'm guessing
a)it has something to do with the fact that 3.17 and 3.18 dont stop trying to connect or
b)the split library view introduced in 3.17, whatever that is or does.

If you have no idea I wil stay with 3.16.

Thanks

[Kovid Goyal (kovid)]

Then the remaining cause of the slowdowns is ome third party plugin you have installed. Run calibre from a command proimpt as

calibre.exe --ignore-plugins and see if your issue goes away. If it does then you will have to disable the plugins you have via Preferences->Plugins one by one till you find the culprit.

[Wim Hekken (wim-hekken)]

@ Kovid Goyal:

Wow, that was quite a job!

If I start 3.18 64 as you discribed all goes fine. I was already happy to have found a reason!

BUT.......

I went to Plugins and disabled, or if that is not possible, deleted ALL the user-added plugins. After a restart Calibre still hangs...........

The problem could be in one of the many plugins that are already installed at install, not installed by me.
To find which that is, is impossible.

BTW, you keep ignoring the fact that this problem started with the introduction of the split library view in 3.17.
Why?

I go back to 3.16, I have no choice........:-(

[Kovid Goyal (kovid)]

--ignore-plugins only ignores third party plugins. So you have not disabled/removed all third party plugins. And yes it only started with 3.17 but it is caused by some third party plugin, I dont support third party plugins. Once you find the problematic plugin, you should notify that plugins author to fix it.

[Wim Hekken (wim-hekken)]

Wow, you quick with conclusions about something that complicated....
First 100% sure a USB problem, now 100% sure somebody else

OK, I will not only disable, but also uninstall all plugins I added and try again.

BTW, the same occurs with Calibre portable.....but it seems to be "not your problem"

We will see.....

Thanks anyway

[Kovid Goyal (kovid)]

Wow, you're hostile to somebody trying to help you. So this is the last
response you are going to get from me, good bye and good luck.

[Wim Hekken (wim-hekken)]

@ who might be interested:

I removed ALL plugins from 3.18.
Calibre still hangs.

I started the completely naked 3.18 with "calibre.exe --ignore-plugins" and Calibre is NOT hanging.
It should make no difference as ALL the Plugins are removed, BUT IT DOES MAKE A DIFFERENCE.

And again, it started with 3.17, 3.16 is working fine.

Comments? Thanks!

@ Kovid Goyal:

I did everything you asked me to do, if the results are not to your liking its not my fault. You are very definitive with your comments. Maybe too definitive?
And "hostile"? Wow, is that not a bit overreacting?
All the best and thank you again.

[Wim Hekken (wim-hekken)]

@ who might be interested:

I installed a fresh version of Calibre Portable 3.18
No plugins added, I did nothing, did not even choose a reader.
opened my (big) library, hangs.
Started with "--ignore-plugins", opened the same (big) library, does NOT hang.

Again, this only happens with 3.17 and 3.18
But it MUST be me or someone else, NOT Calibre.........

Draw your own conclusions..................

[Wim Hekken (wim-hekken)]

@ who might be interested:

A completely naked version of Calibre portable 3.19 also hangs when it has to handle a big library.

I am almost convinced that it has to do with the split library view introduced in 3.17,
But saying that is a crime...........

But 3.16 is working like a charm, I stay with that.

Sticking your head in the sand reminds me of a big bird......that has long toes also.....

[Wim Hekken (wim-hekken)]

Opinion?
Thats a matter of opinion!

As far as I'm concerned this is still in progress, untill all new versions of calibre are working again with big libraries as in version 3.16, before the introduction of the split library view in 3.17.

[Wim Hekken (wim-hekken)]

And today version 3.20 was released.......
I tried the portable version (completely untouched) with my large (27415 books at the moment of writing) library.
All placed on a SSD in a i7 PC.
It hangs after a while for a minute, and again, and again......

Version 3.16 (bloated with plug-ins etc) is working absolutely without problems.

But it must be me, not Calibre..... Blaming Calibre is kicking the Holy Grail.

??the introduction of the split library view in 3.17??

I know you are too .............. to reply, but do you read this??? Maybe better not..........

[Piotr Blum (piotr77)]

I had the same problem. 3.16 worked without any problems. I completely removed the entire program (including the directory, plug in, etc.). After I installed 3.21 with four large libraries (6000, 10000, 8000, 300) which took a long time to accomplish, everything seems to be working fine!!!

[Piotr Blum (piotr77)]

Unfortunately, I was optimistic too soon. If you're opening a large capacity (5M), the program freezes.

[Wim Hekken (wim-hekken)]

Hello Piotr,

I am very sorry to say it, but I am glad that I am not the only one with this problem.

I have about 10 libraries and only the biggest is giving me troubles.
I noticed that, in my case, it is not the size of the library that gives the problem, but the number of books in it.
For instance:
I have a library with mainly PDF. 267 books but a size of over 20GB!
No troubles with this librarie at all.
Another library, 1350 books, mainly epub, about 7GB, also no trouble at all.
But my main librarie, 27500 books, most epub, 29.1GB is practically not workable with versions above 3.16.

The newer versions I test as distributed by Calibre, nothing altered or added; I test mainly with the portable version.
All programs and libraries are on a SSD. Fast enough I would think.

They changed someting with the library handling? starting 3.17, but blaming that is "not done".

As for now I can use 3.16 with no problems at all. And my version of 3.16 is loaded with my own settings and added plug in etc.

I really hope somebody picks up these signals and puts his/her proud aside and looks into it seriously........

[Wim Hekken (wim-hekken)]

Today Calibre 3.25 was published.
That is still NOT working with very large libraries. (Smaller libraries are no problem at all)
Although it is confirmed nobody seems to care.

3.16 is working without the slightest problem.

Since 3.17 the troubles started AND the "split library view" was introduced.
But suggesting that may have any connection..................

[Piotr Blum (piotr77)]

The problem was solved after Active Protection in Acronis True Image 2018 was turned off. All versions of Calibre work fine now.

[Wim Hekken (wim-hekken)]

Hi Peter,

I am home again and found your mail.
Thanks for letting me know your solution.
But I have to look further, I don’t have Acronis....
But maybe I find something, and if not; I can use the last working one or change accounts to work with Calibre.....

-----Oorspronkelijk bericht-----
Van: <email address hidden> [mailto:<email address hidden>] Namens Piotr Blum
Verzonden: maandag 25 juni 2018 2:36
Aan: <email address hidden>
Onderwerp: [Bug 1751734] Re: Calibre hangs/freezes several times

The problem was solved after Active Protection in Acronis True Image
2018 was turned off. All versions of Calibre work fine now.

--
You received this bug notification because you are subscribed to the bug
report.
https://bugs.launchpad.net/bugs/1751734

Title:
  Calibre hangs/freezes several times

Status in calibre:
  Confirmed

Bug description:
  I tried both w32 and w64 version on W10 v1709, fully up to date.

  Starting 3.17 and also 3.18 Calibre freezes after startup after every click or scroll for about a minute.
  Typing, f.i. to look up a writer, is also hardly possible.
  After at least 10 times freezing/hanging (the Calibre-window says "not reacting"(translated from Dutch)) the program is reacting normal and all lookes fine. In short; I have to struggle for about 15 minutes, then all is OK.

  I have a rather big library, but that seems to be no problem after the
  freezes are gone, again, then all works fine.

  I went back to version 3.16 and all problems are gone.

  Any suggestions besides using 3.16?

To manage notifications about this bug go to:
https://bugs.launchpad.net/calibre/+bug/1751734/+subscriptions

[Wim Hekken (wim-hekken)]

To who is interested.
(nobody from Calibre, I guess)

Today I got a upgrade to windows 1803.
I had a little hope that this might solve this still existing problem.
Trouble enough becouse after the upgrade windows crashed over asmtxhci.sys, but after a few tries
I managed to reinstall a older version of this USB3 driver before the crash could occur.
But Calibre could not care less; still hangs…………

I have no idea where to look further, 3.16 is still working like a rocket.

[Wim Hekken (wim-hekken)]

@ Kovid Goyal and everybody else that reads this.

The fact that you hate to hear that is something wrong does not make this invalid.
I had confirmation from exactly the same problem from several people, both here and using mail.
(I wonder why people hesitate to react here, any ideas? I have!)
It is a facy that after 3.16 something changed in Calibre that conflicts with something else on the PC.
Some have found what it was (Acronis True Image), but others dont use that and have not found the program that conflicts WITH THE CHANGE IN CALIBRE (yet).
3.16 is still working fine, later versions hang.

[Eli Schwartz (eschwartz)]

You've stated for a fact that using --ignore-plugins will fix things for
you. Therefore by definition it is a third-party plugin causing the issue.
This discussion will get nowhere until and unless you can identify which
plugins cause it to mess up.

Try to back up and delete your configuration appdata and see if calibre
works with just using your library. Then one-by-one, install the plugins
you used to have, until you can recreate your issue. Then report a bug to
the ugin maintainer of the problematic plugin.

 status invalid

[Wim Hekken (wim-hekken)]

@ Eli Schwartz

You are too quick to jump to a conclusion. (In Dutch we have a proverb, translated:
the wish is the father of the thought. That happens to me also sometimes.)
You did not read all postings: the problem also occurs with every portable version after 3.16.
That version is totally clean of course. I did not change anything.
AND I removerd ALL plugins in the 32 and 64 bits desktop programs, yours and third party, with the same result.
Me stating that using ignore-plugins was too previous, I was hoping that it was a solution.(See above; the wish is the father of the thought)
But it was not, after some more fiddeling around Calibre hung.
And I am not the only one who was happy too quickly, see Pjotr's postings.
I keep trying every new update that is published. I use the CLEAN portable version to test. But every version after 3.16 hang after a while. And all versions of 3.16, with or without plugins, work like a charm till now.

[Wim Hekken (wim-hekken)]

.

[Wim Hekken (wim-hekken)]

I understand why people are not posting their problems here but contact me by male . . . . . .

[Wim Hekken (wim-hekken)]

Sorry, male = mail . . . .

[Lingga (balonesia)]

ya, while doing this update I can understand we are facing many issues, your steps are work for me but I also have some freezing issue for which I go to https://www.balonesia.com/balon-selfie/ that give me instant and easy solution of my problem.

[Lingga (balonesia)]

Hmm I tried it with that metadata.db on my W10 machine, with no issues. Try running calibre in debug mode. Please visit my site: https://kreasihebat.id/balon-sky-dancer/

[Lingga (balonesia)]

Thank you for the information. https://balongate.co.id/