Ubuntu: Import EPUB, Metadata Error

[Armin Geller]

Different behavior importing an epub file between Windows and Linux (Ubuntu 14.2) calibre 2.0.

On Windows, there is no error-warning. file and metadata (author and title) are correct in calibe. On Ubuntu there is a warning. Calibre has import without metadata.
Warning message:
db030-473.epub
Traceback (most recent call last):
  File "site-packages/calibre/gui2/add.py", line 200, in add
  File "site-packages/calibre/ebooks/metadata/opf2.py", line 565, in __init__
IOError: [Errno 2] Datei oder Verzeichnis nicht gefunden: u'/tmp/calibre_2.0.0_tmp_qLA3yQ/RPWLdm_rm_worker/0.opf'

The epub is generated by Digitale Bibliothek. I will attach the file below. I see some warnings if I check the book with the editor but I wonder, why the behavior is different.

Best Regards,
Armin

[Kovid Goyal (kovid)]

Works for me on linux. Adding that wpub file gives no error and the
metadata is set correctly.

That error indicates something deleted a temporary file calibre was
using while calibre was running. Try running in debug mode as

calibre-debug -g

we may get more information that way.

 status invalid

[Armin Geller (armingeller)]

Ok. Here is the log:

armin@ubuntu:~$ calibre-debug -g
calibre 2.0 isfrozen: True is64bit: True
Linux-3.13.0-34-generic-x86_64-with-debian-jessie-sid Linux ('64bit', 'ELF')
('Linux', '3.13.0-34-generic', '#60-Ubuntu SMP Wed Aug 13 15:45:27 UTC 2014')
Python 2.7.8
Linux: ('debian', 'jessie/sid', '')
Successfully initialized third party plugins: DeDRM && Goodreads && Generate Cover && Open With && Quality Check && Find Duplicates && Manage Sony x50 Reader Book List && Favourites Menu && Goodreads Sync && KindleUnpack - The Plugin && Modify ePub
Starting up...
Traceback (most recent call last):
  File "site-packages/calibre/gui2/ui.py", line 163, in __init__
  File "site-packages/calibre/gui2/ui.py", line 177, in init_iaction
  File "site-packages/calibre/customize/__init__.py", line 582, in load_actual_plugin
  File "importlib/__init__.py", line 37, in import_module
  File "site-packages/calibre/customize/zipplugin.py", line 179, in load_module
  File "calibre_plugins.ManageSonyX50BookList.action", line 162, in <module>
ImportError: No module named PyQt4.Qt
libpng warning: iCCP: Not recognizing known sRGB profile that has been edited
C:\Users\Armin\Desktop\Calibre-Import is not a valid directory to watch for new ebooks, ignoring
Started up in 2.86 seconds with 3 books

Debugging DND event
x-special/gnome-icon-list 62 'file:///home/armin/Schreibtisch/db030-473.epub\r-21:-27:48:48\r\n'

text/uri-list 48 'file:///home/armin/Schreibtisch/db030-473.epub\r\n'

text/plain 48 'file:///home/armin/Schreibtisch/db030-473.epub\r\n'

COMPOUND_TEXT 48 'file:///home/armin/Schreibtisch/db030-473.epub\r\n'

text/plain;charset=utf-8 48 'file:///home/armin/Schreibtisch/db030-473.epub\r\n'

Firefox rurl: None None
URLS: ['file:///home/armin/Schreibtisch/db030-473.epub']
Paths: [u'/home/armin/Schreibtisch/db030-473.epub']
Extensions: frozenset([u'epub'])
Worker Launch took: 0.401809930801
Job: 1 Read metadata (0 of 1) finished
Read metadata (0 of 1)
 libpng warning: iCCP: Not recognizing known sRGB profile that has been edited

Read metadata (0 of 1)
libpng warning: iCCP: Not recognizing known sRGB profile that has been edited

Added Unbekannt to db in: 0.109871864319 seconds

[Kovid Goyal (kovid)]

Did it fail when you generated that log?

[Armin Geller (armingeller)]

Yes it did (same error message

[Kovid Goyal (kovid)]

Try running

ebook-meta db030-473.epub

does it read the metadata successfully?

[Armin Geller (armingeller)]

Sorry for the late answer. I got a crash error and it took some time to find it.

[Kovid Goyal (kovid)]

That EPUB file has no cover, so calibre is trying to render the first
page as the cover, which involves Qt WebKit and something on your system
is causing Qt WebKit to crash, you will have to try to get a backtrace
using gdb for more information. Unfortunately, in my experince Qt 5 and
gdb just dont work well together, still you can try:

echo 'run\nbt' | gdb --args /usr/bin/python2.7 /usr/bin/ebook-meta db030-473.epub --get-cover x.jpg

[Kovid Goyal (kovid)]

Sorry, make that

echo 'run\nbt' | gdb --args /opt/calibre/ebook-meta db030-473.epub --get-cover x.jpg

[Armin Geller (armingeller)]

I became the output below.

I did an additional test, follow your advice, and add a cover. I did it with the editor and add simply the pic inside the epub as cover and save that file. Then I import the updated epub. This way it works. It seems that with Linux the procedure seems to be different (I have in our German forum a person with the same problem).

armin@ubuntu:~/Schreibtisch$ echo run\nbt | gdb --args /opt/calibre/ebook-meta db030-473.epub --get-cover cover.jpg
GNU gdb (Ubuntu 7.7-0ubuntu3.1) 7.7
Copyright (C) 2014 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /opt/calibre/ebook-meta...(no debugging symbols found)...done.
(gdb) Undefined command: "runnbt". Try "help".
(gdb) quit
armin@ubuntu:~/Schreibtisch$ echo 'run\nbt' | gdb --args /opt/calibre/ebook-meta db030-473.epub --get-cover x.jpg
GNU gdb (Ubuntu 7.7-0ubuntu3.1) 7.7
Copyright (C) 2014 Free Software Foundation, Inc.
License GPLv3+: GNU GPL version 3 or later <http://gnu.org/licenses/gpl.html>
This is free software: you are free to change and redistribute it.
There is NO WARRANTY, to the extent permitted by law. Type "show copying"
and "show warranty" for details.
This GDB was configured as "x86_64-linux-gnu".
Type "show configuration" for configuration details.
For bug reporting instructions, please see:
<http://www.gnu.org/software/gdb/bugs/>.
Find the GDB manual and other documentation resources online at:
<http://www.gnu.org/software/gdb/documentation/>.
For help, type "help".
Type "apropos word" to search for commands related to "word"...
Reading symbols from /opt/calibre/ebook-meta...(no debugging symbols found)...done.
(gdb) Starting program: /opt/calibre/ebook-meta \nbt
process 5652 is executing new program: /opt/calibre/bin/ebook-meta
[Thread debugging using libthread_db enabled]
Using host libthread_db library "/lib/x86_64-linux-gnu/libthread_db.so.1".
Traceback (most recent call last):
  File "site.py", line 51, in main
  File "site-packages/calibre/ebooks/metadata/cli.py", line 168, in main
IOError: [Errno 2] Datei oder Verzeichnis nicht gefunden: u'nbt'
[Inferior 1 (process 5652) exited with code 01]
(gdb) quit
armin@ubuntu:~/Schreibtisch$

[Kovid Goyal (kovid)]

What shell are you using? It looks like gdb is passing nbt as an argument to ebook-convert. Try it like this

gdb --args /opt/calibre/ebook-meta db030-473.epub --get-cover x.jpg

Then at the gdb prompt type

run

and hit enter

then after the process crashes, type

bt

and hit enter to get the backtrace.

[Armin Geller (armingeller)]

My fault. Thanks for explaination. I am using the normal terminal. Here is the new report:

[Kovid Goyal (kovid)]

Ah, now we are getting somewhere. The next step is to improve the
backtrace by using binaries that do not have their symbols removed.

I have uploaded such builds of calibre here:
http://download.calibre-ebook.com/betas/

Install it by downloading the appropriate tarball (32bit or 64bit) and
running:

sudo rm -rf /opt/calibre/* && sudo tar xvf /path/to/downloaded/calibre-tarball.txz -C /opt/calibre

This assumes your calibre is installed in /opt/calibre

Then generate the backtrace as before, this time it should contain more
useful information.

[Armin Geller (armingeller)]

This time I have no error. See attached file. I made an additional check and import the original file into the library. It works fine.
Therefore, it seems to be something with the normal installation as running from source seems to work.

[Kovid Goyal (kovid)]

That's my fault, I was making a possible workaround for this issue that would prevent the crash. But I would like to properly fix it, for that I need the full backtrace. Do this:

DISPLAY= gdb --args /opt/calibre/ebook-meta db030-473.epub --get-cover x.jpg

that should still crash

[Armin Geller (armingeller)]

Yes this test still crash.

[Kovid Goyal (kovid)]

thanks, that tells me what I needed to know, the fix will be in the next
release.

[Armin Geller (armingeller)]

Your welcome. Thanks for all, I learned today a bit too. :)

[Kovid Goyal (kovid)]

Fixed in branch master. The fix will be in the next release. calibre is usually released every Friday.

 status fixreleased

[Armin Geller (armingeller)]

Only a feedback: working perfect with Calibre 2.1
Thanks a lot,
Armin

[Edward Donovan (edward.donovan)]

Yes, thanks! You guys fixed it before I had gotten near to investigating these crashes.