Error in communicating with device / Failed to parse

[John Nellen]

I am new here and was advised by Kovid Goyal to report an error on this forum.

The 'Kobo Utilities plugin works fine for my Kobo Aura.
I do have version 1.6.4 and it loads the books I have from Calibre to my Kobo Aura. 'So far: fine.

However... when I load the book below, the Kobo Utilities plugin post the following message:

calibre, version 1.33.0
FOUT: Fout: Fout bij communicatie met apparaat (Meaning: ERROR: Error in communicating with device)

Failed to parse 'De kolonel krijgt nooit post' by 'Gabriel Garcia Marquez' with error: '' (file: calibre_plugins.kobotouch_extended.container, line: 319)

Traceback (most recent call last):
File "site-packages\calibre\gui2\device.py", line 86, in run
File "site-packages\calibre\gui2\device.py", line 571, in _upload_books
File "calibre_plugins.kobotouch_extended.device.driver" , line 276, in upload_books
File "site-packages\calibre\devices\kobo\driver.py", line 1898, in upload_books
File "calibre_plugins.kobotouch_extended.device.driver" , line 220, in _modify_epub
InvalidEPub: Failed to parse 'De kolonel krijgt nooit post' by 'Gabriel Garcia Marquez' with error: '' (file: calibre_plugins.kobotouch_extended.container, line: 319)

...it seems to be a parsing error?
Can you please help?

[John Nellen (jmn-9)]

If a parsing error means that the books contains error(s) somewhere and can't be converted/loaded and any further solution is impossible; than...is there a way the error message also provides some meaningful information on what (and where) the problem relates to and where the solution (piece of text etc.) can be found?

[Joel Goguen (jgoguen)]

First, the Kobo Utilities plugin isn't giving you an error message at all. It's the KoboTouchExtended plugin, for which fortunately you've reported a bug in the right place.

Second, there's a lot of information you're missing that you were asked for when submitting this bug. Please read http://www.mobileread.com/forums/showthread.php?t=211135 and provide the rest of the information I've asked for, remembering to set the bug to Private unless you're certain the book you provide meets "Life + 70" copyright requirements.

[John Nellen (jmn-9)]

Hi Joel,

many thanks for your swift reply! I went over the missing information. Please find below the details
Let me recap:
- Calibre version: 1.33.0
- Version plugin: Kobo Utilities 1.6.4 (just updated to 1.6.5 with the minor change that was made within. But with the same result)
- Kobo device used: KOBO Aura
- Sofware version KOBO Aura: 3.2.0 (11-02-14) (was missing)

Here is the debug report from Calibre:
----
calibre Debuglog
calibre 1.33 isfrozen: True is64bit: False
Windows-7-6.1.7601-SP1 Windows ('32bit', 'WindowsPE')
32bit process running on 64bit windows
('Windows', '7', '6.1.7601')
Python 2.7.5
Windows: ('7', '6.1.7601', 'SP1', 'Multiprocessor Free')
Starting up...
DEBUG: 0.0 KoboUtilites::action.py - loading translations
DEBUG: 0.0 KoboUtilites::dialogs.py - loading translations
DEBUG: 0.0 KoboUtilites::action.py - loading translations
DEBUG: 1.9 No Kobo Touch, Glo or Mini appears to be connected
DEBUG: 1.9 rebuild_menus - self.supports_ratings=False
Started up in 69.70 seconds with 9749 books
Job: 1 Lees apparaatinformatie started
DeviceJob: 1 Lees apparaatinformatie done, calling callback
DeviceJob: 1 Lees apparaatinformatie callback returned
Job: 2 Lees boekenlijst van apparaat started
DEBUG: 0.0 KoboTouch:books - oncard='None'
DEBUG: 0.0 KoboTouch:books - oncard='None', prefix='E:\'
DEBUG: 0.0 Kobo device: Kobo Aura
DEBUG: 0.0 Version of driver: (2, 2, 14) Has kepubs: True
DEBUG: 0.0 Version of firmware: (3, 2, 0) Has kepubs: True
DEBUG: 0.0 Firmware supports cover image tree: True
DEBUG: 0.0 KoboTouch:books - opts.extra_customization= [u'', False, False, False, False, False, False, False, False, False, False, False, u'', True, False, False, False, False, False, False, u'', False]
DEBUG: 0.0 KoboTouch:books - prefs['manage_device_metadata']= on_connect
DEBUG: 0.0 KoboTouch:books - set_debugging_title to ''
DEBUG: 0.0 KoboTouch:books - length bl=0
DEBUG: 0.0 KoboTouch:books - length bl after sync=3
Job: 1 Lees apparaatinformatie finished
Geen details beschikbaar.
DEBUG: 0.8 KoboTouch:books - reading device database
DEBUG: 0.8 Database Version=96
DEBUG: 0.8 KoboTouch:books - shelf list: []
DEBUG: 0.8 KoboTouch:books - query= SELECT Title, Attribution, DateCreated, ContentID, MimeType, ContentType, ImageID, ReadStatus, ___ExpirationStatus, FavouritesIndex, Accessibility, IsDownloaded, Series, SeriesNumber, ___UserID, ExternalId FROM content where BookID is Null and ((Accessibility = -1 and IsDownloaded in ('true', 1 )) or (Accessibility in (1,2) and IsDownloaded in ('true', 1)) ) and not ((___ExpirationStatus=3 or ___ExpirationStatus is Null) and ContentType = 6) AND (externalId IS NULL OR externalId = '') AND contentId NOT LIKE 'file:///mnt/sd/%'
DEBUG: 0.8 KoboTouch:books - looping on database - row=0
DEBUG: 0.8 KoboTouch:books - title='' authors= Kobo Inc.
DEBUG: 0.8 KoboTouch:books - row= (u'', u'Kobo Inc.', None, u'file:///usr/local/Kobo/help/09UserGuide-Contacting_FNAC.kepub.epub', u'application/x-kobo-epub+zip', u'6', None, 0, 0, -1, 1, 1, None, None, u'', None)
DEBUG: 0.8 KoboTouch:books - automatically managing metadata
DEBUG: 0.8 KoboTou...

[John Nellen (jmn-9)]

Here it is....... :-) The book.

[John Nellen (jmn-9)]

Ah... forgot to mention which version of 'Kobo extended driver' I have.... Sorry.
It is version: 2.2.14

[John Nellen (jmn-9)]

All info is contained within now.

[Joel Goguen (jgoguen)]

The following personal email was sent. Please note that I do not accept personal email for support-related requests, but this requires a response.

Hello Jgoguen,

I hope you are doing fine.

As I am aware, I provided all the information you asked for on bugs.lauchpad.net.
You did not respond yet or changed the status.
Maybe you did not come to it yet, or are on a holiday.

Did I miss out on something or is something still missing?

Best regards,

John Nellen

[Joel Goguen (jgoguen)]

This project is something I do, and provide support for, at no mandatory charge and in my own spare time. I have various responsibilities, many towards my family, that this project must not interfere with considering that I am not being paid. I will review the information on the bug as I have time, and I will fix any problems I find as a result of that bug when I have time.

If you require faster response times, we can negotiate a support contract. Otherwise, please understand that an open source project done for free must take a back seat to real-world obligations and caring for my family.

[Joel Goguen (jgoguen)]

The issue is with internal content files having non-UTF-8 encodings and accented (or otherwise "extended") characters. The recent upload should fix that, look for it in a calibre update sometime in the next couple hours.

[John Nellen (jmn-9)]

It works.
Many thanks !

[Wampie (wampie75)]

calibre, version 2.59.0
FOUT: Fout: Fout bij communicatie met apparaat

Failed to parse 'Nachtblauw' by 'Simone van der Vlugt' with error: '.html' (file: calibre_plugins.kobotouch_extended.container, line: 172)

Traceback (most recent call last):
  File "site-packages\calibre\gui2\device.py", line 87, in run
  File "site-packages\calibre\gui2\device.py", line 584, in _upload_books
  File "calibre_plugins.kobotouch_extended.device.driver", line 294, in upload_books
  File "site-packages\calibre\devices\kobo\driver.py", line 1916, in upload_books
  File "calibre_plugins.kobotouch_extended.device.driver", line 231, in _modify_epub
InvalidEPub: Failed to parse 'Nachtblauw' by 'Simone van der Vlugt' with error: '.html' (file: calibre_plugins.kobotouch_extended.container, line: 172)

How can I solve this problem?
Regards,
Wampie