Update Scan Data Over Internet fails

[Iestyn Guest]

Workaround from Tj; 3 commands (ignore word-wrapping by launchpad):

cd ~/.local/share/kaffeine
mv scanfile.dvb{,.$(awk 'C==1{print;exit}/^\[date\]/{C=1}' scanfile.dvb)}
wget https://linuxtv.org/downloads/dtv-scan-tables/kaffeine/scantable.dvb -O scanfile.dvb

----

Running Kaffeine 2.0.18 on Ubuntu 20.04 LTS Plasma Desktop. Update Scan Data Over Internet fails with message: Scan data update failed

I believe Kaffeine is looking for a file called scanfile.dvb or perhaps scanfile.dvb.qz

https://linuxtv.org/downloads/dtv-scan-tables/kaffeine/ shows a file called scantable.dvb (Different file name)

The wiki here (https://linuxtv.org/wiki/index.php/Dtv-scan-tables) says that this file will be autocreated and eventually be located here: https://autoconfig.kde.org/kaffeine/ The file i see at this location is currently called: scantable.dvb.qz

Perhaps this is just a file naming issue?

Thanks,

Iestyn Guest

[Launchpad Janitor (janitor)]

Status changed to 'Confirmed' because the bug affects multiple users.

[Oskar Alois Runggaldier (oskar-runggaldier)]

Created attachment 138009
Fehler

SUMMARY

STEPS TO REPRODUCE
1. Fernsehen einrichten
2. Suchlaufdaten über Internet aktualisieren
3. Aktualisierung fehlgeschlagen

OBSERVED RESULT

EXPECTED RESULT

SOFTWARE/OS VERSIONS
Windows:
macOS:
Linux/KDE Plasma:
(available in About System)
KDE Plasma Version:
KDE Frameworks Version:
Qt Version:

ADDITIONAL INFORMATION
Ubuntu 21.04 >>>>>>>> pls email : <email address hidden>

[Mchehab+huawei (mchehab+huawei)]

Git commit 209a263ab2191f0b1d13f48a0a2fa67794357ad0 by Mauro Carvalho Chehab.
Committed on 30/04/2021 at 06:39.
Pushed by mauroc into branch 'master'.

dvbconfigdialog: increase max download size for scandata

By the time Kaffeine was written, a 64KB max limit were
enough, but nowadays, the scandata file has already 104KB.

Increase the limit up to 1MB, in order to fix download
issues with valid files.

While here, also improve the download messages to show
how much data was downloaded and to report the reason
why a download was aborted.

Signed-off-by: Mauro Carvalho Chehab <email address hidden>

M +21 -7 src/dvb/dvbconfigdialog.cpp
M +1 -0 src/dvb/dvbconfigdialog.h

https://invent.kde.org/multimedia/kaffeine/commit/209a263ab2191f0b1d13f48a0a2fa67794357ad0

[Mchehab+huawei (mchehab+huawei)]

(In reply to Oskar Alois from comment #0)

English please.

> STEPS TO REPRODUCE
> 1. Fernsehen einrichten
> 2. Suchlaufdaten über Internet aktualisieren
> 3. Aktualisierung fehlgeschlagen

STEPS TO REPRODUCE
1. Set up television
2. Update search data via the Internet
3. Update failed

[Mchehab+huawei (mchehab+huawei)]

In order to prevent too big files, Kaffeine has an upper limit. The current limit is too low for the size of the current scanfile (104KB).

Commit 209a263ab2191f0b1d13f48a0a2fa67794357ad0 increased the limit to 1MB.

[TJ (tj)]

Confirming this is still an issue on 20.04 with

$ apt-cache policy kaffeine
kaffeine:
  Installed: 2.0.18-1build1
  Candidate: 2.0.18-1build1
  Version table:
 *** 2.0.18-1build1 500
        500 http://gb.archive.ubuntu.com/ubuntu focal/universe amd64 Packages

The file is a sequence of zlib-encoded bytes created using QT's QFile.qCompress()

https://doc.qt.io/qt-5/qbytearray.html#qCompress

QByteArray qCompress(const QByteArray &data, int compressionLevel = -1)

where compressionLevel = 9 (best).

Analyzing the received file shows:

$ binwalk /tmp/scantable.dvb.gz

DECIMAL HEXADECIMAL DESCRIPTION
--------------------------------------------------------------------------------
4 0x4 Zlib compressed data, best compression

The file being requested is:

https://autoconfig.kde.org/kaffeine/scantable.dvb.qz

src/dvb/dvbconfigdialog.cpp:636: job = KIO::get(QUrl("https://autoconfig.kde.org/kaffeine/scantable.dvb.qz"), KIO::NoReload,

Enabling KIO debugging reveals the file is downloaded:

kf5.kio.kio_http: ============ Sending Header:
kf5.kio.kio_http: "GET /kaffeine/scantable.dvb.qz HTTP/1.1"
kf5.kio.kio_http: "Host: autoconfig.kde.org"
kf5.kio.kio_http: "Connection: keep-alive"
kf5.kio.kio_http: "User-Agent: Mozilla/5.0 (X11; Linux x86_64) KHTML/5.68.0 (like Gecko) Konqueror/5 KIO/5.68"
kf5.kio.kio_http: "Accept: text/html, text/*;q=0.9, image/jpeg;q=0.9, image/png;q=0.9, image/*;q=0.9, */*;q=0.8"
kf5.kio.kio_http: "Accept-Encoding: gzip, deflate, x-gzip, x-deflate"
kf5.kio.kio_http: "Accept-Charset: utf-8,*;q=0.5"
kf5.kio.kio_http: "Accept-Language: en-GB,en;q=0.9"
kf5.kio.kio_http: sent it!
kf5.kio.kio_http:
kf5.kio.kio_http: ============ Received Status Response:
kf5.kio.kio_http: "HTTP/1.1 200 OK"
kf5.kio.kio_http: QUrl("https://autoconfig.kde.org/kaffeine/scantable.dvb.qz") response code: 200 previous response code: 0
kf5.kio.kio_http: wasAuthError= false isAuthError= false sameAuthError= false
kf5.kio.kio_http: -- full response:
 "HTTP/1.1 200 OK\r\nDate: Sun, 15 Aug 2021 07:07:46 GMT\r\nServer: Apache/2.4...

[TJ (tj)]

Attached patch cherry-picked from upstream and confirmed working

[TJ (tj)]

I've built a package with this fix applied in my PPA at:

https://launchpad.net/~tj/+archive/ubuntu/bugfixes/+packages

[Ubuntu Foundations Team Bug Bot (crichton)]

The attachment "Update for focal 20.04" seems to be a debdiff. The ubuntu-sponsors team has been subscribed to the bug report so that they can review and hopefully sponsor the debdiff. If the attachment isn't a patch, please remove the "patch" flag from the attachment, remove the "patch" tag, and if you are member of the ~ubuntu-sponsors, unsubscribe the team.

[This is an automated message performed by a Launchpad user owned by ~brian-murray, for any issue please contact him.]

[Brian Murray (brian-murray)]

I've uploaded this for Impish.

[Launchpad Janitor (janitor)]

This bug was fixed in the package kaffeine - 2.0.18-1ubuntu1

---------------
kaffeine (2.0.18-1ubuntu1) impish; urgency=medium

  * dvb: allow dvb scantables larger than 64KiB (LP: #1879923)

 -- Tj <email address hidden> Sun, 15 Aug 2021 09:27:27 +0100