uncomplete list of videos

Bug #1573934 reported by promeneur
10
This bug affects 2 people
Affects Status Importance Assigned to Milestone
Qarte
Fix Released
Critical
VinsS

Bug Description

opensuse 13.1 x86_64
python 2.7.6

since 1 or 2 months (?)

- there are less videos in the list of videos. the list is shorter than usual.

other pb:
- one day i display the list of videos then i search the list of videos of a particular d day
-next day i display the list of the videos then i search the list of videos of the d day. surprise ! there are new videos in this list!

it seems that qarte does not found the complete list of videos.

Revision history for this message
VinsS (vincent-vandevyvre) wrote :

I don't see thath with openSuse 42

Run qarte into a terminal with the option debug

$ qarte -d

Maybe some pages are loss.

Note: since some days arte publish the morning the film or series wich are scheduled at the evening. See the date and hour of the videos.

Revision history for this message
promeneur (epistemepromeneur) wrote :
Download full text (13.5 KiB)

 qarte -d
13:05:56: INFO - qarte Main thread: <_MainThread(MainThread, started 140158761846528)>
13:05:56: INFO - ui_main setup main window
13:05:56: INFO - ui_main set page arte+
13:05:56: INFO - ui_main set basket arte+
13:05:56: INFO - ui_main set dwnld button arte+
13:05:56: INFO - ui_main set page arteLive
13:05:56: INFO - ui_main set categories buttons
13:05:56: INFO - ui_main set basket arteLive
13:05:56: INFO - ui_main set dwnld buttons
13:05:56: INFO - ui_main set page arteLive extra
13:05:56: INFO - ui_main set extra categories buttons
13:05:56: INFO - ui_main set basket arteLive extra
13:05:56: INFO - ui_main set extra dwnld buttons
13:05:56: INFO - ui_main set menu bar
13:05:56: INFO - ui_main set status bar
13:05:56: INFO - ui_main set actions
13:05:56: INFO - ui_main make connections
13:05:56: INFO - ui_main set theme
13:05:56: INFO - ui_main main window complete
13:05:56: INFO - utils Updating
13:05:56: INFO - utils File /home/roubach/.Qarte/livedata.py saved
13:05:56: INFO - utils The file has been updated at: sam. 03 oct. 2015 09:56:52 CEST

13:05:56: INFO - artePlus arte+7 folder: /home/roubach/Vidéos/tele/Arte
13:05:56: INFO - parsers Fetch page: http://www.arte.tv/guide/fr/plus7/
13:05:56: INFO - parsers Get page: http://liveweb.arte.tv/fr
13:05:56: INFO - parsers get page http://liveweb.arte.tv/fr
13:05:57: INFO - parsers Extract json code
13:05:57: INFO - parsers Fetch page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-1
13:05:57: INFO - parsers Extract json code
13:05:57: INFO - parsers Fetch page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-2
13:05:57: INFO - parsers Get arteLiveWeb video's data in 'Jazz & Blues'
13:05:57: INFO - parsers Threads enum: [<_MainThread(MainThread, started 140158761846528)>, <Thread(Thread-1, started 140158209349376)>, <Thread(Thread-2, started 140158200956672)>]
13:05:57: INFO - parsers get page http://download.liveweb.arte.tv/o21/liveweb/rss/home-34-fr.rss
13:05:58: INFO - parsers Loading category Jazz & Blues failed
13:05:58: INFO - parsers Reason: HTTP Error 404: Not Found
13:05:58: INFO - parsers get page http://download.liveweb.arte.tv/o21/liveweb/rss/partner-229-fr.rss
13:05:58: INFO - parsers Extract json code
13:05:58: INFO - parsers Fetch page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-3
13:05:58: INFO - parsers urllib2 error: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-3, HTTP Error 404: Not Found
13:05:58: INFO - parsers Read Error: HTTP Error 404: Not Found
13:05:58: INFO - parsers Fetch page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-4
13:05:58: INFO - parsers Loading category Jazz & Blues failed
13:05:5...

Revision history for this message
VinsS (vincent-vandevyvre) wrote :

With these seven pages http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-1 to j-7 I have now 98 videos, not you ?

Revision history for this message
VinsS (vincent-vandevyvre) wrote :

There's one page not loaded:

13:05:58: INFO - parsers urllib2 error: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-3, HTTP Error 404: Not Found

The problem is on the server of arte, not in the application.

Revision history for this message
promeneur (epistemepromeneur) wrote :
Download full text (12.8 KiB)

there is 2 404 error thus 2 pages are no mloaded. no?

i just retried i get four 404 errors but not about arte+7 but the other (rock etc.)

qarte -d
14:28:22: INFO - qarte Main thread: <_MainThread(MainThread, started 140147332445952)>
14:28:22: INFO - ui_main setup main window
14:28:22: INFO - ui_main set page arte+
14:28:22: INFO - ui_main set basket arte+
14:28:22: INFO - ui_main set dwnld button arte+
14:28:22: INFO - ui_main set page arteLive
14:28:22: INFO - ui_main set categories buttons
14:28:22: INFO - ui_main set basket arteLive
14:28:22: INFO - ui_main set dwnld buttons
14:28:22: INFO - ui_main set page arteLive extra
14:28:22: INFO - ui_main set extra categories buttons
14:28:22: INFO - ui_main set basket arteLive extra
14:28:22: INFO - ui_main set extra dwnld buttons
14:28:22: INFO - ui_main set menu bar
14:28:22: INFO - ui_main set status bar
14:28:22: INFO - ui_main set actions
14:28:22: INFO - ui_main make connections
14:28:22: INFO - ui_main set theme
14:28:22: INFO - ui_main main window complete
14:28:22: INFO - utils Updating
14:28:22: INFO - utils File /home/roubach/.Qarte/livedata.py saved
14:28:22: INFO - utils The file has been updated at: sam. 03 oct. 2015 09:56:52 CEST

14:28:22: INFO - artePlus arte+7 folder: /home/roubach/Vidéos/tele/Arte
14:28:22: INFO - parsers Fetch page: http://www.arte.tv/guide/fr/plus7/
14:28:22: INFO - parsers Get page: http://liveweb.arte.tv/fr
14:28:22: INFO - parsers get page http://liveweb.arte.tv/fr
14:28:22: INFO - parsers Extract json code
14:28:22: INFO - parsers Fetch page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-1
14:28:23: INFO - parsers Extract json code
14:28:23: INFO - parsers Fetch page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-2
14:28:23: INFO - parsers Get arteLiveWeb video's data in 'Jazz & Blues'
14:28:23: INFO - parsers Threads enum: [<_MainThread(MainThread, started 140147332445952)>, <Thread(Thread-1, started 140146779948800)>, <Thread(Thread-2, started 140146771556096)>]
14:28:23: INFO - parsers get page http://download.liveweb.arte.tv/o21/liveweb/rss/home-34-fr.rss
14:28:23: INFO - parsers Extract json code
14:28:23: INFO - parsers Fetch page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-3
14:28:23: INFO - parsers Loading category Jazz & Blues failed
14:28:23: INFO - parsers Reason: HTTP Error 404: Not Found
14:28:23: INFO - parsers get page http://download.liveweb.arte.tv/o21/liveweb/rss/partner-229-fr.rss
14:28:23: INFO - parsers Loading category Jazz & Blues failed
14:28:23: INFO - parsers Reason: HTTP Error 404: Not Found
14:28:23: INFO - parsers get page http://concert.arte.tv/fr/videos/jazz
14:28:23: INFO - parsers Extract json code
14:28:23: INFO - parsers Fetch page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-4
14:28:24: INFO - parsers Extract json code
14:28:24: INFO - parsers Fetch page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-5
14:28:24: INFO - parsers find_item_at_concert
14:28:24: INFO - parsers get page http://concert.arte.tv/fr/glen-david-andrews-nancy-jazz-pulsations
14:28:24: INFO - parsers Get arteLiveWeb video's data in 'Théâtre & Danse'
14:28:24: INFO - parsers Thr...

Revision history for this message
didier (dpa4aviation) wrote :
Download full text (22.5 KiB)

Python 2.7.7 sur Ubuntu 14.04

Linux manureva 4.4.0-38-generic #57~14.04.1-Ubuntu SMP Tue Sep 6 17:20:43 UTC 2016 x86_64 x86_64 x86_64 GNU/Linux

Je ne vois pas les videos "les années Barack Obama" ;
or si on va chercher : http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-1

on les trouve ;

voici une trace
qarte -d
19:44:16: INFO - core Set workspace
19:44:16: INFO - core Load config from: /home/dpavet/.Qarte/user_config
19:44:16: INFO - core Build main window
19:44:16: INFO - artetv Read indexes
19:44:16: INFO - artetv Read video's data
19:44:16: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?sort=recent
19:44:16: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-1
19:44:16: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-2
19:44:16: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-3
19:44:16: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-4
19:44:17: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-5
19:44:17: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-6
19:44:17: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-7
19:44:17: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-8
19:44:17: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-9
19:44:18: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-10
19:44:18: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-11
19:44:18: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-12
19:44:18: INFO - artetv Load page: http://www.arte.tv/guide/fr/plus7/toutes-les-videos?date=j-13
19:44:18: INFO - artetv Sorting videos, last index: 063946-024-A
19:44:18: INFO - artetv Load page: http://www.arte.tv/guide/fr/064317-019-A/catherine-deneuve-lit-la-mode
19:44:19: INFO - artetv Load page: http://www.arte.tv/guide/fr/052692-009-A/d-amsterdam-a-odessa-9-10
19:44:19: INFO - artetv Load page: http://www.arte.tv/guide/fr/063944-012-A/xenius
19:44:19: INFO - artetv Load page: http://www.arte.tv/guide/fr/048158-000-A/le-scribe-qui-dessine
19:44:19: INFO - artetv Load page: http://www.arte.tv/guide/fr/064092-200-A/arte-journal
19:44:19: INFO - artetv Load page: http://www.arte.tv/guide/fr/048295-009-A/360-geo
19:44:20: INFO - artetv Load page: http://www.arte.tv/guide/fr/047421-000-A/360-geo
19:44:20: INFO - artetv Load page: http://www.arte.tv/guide/fr/064097-199-A/arte-journal-junior
19:44:20: INFO - artetv Load page: http://www.arte.tv/guide/fr/060723-000-A/ida
19:44:21: INFO - artetv Load page: http://www.arte.tv/guide/fr/064094-199-A/arte-journal
19:44:21: INFO - artetv Load page: http://www.arte.tv/guide/fr/064317-008-A/catherine-deneuve-lit-la-mode
19:44:21: INFO - artetv Load page: http://www.arte.tv/guide/fr/052692-008-A/d-amsterdam-a-odessa-8-10
19:44:21: INFO - artetv Load page: http://www.arte.tv/guide/fr/063944-015-A/xenius
19:44:25: INFO - artetv...

Revision history for this message
VinsS (vincent-vandevyvre) wrote :

Confirmed and fixed.

Thanks

Changed in qarte:
status: New → Fix Committed
assignee: nobody → VinsS (vincent-vandevyvre)
importance: Undecided → Critical
Revision history for this message
VinsS (vincent-vandevyvre) wrote :

Fixed in version 3.4

Changed in qarte:
status: Fix Committed → Fix Released
Revision history for this message
didier (dpa4aviation) wrote :

super! pb corrigé . merci . belle réactivité. cdlt

To post a comment you must log in.
This report contains Public information  
Everyone can see this information.

Other bug subscribers

Remote bug watches

Bug watches keep track of this bug in other bug trackers.