0.5.4 very high cpu usage

[Dale]

I not sure how to put this one but now when I run Me TV it is running at very high CPU usage and is unresponsive when you click on button or the EPG etc to change channels, and the CPU load just keeps going up till all I can do is open pure terminal and kill it ('killall me-tv'). I suspect it has something to do with GtkHTML 3.14.

[Dale (quail-linux)]

I have attached gdb backtrace if it is any help

[staedtler-przyborski (staedtler-przyborski-deactivatedaccount)]

I can second this, with 0.54 CPU shows a rythmical peak of ~45% every few sec. on one of my CPU's, 0.52 never exceeded 10%

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

Every 5 seconds Me TV processes received EPG events. Does that sound like it, 5 seconds?

[Dale (quail-linux)]

yep that sounds about right to me, but for me it getting close to 100%
CPU usage on my 1.6GHz machine

On Jan 16, 2008 9:45 AM, Michael Lamothe <email address hidden> wrote:
> Every 5 seconds Me TV processes received EPG events. Does that sound
> like it, 5 seconds?
>
> ** Changed in: me-tv
> Importance: Undecided => Critical
> Assignee: (unassigned) => Michael Lamothe (michael-lamothe)
> Status: New => In Progress
> Target: None => station-5
>
>
> --
> 0.5.4 very high cpu usage
> https://bugs.launchpad.net/bugs/183309
> You received this bug notification because you are a direct subscriber
> of the bug.
>

--
[WWW] http://southernvaleslug.org/
[IRC] #southern-vales.lug on irc.freenode.net
"The significant problems we face cannot be solved at the same level of
 thinking we were at when we created them"
 Albert Einstein

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

I can't replicate this. I have a AMD 64 bit Dual Core 1.6 GHz processor in my laptop and when I tested Me TV it never went over 15% (Using System Monitor). Can you please try a few different channels on different transponders and see if you get the same results?

[Dale (quail-linux)]

this problem still persists in 0.5.5 and it happens on all channels,
atm Me TV is unusable cause I have to wait ~10 sec for what ever I
click on to happen :-(

On Jan 16, 2008 4:30 PM, Michael Lamothe <email address hidden> wrote:
> I can't replicate this. I have a AMD 64 bit Dual Core 1.6 GHz processor
> in my laptop and when I tested Me TV it never went over 15% (Using
> System Monitor). Can you please try a few different channels on
> different transponders and see if you get the same results?
>
>
> --
> 0.5.4 very high cpu usage
> https://bugs.launchpad.net/bugs/183309
> You received this bug notification because you are a direct subscriber
> of the bug.
>

--
[WWW] http://southernvaleslug.org/
[IRC] #southern-vales.lug on irc.freenode.net
"The significant problems we face cannot be solved at the same level of
 thinking we were at when we created them"
 Albert Einstein

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

Thanks Dale, can you try another test for me. Can you please cutback the channels.conf to 2 lines. I know that you have a rather large list. I want to see if that helps.

Do you also get the rhythmic spiking or is the CPU flatlined?

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

Also, do you think that it might be the deinterlacer, or has this problem started only recently also.

[Dale (quail-linux)]

this problem has only started recently

On Jan 17, 2008 4:56 PM, Michael Lamothe <email address hidden> wrote:
> Also, do you think that it might be the deinterlacer, or has this
> problem started only recently also.
>
>
> --
> 0.5.4 very high cpu usage
> https://bugs.launchpad.net/bugs/183309
> You received this bug notification because you are a direct subscriber
> of the bug.
>

--
[WWW] http://southernvaleslug.org/
[IRC] #southern-vales.lug on irc.freenode.net
"The significant problems we face cannot be solved at the same level of
 thinking we were at when we created them"
 Albert Einstein

[Dale (quail-linux)]

Ok I have cut my channels.conf file back to 2 channels and it still
the same and spends most it time at 90+% CPU load, but it does drop
down to ~20% CPU load for a short time that Me TV usually / used to
run at.

On Jan 17, 2008 4:54 PM, Michael Lamothe <email address hidden> wrote:
> Thanks Dale, can you try another test for me. Can you please cutback
> the channels.conf to 2 lines. I know that you have a rather large list.
> I want to see if that helps.
>
> Do you also get the rhythmic spiking or is the CPU flatlined?
>
>
> --
> 0.5.4 very high cpu usage
> https://bugs.launchpad.net/bugs/183309
> You received this bug notification because you are a direct subscriber
> of the bug.
>

--
[WWW] http://southernvaleslug.org/
[IRC] #southern-vales.lug on irc.freenode.net
"The significant problems we face cannot be solved at the same level of
 thinking we were at when we created them"
 Albert Einstein

[Dale (quail-linux)]

And I have only noticed this problem when you implemented GtkHTML 3.14
to handle the EPG.

On Jan 17, 2008 4:56 PM, Michael Lamothe <email address hidden> wrote:
> Also, do you think that it might be the deinterlacer, or has this
> problem started only recently also.
>
>
> --
> 0.5.4 very high cpu usage
> https://bugs.launchpad.net/bugs/183309
> You received this bug notification because you are a direct subscriber
> of the bug.
>

--
[WWW] http://southernvaleslug.org/
[IRC] #southern-vales.lug on irc.freenode.net
"The significant problems we face cannot be solved at the same level of
 thinking we were at when we created them"
 Albert Einstein

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

Dale,

If you want to confirm that it's GtkHTML 3.14 then:

1. Go into configure.ac change "libgtkhtml-3.14" to "libgtkhtml-3.8".
2. ./autogen.sh
3. make
4. src/me-tv

that'll help me out heaps because I do not get high CPU load here.

Thanks,

Michael

[Dale (quail-linux)]

I have done what you said and my CPU is still running full and I have
to wait ~10 sec for it to respond to mouse clicks etc. But that when
I first run Me TV to update the EPG and then it settles down, every ~5
sec so it runs at full CPU load. So now I am thinking it have to do
with you code for auto detect of PIDs, let me know how to further
test.

On Jan 17, 2008 9:46 PM, Michael Lamothe <email address hidden> wrote:
> Dale,
>
> If you want to confirm that it's GtkHTML 3.14 then:
>
> 1. Go into configure.ac change "libgtkhtml-3.14" to "libgtkhtml-3.8".
> 2. ./autogen.sh
> 3. make
> 4. src/me-tv
>
> that'll help me out heaps because I do not get high CPU load here.
>
> Thanks,
>
> Michael
>
>
> --
> 0.5.4 very high cpu usage
> https://bugs.launchpad.net/bugs/183309
> You received this bug notification because you are a direct subscriber
> of the bug.
>

--
[WWW] http://southernvaleslug.org/
[IRC] #southern-vales.lug on irc.freenode.net
"The significant problems we face cannot be solved at the same level of
 thinking we were at when we created them"
 Albert Einstein

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

I would think that you'd see different results different channels if it was the auto pid detect.

Might be time to crack open oprofile ... see http://oprofile.sourceforge.net/docs/. If you've got the time.

Do you know exactly what transition it was 0.5.3->0.5.4?

[staedtler-przyborski (staedtler-przyborski-deactivatedaccount)]

Testing 0.56 I discovered that CPU load depends on used channel. On some channels I get the rythmical peak (~ every 5 sec.). On some other channels (never watched them before, due to absolutely uninteresting TV) I 'don't', means the rythm is ways longer. There the EPG shows only information of the selected channel, all the other channels of the 'bundle' (I know term is not correct, but don't have the correct in mind) have a blank EPG, quite contrary to the channels with peak.

What else informations are needed to catch the issue ?

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

Hi, I've sent some ideas for code modifications to Dale because he is able to build from source. If you know how to use bazaar and how to build packages from source then I can send these instructions on to you. We need to determine the "busy" part of the code.

[staedtler-przyborski (staedtler-przyborski-deactivatedaccount)]

After applying latest patches from today to my DIP7070P based Hauppauge WIN TV-NOVA CE drivers the CPU load drastically decreased. From before ~45% during the peaks, I get now < 25%.

Unfortunately (for most users, not for me) these patches will go into kernel 2.6.25 or later...

So it seems the High-CPU-load burden rests on the shoulders of the used drivers and MeTV is not to blame.

[Dale (quail-linux)]

I still have high CPU usage and I am running 0.5.8

On Jan 22, 2008 5:15 AM, staedtler-przyborski
<email address hidden> wrote:
> After applying latest patches from today to my DIP7070P based Hauppauge
> WIN TV-NOVA CE drivers the CPU load drastically decreased. From before
> ~45% during the peaks, I get now < 25%.
>
> Unfortunately (for most users, not for me) these patches will go into
> kernel 2.6.25 or later...
>
> So it seems the High-CPU-load burden rests on the shoulders of the used
> drivers and MeTV is not to blame.
>
>
> --
> 0.5.4 very high cpu usage
> https://bugs.launchpad.net/bugs/183309
> You received this bug notification because you are a direct subscriber
> of the bug.
>

--
[WWW] http://southernvaleslug.org/
[IRC] #southern-vales.lug on irc.freenode.net
"The significant problems we face cannot be solved at the same level of
 thinking we were at when we created them"
 Albert Einstein

[Dale (quail-linux)]

oops I forgot to add the only channel I not high CPU usage on is the
ABC channels

On Jan 22, 2008 5:15 AM, staedtler-przyborski
<email address hidden> wrote:
> After applying latest patches from today to my DIP7070P based Hauppauge
> WIN TV-NOVA CE drivers the CPU load drastically decreased. From before
> ~45% during the peaks, I get now < 25%.
>
> Unfortunately (for most users, not for me) these patches will go into
> kernel 2.6.25 or later...
>
> So it seems the High-CPU-load burden rests on the shoulders of the used
> drivers and MeTV is not to blame.
>
>
> --
> 0.5.4 very high cpu usage
> https://bugs.launchpad.net/bugs/183309
> You received this bug notification because you are a direct subscriber
> of the bug.
>

--
[WWW] http://southernvaleslug.org/
[IRC] #southern-vales.lug on irc.freenode.net
"The significant problems we face cannot be solved at the same level of
 thinking we were at when we created them"
 Albert Einstein

[staedtler-przyborski (staedtler-przyborski-deactivatedaccount)]

>I still have high CPU usage and I am running 0.5.8

My reduction of CPU usage was done by replacing the DVB-T drivers, not by upgrading MeTV.

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

Dale, have you tried my suggestions?

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

This appears to be a fault with one of the drivers. Will leave this open for a bit, just in case someone wants to disagree. Happy to discuss.

[staedtler-przyborski (staedtler-przyborski-deactivatedaccount)]

We are now switching to the good news ;-)

After applying latest proprietary nvidia drivers 169.09 CPU usage has reduced again. In the peaks I get now < than 15% (on one cpu of my core2duo), Overall CPU usage of MeTV has decreased too (oscillating something between 5 and 8 %).

Seems this issue addresses really nothing else than driver-bugs

[Dale (quail-linux)]

I can concur with the upgrade with the Nvidia drivers to 169.09 has
drop the CPU usage when Me TV is running :-)

On Jan 25, 2008 4:59 AM, staedtler-przyborski
<email address hidden> wrote:
> We are now switching to the good news ;-)
>
> After applying latest proprietary nvidia drivers 169.09 CPU usage has
> reduced again. In the peaks I get now < than 15% (on one cpu of my
> core2duo), Overall CPU usage of MeTV has decreased too (oscillating
> something between 5 and 8 %).
>
> Seems this issue addresses really nothing else than driver-bugs
>
>
> --
> 0.5.4 very high cpu usage
> https://bugs.launchpad.net/bugs/183309
> You received this bug notification because you are a direct subscriber
> of the bug.
>

--
[WWW] http://southernvaleslug.org/
[IRC] #southern-vales.lug on irc.freenode.net
"The significant problems we face cannot be solved at the same level of
 thinking we were at when we created them"
 Albert Einstein

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

Ok, thanks guys.

[Dale (quail-linux)]

were back to high CPU usage as of from rev 188 and still exists to current rev 198, and I don't think this can be blamed to driver problem this time

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

Dale, are you able to run those tests for me?

[Dale (quail-linux)]

What tests?

On Jan 30, 2008 5:07 PM, Michael Lamothe <email address hidden> wrote:
> Dale, are you able to run those tests for me?
>
> ** Changed in: me-tv
> Status: Won't Fix => In Progress
>
>
> --
> 0.5.4 very high cpu usage
> https://bugs.launchpad.net/bugs/183309
> You received this bug notification because you are a direct subscriber
> of the bug.
>

--
[WWW] http://southernvaleslug.org/
[IRC] #southern-vales.lug on irc.freenode.net
"The significant problems we face cannot be solved at the same level of
 thinking we were at when we created them"
 Albert Einstein

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

It still runs even when it's high CPU right? We have another issue with Me TV sometimes hanging and taking all CPU and memory.

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

Ok, I think that it's the HTML rendering that's causing the issue. It seems to be very CPU intensive. I've had it with GtkHTML, it's causing me too many troubles with it's versions and I have to have special hacks to get certain text to display. Also, I think that it might be the cause of the random crashes that we get when opening the EPG.

I've started writing a Gtk Widget based EPG (like we had before). It won't be as pretty but it'll be faster and will remove the GtkHTML dependency, which is a good thing.

For now, decreasing the amount of data that you have in the EPG might help (no guarantee). Reduce the channel list to only those you need and limit the number of hours,

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

How is rev 222? I think that it should help a lot.

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

Released in 0.5.13. Hope that works for you.

[staedtler-przyborski (staedtler-przyborski-deactivatedaccount)]

Starting with 0.5.20 the rythmical 5 sec.peak (here approx. 60% CPU-Load) came back. With 0.5.18 and 0.5.19 CPU-Load never exceeded 10% (most times something at 7% at one cpu and 1% at the other on a Intel Core2Duo 6400)

[staedtler-przyborski (staedtler-przyborski-deactivatedaccount)]

High CPU Load started again with 0.5.20

[Roman Polach (rpolach)]

I have also problem with high CPU usage some time.
As I remember some very old versions 0.4.x didn't do that.
I have Avermedia AverTV DVB-T 771 card.

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

Klaus is trying to isolate which revision this started in.

[staedtler-przyborski (staedtler-przyborski-deactivatedaccount)]

The good news is: in official 0.5.22 High CPU-usage and rythmical-peak has vanished again. I get now (addition of both cpu's and depending on channel) the excellent results of 05.18/19. Sometimes even better: only 2% overall CPU-usage (with default de-interlacer), guess this can't be beaten.

Not sure if it's now necessary to crawl the sources back, to find out exactly when High-CPU usage started and where it stopped again.

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

That's excellent news. I'm still concerned that I don't know what the issue is. How will I know if trigger it again? There aren't going to be many more changes to 0.5 so I hope that it'll be ok for a while. If it happens again then please let me know ASAP by reopening this bug.

[staedtler-przyborski (staedtler-przyborski-deactivatedaccount)]

Be assured that I check every release for it's CPU-usage and that I raise my hands whenever it get's too high. I believe too it's better to investigate in issue-fixing when it occurs, although it's unsatiesfying not to know what caused the high-CPU usage.

[Roman Polach (rpolach)]

cpu usage is much better in 0.5.22 also for me.

[Darrin Ritter (darrinritter)]

I have noticed that there is a cyclic surge to over 80% CPU usage with version 0.5.25 and 0.5.24 that I downloaded from the:
http://ppa.launchpad.net/michael-lamothe/ubuntu gutsy main
repository.

I'm currently using Gutsy Gibbon, and also full blown compiz setup, the video still plays in the window and the audio still plays ok, but me-tv greys out (compiz effect) and becomes unresponsive for sometimes up to 2 minutes

I will attempt to build from source and check it out further

Thanks Darrin

[ourasi (ourasi)]

Latest 0.5.25 (and 0.5.26) builds are not usable in my slow machine because of too high processor load.

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

Have you tried disabling the start_epg_thread like we mentioned?

[Darrin Ritter (darrinritter)]

I removed all but 2 channels from the channel.conf file and ended up with a reduced CPU load surging is now down to about 25-50% (normally running about 5% but rythmic surging every minute or so), personally I thought it might be EPG related myself, Im happy to try an compile the app with modification as i have compiles other apps i the past but Im not a programmer so my help is limited

thanks Darrin

[Michael Lamothe (lamothe-deactivatedaccount-deactivatedaccount)]

Hi Darrin, I'm trying to limit the conversation in LP to only what necessary because the threads and up huge. Please answer the email that I sent you yesterday to discuss possible options. Then we'll put the results here.

[Darrin Ritter (darrinritter)]

ok will do
Darrin

On Sun, Mar 30, 2008 at 9:15 AM, Michael Lamothe <email address hidden>
wrote:

> Hi Darrin, I'm trying to limit the conversation in LP to only what
> necessary because the threads and up huge. Please answer the email that
> I sent you yesterday to discuss possible options. Then we'll put the
> results here.
>
> --
> 0.5.4 very high cpu usage
> https://bugs.launchpad.net/bugs/183309
> You received this bug notification because you are a direct subscriber
> of the bug.
>
> Status in Me TV, it's TV for me computer: Fix Released
>
> Bug description:
> I not sure how to put this one but now when I run Me TV it is running at
> very high CPU usage and is unresponsive when you click on button or the EPG
> etc to change channels, and the CPU load just keeps going up till all I can
> do is open pure terminal and kill it ('killall me-tv'). I suspect it has
> something to do with GtkHTML 3.14.
>