High memory usage

[WalterCool]

Oggconvert is using >1.3Gb ram on my conversion... my target file is ~1.2Gb, im near of 50% of conversion...

You should free some memory sometimes on your main cycle.

Thanks.

[Kerry Hatcher (kerry.hatcher)]

Could you provide some more details?

Input file type
Output settings
Ubuntu Version
64bit or 32bit
OggConvert Version

Thanks,
Kerry

[WalterCool (waltercool)]

Input file=Any
Output file=theora
Ubuntu Version=Current
32bits
OggConvert Version=0.3.2

My memory usage will grow while im encoding (if my result video is 32GB, oggConvert will use 32GB Ram).

When oggconvert ends conversion, that memory still wasted until i close oggconvert.

[Kerry Hatcher (kerry.hatcher)]

Thanks Walter,

I'll see if I can duplicate the issue. Are you trying to down convert Blue-ray? I only ask because I seem to remember somewhere about an issue with blue-ray sourced videos and gstreamer. I guess the big question is could you tell me an approx size of your input file so I can try to replicate? I don't have any blue-rays, but I could try a DVD. Most of the videos I deal with at the TV station are relatively short and small.

[Kerry Hatcher (kerry.hatcher)]

Just converted a 697MB AVI file.

Starting off OggConvert used 12MB of RAM.

At 50% OggConvert used 61MB of RAM.

The resulting OGV is 120MB and OggConvert is sitting at 69.3MB in RAM.

Upon closing and reopening OggConvert, it uses 12MB of RAM

Although OggConvert is not using 120MB, it shouldn't be using 70MB idle afterwards. I'll see if I can get my hands on a bigger file and test some more.

Tristan,
Ideas?

Thanks,
-Kerry

[Tristan Brindle (tristan-brindle)]

There are several possible things going on here. The most likely is that OggConvert isn't destroying the instance of the Transcoder class after transcoding is complete (because Python isn't garbage-collecting it). An easy way to test this is to transcode a video, let the memory use grow, and then when it's finished, start transcoding another video without restarting OggConvert, and see what happens.

There are a few other possibilities, but I'm not sure how likely they are.

As to the amount of memory used... well, OggConvert itself (the GUI) uses around 12MB or so on a 32-bit system, a bit more on 64-bit. The rest is used by GStreamer during the transcoding process. I have to say I'm surprised at the amount of memory it seems to be using -- it's possible that a memory leak has sneaked in to one of the GStreamer elements that OggConvert uses. On the other hand, if you're transcoding to Dirac, this memory use is more-or-less normal -- schroenc uses a lot of RAM to speed up encoding.

[WalterCool (waltercool)]

A few minutes converting a 600MB video... this amount of MB still growing after this picture

[WalterCool (waltercool)]

I apologize for that bad picture...

[WalterCool (waltercool)]

And... this is enough for reproduce it?

If can you see, my RAM monitor (the green bars) are on top! My system is paging as a beast! Im stopping this conversion now...

Im sorry, i dont want fill your mail boxes, so i had uploaded the next picture, this is a picture with oggconvert stopped (current conversion finished) http://i47.tinypic.com/15hy8tc.png

[Tristan Brindle (tristan-brindle)]

Well, that's not good.

The attached script runs the same GStreamer pipeline as OggConvert, using the gst-launch command line. You can run it with

oggconvert-command-line.sh /path/to/input/file.ext /path/to/output/file.ogg

Please could you run it with the same file as you're using with OggConvert, and see what the memory usage is like? If it explodes like it does with OggConvert, then we know this is a GStreamer bug. Otherwise, we know it's an OggConvert bug.

Thanks,

Tristan

[WalterCool (waltercool)]

~42.7MB MB on 5.3%, Same video vs above 200MB ram on 4.x% (first picture)

Seems a oggconvert problem

[WalterCool (waltercool)]

Oh... im sorry, wrong file selected... thats the correct screenshot

[Theatre-X (theatrex)]

I'm having the same problem. Tried converting a 700MB AVI video to .ogv and my system was using 2.5 out of 3GB or RAM. Would you like me to run that script?

Linux Katormix 2.6.35-29-generic #51-Ubuntu SMP Fri Apr 15 17:13:54 UTC 2011 i686 GNU/Linux

Oggconvert version: 0.3.3