Cannot create movies
Affects | Status | Importance | Assigned to | Milestone | |
---|---|---|---|---|---|
Helioviewer.org |
New
|
High
|
Keith Hughitt |
Bug Description
After installing the application, I am not able to create any movies. It just says forever, the movie is processing.
See the screen shot of the issue.
Karthik (karthikgp) wrote : | #1 |
Keith Hughitt (keith-hughitt) wrote : Re: [Bug 1086075] [NEW] Cannot create movies | #2 |
Karthik (karthikgp) wrote : | #3 |
I just installed ffmpeg, not x264.
I will install x264 and see what happens.
Karthik (karthikgp) wrote : | #4 |
Also, I do not see any error logs generated in <web_root>/log or in /var/log/
Keith Hughitt (keith-hughitt) wrote : | #5 |
You may need to enable error logging in PHP. See:
http://
Karthik (karthikgp) wrote : | #6 |
I enabled the logs, however I dont see an log error in folder <web_root>/log or any significant logs in file /var/log/
I installed ffmpeg and x264 and I still have the same issue.
Karthik (karthikgp) wrote : | #7 |
- Screen shot of the application in a browser Edit (383.8 KiB, image/png)
After a day finally I see some message. Movie status is changed from "Processing" to "Error".
See the screen shot attached.
I do not see any significant error log in apache2 error.log file, and I do not see anything in [root folder]/log directory.
Keith Hughitt (keith-hughitt) wrote : | #8 |
In the cache directory for a given movie (e.g. cache/movies/
If so, what I would try is editing api/src/
340- // Clean up movie frame images that are no longer needed
341- if (file_exists($dir)) {
342- foreach (glob("$dir*") as $image) {
343: unlink($image);
344- }
345- rmdir($dir);
Then go back and try running the FFmpeg command from the log manually and see if it works.
Karthik (karthikgp) wrote : | #9 |
- Screen shot of directories in cache directory Edit (2.1 KiB, image/png)
I dont see a directory for movies inside cache directory.
And what is the command used by FFmpeg ?
See the screen shot of folders that I have under /var/www/cache directory.
Karthik (karthikgp) wrote : | #10 |
- Image 9.png Edit (18.3 KiB, image/png)
After adding filling in the value for HV_MOVIE_ID_PASS in /var/www/
I see error message in resque web management for a movie I created.
See attached screen shot of resque web management failed jobs.
Keith Hughitt (keith-hughitt) wrote : | #11 |
What permissions do you have for the cache dir? Apache (www-data or httpd) much be able to write there. The easiest way to ensure this is to do a chmod -R 777 cache/, or add www-data to a group with all privileges there.
How did you end up getting Resque web working?
Karthik (karthikgp) wrote : | #12 |
- Screen shot of permission for cache directory Edit (2.4 KiB, image/png)
See the attached screen shot of permission on cache directory.
I made the permission of webserver to access the entire folder /var/www and earlier I just tried "http://
However, it worked when I tried "http://
Karthik (karthikgp) wrote : | #13 |
Moreover, for resque setup, I also make these settings
PATH=/usr/
and run these jobs in the background.
QUEUE=on_
USER=username PASS=pass /var/lib/
Please note, in the installation wiki only the job "USER=username PASS=pass /var/lib/
Karthik (karthikgp) wrote : | #14 |
- Screen shot of the resque management in a browser Edit (40.0 KiB, image/png)
Keith,
I am not able to create movies still. I have loaded all the data.
See the screen shot of error details in resque management. It says, "could not find job class Job Moviebuilder"
Karthik
Karthik (karthikgp) wrote : | #15 |
Keith,
Do we have any update on this issue ? Please, let me know.
Thanks.
Karthik
Keith Hughitt (keith-hughitt) wrote : | #16 |
Karthik,
It is possible that the error you encountered in Resque is due to the workers not be launched with the proper configuration.
Start by killing any workers currently running (you can use "resque list" or "ps -ef | grep resque" to identify them), and then
run the command "APP_INCLUDE=
If all goes well the resque worker daemon should start without any errors. If this is the case, now try requesting a movie on Helioviewer and see if the worker on the command-line recieves the request, and if so, any output that is displayed. Also, check the web UI to see if any errors appear there.
Let me know how this goes and we will decide how to proceed from here.
Karthik (karthikgp) wrote : | #17 |
- Movie creation error Edit (14.2 KiB, application/x-7z-compressed)
Keith,
I killed and started the workers in command line as you mentioned.
See the attached screen shots of the error (in console and in resque web management).
Karthik
Karthik (karthikgp) wrote : | #18 |
- Movie Error2.png Edit (20.4 KiB, image/png)
See the attached screen shot of resque web management display with more detailed error information.
Karthik (karthikgp) wrote : | #19 |
Keith, Do we have any updates on this ? Please, let me know.
Karthik
Changed in helioviewer.org: | |
importance: | Undecided → High |
Keith Hughitt (keith-hughitt) wrote : | #20 |
Okay, so the workers are at least responding to the jobs now. Next things to check:
1) Does the user running the resque workers have permissions to read/write in cache/movies? You can test this by creating a directory and touching a file in there as the same user.
2) If so, do you see any directories created in the movie cache? e.g. 2013/03/05/xxxyyy/
If the directories do exist, check to see if an ffmpeg.log exists inside. That should provide you with more information. You can also check the main log directory to see if anything is logged there, but In this case I don't think there will be.
If the problem is not a permission error, then I suspect at this point it may be missing codecs (e.g. libx264).
Karthik (karthikgp) wrote : | #21 |
Keith,
I ran using my user name, and I do have permission to create directories/files in cache/movies. Also, www-data (web server) also has the read/write access.
Also when I checked the ffmpeg.log I see this command..
ffmpeg -r 15 -i /var/www/
However, I could not find the frames directory in the folder /var/www/
Also, I see permission deny error in the command line ...
k_ganesanpillai
*** Starting worker helioviewer:
Starting movie 6222Z
PHP Warning: mkdir(): Permission denied in /var/www/
PHP Warning: mkdir(): Permission denied in /var/www/
PHP Warning: mkdir(): Permission denied in /var/www/
PHP Warning: mkdir(): Permission denied in /var/www/
Error processing movie 6222Z
Moreover, I see this error message in main log directory for Resque log.
Unable to create movie: Error encountered during video encoding. This may be caused
by a FFmpeg configuration issue, or by insufficient permissions in the cache.
Hope, this provides more information on the issue.
Karthik
Karthik (karthikgp) wrote : | #22 |
Hi Kieth,
Do we have any update on this bug. Kindly, let me know.
Thanks.
Karthik
Keith Hughitt (keith-hughitt) wrote : | #23 |
Hi Karthik,
It looks like there is still some underlying permissions issue. It looks like something is still off as far as the permissions go. Using the same user that you are running resque_env as, what happens if you try "mkdir -p /var/www/
Another thing you can try to see if this is the issue is to try making the cache directory completely open, e.g.
chmod -R 777 /var/www/cache
Karthik (karthikgp) wrote : | #24 |
Hi Keith,
Using the same user name that I use for running resque_env, I tried the command "mkdir -p /var/www/
And also, I changed cache directory to be completely open with the command chmod -R 777 /var/www/cache. However, I still get the error for processing movies.
Karthik
Keith Hughitt (keith-hughitt) wrote : | #25 |
Strange. Helioviewer must be attempting to create the directory in the wrong location...
Just to be sure though, can you try creating a test.php script somewhere in your web server with a simple command to create a directory in the cache, e.g.
<?php
mkdir("
?>
And open it in the web browser. Then check and see if the directory is there (if not, try checking the Apache/PHP error logs to verify that it failed).
If that works, then we Helioviewer is definitely pointing to the wrong location so we need to figure out what is going on.
As a first step, try editing HelioviewerComp
Karthik (karthikgp) wrote : | #26 |
I created the test.php with the command you mentioned and when I open it in a browser, it created a directory in that path specified.
Moreover, with the print command I am seeing this message.
*** Starting worker helioviewer:
Starting movie d222Z
directory is /var/www/
And then followed by
Error processing movie d222Z
I dont see the frames directory :(, but d222z does exist with the following permissions.
-rw-r--r-- 1 k_ganesanpillai k_ganesanpillai 779 2013-04-11 16:02 ffmpeg.log
-rw-r--r-- 1 k_ganesanpillai k_ganesanpillai 366436 2013-04-11 16:02 preview-full.png
-rw-r--r-- 1 k_ganesanpillai k_ganesanpillai 4457 2013-04-11 16:02 preview-icon.png
-rw-r--r-- 1 k_ganesanpillai k_ganesanpillai 153680 2013-04-11 16:02 preview-large.png
-rw-r--r-- 1 k_ganesanpillai k_ganesanpillai 43178 2013-04-11 16:02 preview-medium.png
-rw-r--r-- 1 k_ganesanpillai k_ganesanpillai 25676 2013-04-11 16:02 preview-small.png
Keith Hughitt (keith-hughitt) wrote : | #27 |
Hi Karthik,
To see if the frames directory (and the corresponding frames) are ever created, try editing HelioviewerMovi
Then try creating a new movie and you will be able to see how far the process gets.
Karthik (karthikgp) wrote : | #28 |
Hi Keith,
I commented "unlink" and "rmdir" in the "_cleanUp()" method in HelioviewerMovi
Then, tried to create a movie, however still the same error message as before. See below.
k_ganesanpillai
*** Starting worker helioviewer:
Starting movie c222Z
directory is /var/www/
Karthik
Keith Hughitt (keith-hughitt) wrote : | #29 |
Do you now see a "frames" directory? or is it still not being created?
Karthik (karthikgp) wrote : | #30 |
Awesome, yes I see the frames directory and lots of bmp files are in it. See below.
k_ganesanpillai
frame0.bmp frame110.bmp frame121.bmp frame16.bmp frame27.bmp frame38.bmp frame49.bmp frame5.bmp frame70.bmp frame81.bmp frame92.bmp
frame100.bmp frame111.bmp frame122.bmp frame17.bmp frame28.bmp frame39.bmp frame4.bmp frame60.bmp frame71.bmp frame82.bmp frame93.bmp
frame101.bmp frame112.bmp frame123.bmp frame18.bmp frame29.bmp frame3.bmp frame50.bmp frame61.bmp frame72.bmp frame83.bmp frame94.bmp
frame102.bmp frame113.bmp frame124.bmp frame19.bmp frame2.bmp frame40.bmp frame51.bmp frame62.bmp frame73.bmp frame84.bmp frame95.bmp
frame103.bmp frame114.bmp frame125.bmp frame1.bmp frame30.bmp frame41.bmp frame52.bmp frame63.bmp frame74.bmp frame85.bmp frame96.bmp
frame104.bmp frame115.bmp frame126.bmp frame20.bmp frame31.bmp frame42.bmp frame53.bmp frame64.bmp frame75.bmp frame86.bmp frame97.bmp
frame105.bmp frame116.bmp frame127.bmp frame21.bmp frame32.bmp frame43.bmp frame54.bmp frame65.bmp frame76.bmp frame87.bmp frame98.bmp
frame106.bmp frame117.bmp frame128.bmp frame22.bmp frame33.bmp frame44.bmp frame55.bmp frame66.bmp frame77.bmp frame88.bmp frame99.bmp
frame107.bmp frame118.bmp frame12.bmp frame23.bmp frame34.bmp frame45.bmp frame56.bmp frame67.bmp frame78.bmp frame89.bmp frame9.bmp
frame108.bmp frame119.bmp frame13.bmp frame24.bmp frame35.bmp frame46.bmp frame57.bmp frame68.bmp frame79.bmp frame8.bmp
frame109.bmp frame11.bmp frame14.bmp frame25.bmp frame36.bmp frame47.bmp frame58.bmp frame69.bmp frame7.bmp frame90.bmp
frame10.bmp frame120.bmp frame15.bmp frame26.bmp frame37.bmp frame48.bmp frame59.bmp frame6.bmp frame80.bmp frame91.bmp
Keith Hughitt (keith-hughitt) wrote : | #31 |
Alright! Now we are getting somewhere!
Now try running the FFmpeg command from the ffmpeg log file in the same movie directory. It will probably fail, but will hopefully tell us something interesting.
Karthik (karthikgp) wrote : | #32 |
Okay, here is the new error message!
k_ganesanpillai
ffmpeg version N-47486-g6d7effa Copyright (c) 2000-2012 the FFmpeg developers
built on Dec 5 2012 12:07:27 with gcc 4.5.2 (Ubuntu/Linaro 4.5.2-8ubuntu4)
configuration: --enable-
libavutil 52. 11.101 / 52. 11.101
libavcodec 54. 79.100 / 54. 79.100
libavformat 54. 46.100 / 54. 46.100
libavdevice 54. 3.102 / 54. 3.102
libavfilter 3. 24.100 / 3. 24.100
libswscale 2. 1.103 / 2. 1.103
libswresample 0. 17.102 / 0. 17.102
libpostproc 52. 2.100 / 52. 2.100
Input #0, image2, from '/var/www/
Duration: 00:00:05.16, start: 0.000000, bitrate: N/A
Stream #0:0: Video: bmp, bgra, 672x834, 25 fps, 25 tbr, 25 tbn, 25 tbc
File for preset 'lossless_fast' not found
Karthik (karthikgp) wrote : | #33 |
However, after removing all the preset options, the ffmpeg command generated the movie. See below.
k_ganesanpillai
ffmpeg version N-47486-g6d7effa Copyright (c) 2000-2012 the FFmpeg developers
built on Dec 5 2012 12:07:27 with gcc 4.5.2 (Ubuntu/Linaro 4.5.2-8ubuntu4)
configuration: --enable-
libavutil 52. 11.101 / 52. 11.101
libavcodec 54. 79.100 / 54. 79.100
libavformat 54. 46.100 / 54. 46.100
libavdevice 54. 3.102 / 54. 3.102
libavfilter 3. 24.100 / 3. 24.100
libswscale 2. 1.103 / 2. 1.103
libswresample 0. 17.102 / 0. 17.102
libpostproc 52. 2.100 / 52. 2.100
Input #0, image2, from '/var/www/
Duration: 00:00:05.16, start: 0.000000, bitrate: N/A
Stream #0:0: Video: bmp, bgra, 672x834, 25 fps, 25 tbr, 25 tbn, 25 tbc
[libx264 @ 0xfbb520] using cpu capabilities: MMX2 SSE2Fast FastShuffle LZCNT BMI1
[libx264 @ 0xfbb520] profile High, level 3.1
[libx264 @ 0xfbb520] 264 - core 129 r2230 1cffe9f - H.264/MPEG-4 AVC codec - Copyleft 2003-2012 - http://
Output #0, mp4, to '/var/www/
Metadata:
encoder : Lavf54.46.100
Stream #0:0: Video: h264 ([33][0][0][0] / 0x0021), yuv420p, 672x834, q=-1--1, 15360 tbn, 15 tbc
Stream mapping:
Stream #0:0 -> #0:0 (bmp -> libx264)
Press [q] to stop, [?] for help
frame= 129 fps= 71 q=-1.0 Lsize= 765kB time=00:00:08.46 bitrate= 740.5kbits/s
video:763kB audio:0kB subtitle:0 global headers:0kB muxing overhead 0.299115%
[libx264 @ 0xfbb520] frame I:1 Avg QP:16.85 size: 64078
[libx264 @ 0xfbb520] frame P:36 Avg QP:17.68 size: 19303
[libx264 @ 0xfbb520] frame B:92 Avg QP:16.81 size: 235
[libx264 @ 0xfbb520] consecutive B-frames: 4.7% 0.0% 2.3% 93.0%
[libx264 @ 0xfbb520] mb I I16..4: 65.7% 17.4% 16.8%
[libx264 @ 0xfbb520] mb P I16..4: 0.4% 0.0% 0.0% P16..4: 14.6% 5.2% 6.4% 0.0% 0.0% skip:73.4%
[libx264 @ 0xfbb520] mb B I16..4: 0.1% 0.0% 0.0% B16..8: 6.1% 0.0% 0.0% direct: 0.3% skip:9...
Keith Hughitt (keith-hughitt) wrote : | #34 |
Ah, I should have guessed it. So the FFmpeg presets are a way to specify a group of settings to apply during encoding to achieve some particular goal (e.g. quality level or file size).
Here is some information about it:
http://
Can you check to see if you have any .ffpreset files? You can try checking the default locations (e.g. /usr/share/ffmpeg), or using 'sudo updatedb' and 'locate' to look for 'ffpreset'.
Depending on which presets you have available, we can either adjust the relevant settings in Config.ini, or you can copy the presets included with Helioviewer, which are located in "api/resources/
Changed in helioviewer.org: | |
assignee: | nobody → Keith Hughitt (keith-hughitt) |
Karthik (karthikgp) wrote : | #35 |
Hi Keith,
Here is the details on the presets I have now.
k_ganesanpillai
/usr/local/
/usr/local/
/usr/local/
/usr/local/
/usr/local/
/usr/local/
/usr/local/
/var/www/
/var/www/
/var/www/
/var/www/
/var/www/
/var/www/
/var/www/
/var/www/
/var/www/
I have the following information in Config.ini file on presets, under movie parameters.
x264_preset = "lossless_fast"
x264_hq_preset = "ultrafast"
Let me know, what to do. Thanks.
Karthik
Keith Hughitt (keith-hughitt) wrote : | #36 |
It looks like FFmpeg may now use the 'avpreset' files provided by the 'libav-tools' package. Try doing another locate for 'avpreset' and see if anything comes up.
Karthik (karthikgp) wrote : | #37 |
Keith,
Nothing comes up for avpreset, when I do a locate avpreset :(
Karthik
Keith Hughitt (keith-hughitt) wrote : | #38 |
Karthik -- try installing libav-tools:
sudo apt-get install libav-tools
then do a 'sudo updatedb' and try to locate the avpreset files again.
Are any related error logs generated in either <web_root>/log or apache/ error.log?
/var/log/
Did you install FFmpeg and x264?
On Mon, Dec 3, 2012 at 1:07 PM, Karthik <email address hidden> wrote:
> Public bug reported: /bugs.launchpad .net/bugs/ 1086075/ +attachment/ 3450759/ +files/ Image%204. png /bugs.launchpad .net/bugs/ 1086075 /bugs.launchpad .net/helioviewe r.org/+ bug/1086075/ +subscriptions
>
> After installing the application, I am not able to create any movies. It
> just says forever, the movie is processing.
>
> See the screen shot of the issue.
>
> ** Affects: helioviewer.org
> Importance: Undecided
> Status: New
>
> ** Attachment added: "Screen shot of the application in a browser"
>
> https:/
>
> --
> You received this bug notification because you are a member of
> Helioviewer, which is subscribed to Helioviewer.org.
> https:/
>
> Title:
> Cannot create movies
>
> Status in Helioviewer.org:
> New
>
> Bug description:
> After installing the application, I am not able to create any movies.
> It just says forever, the movie is processing.
>
> See the screen shot of the issue.
>
> To manage notifications about this bug go to:
> https:/
>