Hi Chris, I'll be more specific: I have a script, let's call it worker.py, which I run with 'python worker.py'. Inside it calls subprocess.popen(['ffmpeg'...], ...)
When I run the worker from my shell, it runs perfectly fine. Nothing crashes, no errors, etc. When I run the exact same worker using 'supervisor start worker', it will work *most of the time*, but sometimes, while the ffmpeg subprocess is running, the worker will crash. What happens is that the worker exits immediately, ignoring any finally. supervisord itself will keep running. It seems that it always crashes on certain videos, but never crashes on others, which leads me to believe that it is a stress issue. I don't know why this happens, and perhaps I guessed the wrong bug. But I'm strongly convinced that the bug is in supervisor, and I hope you can see why. For now, since this is a production server, I moved my worker scripts to use Upstart, and suffered no crashes so far. On Mon, Nov 19, 2012 at 7:27 PM, Chris McDonough <[email protected]> wrote: > On 11/19/2012 03:02 AM, Erez Sh wrote: > >> I think so because ffmpeg creates a lot of child processes, and it's >> very possible that it creates a lot of files descriptors too. How can I >> check if that really is the case? >> > > When you say it "crashes", what does that mean? Does supervisord itself > stop running? Or just your program? To be honest I'd look elsewhere for > the problem unless you have some sort of evidence it's a file descriptor > issue, because supervisor doesn't really share its file descriptors with > the processes it launches (and therefore shares no limit with them). > > >> >> On Sun, Nov 18, 2012 at 5:07 PM, Erez Sh <[email protected] >> <mailto:[email protected]>> wrote: >> >> Hi, >> >> I'm running a python script through supervisord, and inside I run >> ffmpeg through the subprocess module. >> Occasionally, supposedly when ffmpeg works hard enough, the entire >> process tree (ffmpeg+python) crashes without a warning. >> >> I think it has something to do with >> >> https://github.com/Supervisor/**supervisor/issues/26<https://github.com/Supervisor/supervisor/issues/26>, >> but I can't be sure. >> >> What should I do? I'll be happy to hear suggestions. >> >> Thanks, >> Erez >> >> >> >> >> ______________________________**_________________ >> Supervisor-users mailing list >> Supervisor-users@lists.**supervisord.org<[email protected]> >> https://lists.supervisord.org/**mailman/listinfo/supervisor-**users<https://lists.supervisord.org/mailman/listinfo/supervisor-users> >> >> > ______________________________**_________________ > Supervisor-users mailing list > Supervisor-users@lists.**supervisord.org<[email protected]> > https://lists.supervisord.org/**mailman/listinfo/supervisor-**users<https://lists.supervisord.org/mailman/listinfo/supervisor-users> >
_______________________________________________ Supervisor-users mailing list [email protected] https://lists.supervisord.org/mailman/listinfo/supervisor-users
