Followed your advice. Let's see what we get. massimo
On Thursday, 14 June 2012 16:08:22 UTC-5, mcm wrote: > > I would still lower Threads to 5 and use the WSGIDaemonProcess > directive with only processes. > > WSGIDaemonProcess processes=x > > x depends on how much memory you have. since web2py *is* fast you do > not need higher than x = 4*n cpus. > with processes dal db connection can be with poolsize=1. > > > mic > > > 2012/6/14 Massimo Di Pierro <massimo.dipie...@gmail.com>: > > I am switching to nginx as soon as I move the server. Anyway for now I > > disabled apps that are not used (should not be used) and changed the > apache > > conf to > > > > Timeout 35 > > KeepAlive On > > MaxKeepAliveRequests 15 > > KeepAliveTimeout 2 > > <IfModule mpm_worker_module> > > StartServers 5 > > MaxClients 10 > > MinSpareThreads 15 > > MaxSpareThreads 15 > > ThreadsPerChild 10 > > MaxRequestsPerChild 50 > > </IfModule> > > > > and the memory exhaustion problem seems to be gone away. At least for > now. > > > > massimo > > > > On Thursday, 14 June 2012 05:10:43 UTC-5, mcm wrote: > >> > >> Massimo, > >> > >> do you have any good reason to run apache? if not switch to nginx. > >> > >> mic > >> > >> > >> 2012/6/14 Michele Comitini <michele.comit...@gmail.com>: > >> > Correction: > >> >> mpm_worker -> spawn a number of different long running processes to > >> >> manage requests > >> > mpm_worker -> spawn a number of different long running *threads* to > >> > manage requests > >> > > >> > > >> > 2012/6/14 Michele Comitini <michele.comit...@gmail.com>: > >> >> mpm_prefork -> fork a number of different long running processes to > >> >> manage requests > >> >> mpm_worker -> spawn a number of different long running processes to > >> >> manage requests > >> >> > >> >> wsgi can fork and thread python interpreters so the overall status > of > >> >> forking and threading varies a lot because of this. > >> >> An important thing to remember is that if the python interpreter > dies > >> >> all threads in the same thread group die. > >> >> If there is a pure threaded only configuration the whole apache > server > >> >> can die if python dies. > >> >> > >> >> Switching to prefork could make the site more available, but does > hide > >> >> the real problem, i.e. the python interpreter dies for some reason. > >> >> > >> >> N.B. php can work reliably only on prefork configuration, because it > >> >> is not thread safe. > >> >> > >> >> mic > >> >> > >> >> > >> >> 2012/6/14 Massimo Di Pierro <massimo.dipie...@gmail.com>: > >> >>> some follow up. One thing that happened when the problem started is > >> >>> that I > >> >>> was experimenting with the apache settings and turned off > keepalive. > >> >>> > >> >>> I do not fully understand the implications of apache settings > >> >>> (mpm_prefork_module vs mpm_worker_module) and their parameters but > >> >>> since > >> >>> Python get slower the more cores are available for a fixed number > of > >> >>> threads, there is an optimum set of parameters depending on the > >> >>> architecture. > >> >>> > >> >>> I will continue some experimentation. > >> >>> > >> >>> Massimo > >> >>> > >> >>> > >> >>> On Wednesday, 13 June 2012 17:47:55 UTC-5, Massimo Di Pierro wrote: > >> >>>> > >> >>>> The fact is I did not have that problem before. The number of > users > >> >>>> has > >> >>>> not increased much. Either a recent commit changed something (if > this > >> >>>> is a > >> >>>> web2py problem) or it is a cache issue (I have many apps and some > >> >>>> cache too > >> >>>> much stuff in ram). > >> >>>> > >> >>>> massimo > >> >>>> > >> >>>> On Wednesday, 13 June 2012 17:38:26 UTC-5, Bruce Wade wrote: > >> >>>>> > >> >>>>> This seems like the same problems I am having with > >> >>>>> new.youadworld.com all > >> >>>>> the resources are getting sucked out of 5 servers. I am starting > to > >> >>>>> think I > >> >>>>> will have to start porting some of the sites features to a > different > >> >>>>> technology. > >> >>>>> > >> >>>>> This is a bad situation as I have been developing > >> >>>>> www.fittraineronline.com also with web2py however I cannot run > into > >> >>>>> the same > >> >>>>> situation with that site, especially when I will have a mobile > web > >> >>>>> app also > >> >>>>> with potentially millions of members. > >> >>>>> > >> >>>>> I am going to continue digging through the core and try to > optimize > >> >>>>> this > >> >>>>> as the developers productivity is great. However spending around > >> >>>>> $1200 a > >> >>>>> month just to run a site that can't handle 40,000 members isn't > >> >>>>> good. > >> >>>>> > >> >>>>> On Wed, Jun 13, 2012 at 3:31 PM, Massimo Di Pierro > >> >>>>> <massimo.dipie...@gmail.com> wrote: > >> >>>>>> > >> >>>>>> I do not know. Everything worked fine for long time until one > week > >> >>>>>> ago I > >> >>>>>> started having problems with the server. The fact is nothing > >> >>>>>> changed in > >> >>>>>> web2py to be causing this. I am still debugging but not much > info > >> >>>>>> to look > >> >>>>>> at. I have lots of apps running on the same server and I am > >> >>>>>> planning to do a > >> >>>>>> major cleanup so we can have mirrors. > >> >>>>>> > >> >>>>>> Massimo > >> >>>>>> > >> >>>>>> On Wednesday, 13 June 2012 16:13:25 UTC-5, JavierQQ wrote: > >> >>>>>>> > >> >>>>>>> > >> >>>>>>> On Wed, Jun 13, 2012 at 4:08 PM, davidjensen wrote: > >> >>>>>>>> > >> >>>>>>>> cannot establish connection to www.web2py.com > >> >>>>>>>> 2012-06-13T17:11 > >> >>>>>>> > >> >>>>>>> > >> >>>>>>> Me too :( > >> >>>>>>> why is this happening constantly? > >> >>>>>>> > >> >>>>>>> Javier > >> >>>>> > >> >>>>> > >> >>>>> > >> >>>>> > >> >>>>> -- > >> >>>>> -- > >> >>>>> Regards, > >> >>>>> Bruce Wade > >> >>>>> http://ca.linkedin.com/in/brucelwade > >> >>>>> http://www.wadecybertech.com > >> >>>>> http://www.fittraineronline.com - Fitness Personal Trainers > Online > >> >>>>> http://www.warplydesigned.com > >> >>>>> > >> >>> >
