Re: Django, shared hosting memory limits and memory optimization
> > > BTW, if you run 'ldd' on the mod_python.so file from the Apache > > > modules directory, does it use Python as a shared library or is there > > > no reference to libpython2.?.so at all, meaning it is embedded with in > > > mod_python.so? What is the actual size of your mod_python.so file? > > > mod_python.so is about 4MB. It doesn't show libpython2.x.so as one of > > the shared libraries. > > Which shows that the Python installation on the box is really crappy. > One of the problems with using RedHat derived distributions. > > That the mod_python.so is so large means that there is no shared > library built and provided with the Python installation, or at least > not with the version that mod_python was compiled against. > Alternatively, there is a shared library, but it is only in /usr/lib > and not along side the libpython2.?.a file in /usr/lib/python2.?/ > config directory. > > In other words, when mod_python was built, all it found in the /usr/ > lib/python.2?/config directory was the static library archive. As a > consequence, 'libtool' when it creates the mod_python.so file has no > choice but to extract all the object files from the static Python > library and embed them into mod_python.so itself. Thus, instead of > mod_python.so being less than 0.5MB through being able to link > dynamically to the Python library it is much larger. > > Worse is that the size of mod_python.so indicates that debug may have > been compiled into the Python library. For an optimised build of the > Python library it is normally only about 1MB, not over 3MB as in this > case. > > Even more worse than that, is what now happens when that mod_python.so > is loaded by Apache. Now the way I understand it, normally a > dynamically loaded module should really be shared and thus memory cost > only applies once across all processes that load it, however, if the > object files in that static Python library are not truly position > independent, when mod_python.so gets loaded, the dynamic linker will > have to perform address relocations to fixup references to function > and data from the Python library objects. As a consequence, rather > than being shared memory, the mod_python.so becomes private memory to > the parent Apache process. When Apache forks off the child processes, > they in turn will each end up with their own private copy of up to 4MB > of memory that mod_python.so consumes when it could all have been > shared. So, even on a fresh restart, the Apache processes are going to > be much larger than they need to be because of the way that Python was > built in the first place. > > Now whether this is going to happen like this I am not 100% sure as it > can depend on the operating system and perhaps the age of the > operating system version as well and how they handle loading of > dynamically loadable modules. I am led to believe that this can occur > on Solaris, to what degree it applies on different Linux versions I am > not as sure. > > Either way, that debug seems to be built into your Python library is > not good. IfWebfactionused a better build of Python with > optimisation and a shared library they could quite easily cut down on > memory use allowing your applications to have more space within their > set limit. > > What is even more annoying is that various people run around > continually saying how crap mod_python is because of how much memory > it uses, when in practice a lot of it has to do with poorly built > Python versions as I show above. :-( > > > > Base Django setup can take up 5-7MB without even your own stuff so it > > > can jump up quite a bit. Is that 35MB in total across all processes or > > > per process? > > > About 4MB for the parent process, and 13MB for the two child > > processes. > > > > What version of mod_python are you using? > > > 3.2.8. > > Which has various memory leaks. Even 3.2.10 has memory leaks. I highly > recommend upgrading to mod_python 3.3.1 if you can do it as it > eliminates a lot of memory leaks. If you also do a rebuild of Python > with optimisation and a shared library you should hopefully see less > memory being used then at startup. Just a quick update to mention that we've taken these comments into account and we've optimized our Django setup at WebFaction: - Django apps now comes with mod_python-3.3.1 by default - mod_python is now compiled with a shared libpython.so (the size of mod_python.so went from 3MB down to 300KB). - you can now choose between Python-2.4 or Python-2.5 when creating a Django app. Remi -- WebFaction - Hosting for an agile web http://www.webfaction.com --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users?hl=en -~--~~~~--~~--~--~---
Re: WebFaction celebrates its 1000th Django site with free Django hosting
> Hello everyone, > > To celebrate our 1000th Django siteWebFactionis proud to offer 10 > free Django > hosting accounts as a thank you to the Django community. I'm happy to announce that the winners of the 10 free Django hosting accounts are: Martin Glueck Sam/Musicpeeps.co.uk Jay Parlar Vinay Sajip Niels Poppe Jesse Wolfe David Reynolds Adam Fast Ramiro Morales Yhsla Jones Thank you to everyone who entered the draw. FYI, we are currently optimizing our Django deployment setup: - upgrade to mod_python-3.3.1 (fixes some memory leaks plus lots of other improvements) - mod_python compiled with a shared libpython.so (mod_python.so is now 250KB instead of 3MB) - choice of python2.4 or python2.5 These will be available soon. Remi WebFaction - Hosting for an agile web http://www.webfaction.com --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users?hl=en -~--~~~~--~~--~--~---
ANN: Django-0.96 hosting available at WebFaction
Hi everyone, I'm happy to announce that WebFaction have added Django-0.96 to their one-click installer. We've also upgraded MySQLdb to version 1.2.2 on all of our servers because the previous version we had wasn't compatible with the new Django version. Remi http://www.webfaction.com - Hosting for an agile web. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users?hl=en -~--~~~~--~~--~--~---
ANN: Django-0.95.1 hosting available at WebFaction
Hi everyone, This is just a quick post to announce that WebFaction have added Django-0.95.1 to their control panel. Remi http://www.webfaction.com - Hosting for an agile web. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users?hl=en -~--~~~~--~~--~--~---
Django hosting gets cheaper
Hi everyone, I thought you might be interested in knowing that WebFaction just upgraded their hosting plans. We've added one long-running process and 40MB of RAM to all of our plans. This means that Django hosting is now available on our "Shared 1" plan, starting at $7.50/month. That's our little holiday present :) We've been happily supporting Django from the start and host hundreds (actually, close to a thousand now) of Django sites ... Even if you don't host with us, feel free to have a look at our Django forum where you might find useful information related to Django hosting: http://forum.webfaction.com/viewforum.php?id=19 Happy holidays everyone. Remi. http://www.webfaction.com --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users?hl=en -~--~~~~--~~--~--~---
Django hosting gets cheaper
Hi everyone, I thought you might be interested in knowing that WebFaction just upgraded their hosting plans. We've added one long-running process and 40MB of RAM to all of our plans. This means that Django hosting is now available on our "Shared 1" plan, starting at $7.50/month. That's our little holiday present :) We've been happily supporting Django from the start and host hundreds (actually, close to a thousand now) of Django sites ... Even if you don't host with us, feel free to have a look at our Django forum where you might find useful information related to Django hosting: http://forum.webfaction.com/viewforum.php?id=19 Happy holidays everyone. Remi. http://www.webfaction.com --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users?hl=en -~--~~~~--~~--~--~---
ANN: New Django forum at WebFaction
Hello everyone, There is now a new Django forum at WebFaction. Even though it is specific to the WebFaction setup, most of the content can still be useful to the community. The forum is available here: http://forum.webfaction.com/viewforum.php?id=19 Remi WebFaction - Hosting for an agile web http://www.webfaction.com --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users -~--~~~~--~~--~--~---
Re: Fast hosting for Django
Just a few comments about WebFaction. > I am a WebFaction customer, definitely not a bad company. A few thoughts > about WebFaction: > > 1) It's a one man show, at least, support is. WebFaction started with just 3 people but we're growing quite rapidly right now so expect to see more people soon :) > Support ticket response times > are anywhere from three hours to a day and a half. We aim to respond within a few minutes or hours (depending on how urgent the ticket is), and always within 24 hours. If a ticket took a day and a half to get answered it was a mistake on our part and should never happen. > 2) The control panel may be appealing but it is definitely flawed. It > supports Firefox and Internet Explorer, but things are pretty slow with > Opera. Their long running process monitoring (You're allowed one long > running process at $14.50 USD a month.) is pretty bad as well, stopping and > restarting your Apache instance leaves orphaned processes that you > cannot monitor or kill off yourself. I think you're talking about our control panel not killing the processes for you when you delete an application from the control panel, I just fixed that bug today :) A couple more things: I can't tell for sure but I'd say that we're probably one of the hosts with the most Django sites right now (we host more than 200 of them). By gaining some experience from all these sites we've been able to eliminate pretty much all problems (like the libexpat version mismatch that was causing Apache to crash sometimes) and fine tune our setup. I think that we now have one of the best setup for shared hosting: we give each site their own Apache2/mod_python instance proxied behind our main Apache server. This gives them maximum flexibility to start/stop their Apache server on their own and edit their httpd.conf file as they want. But we also configure our main Apache server to serve static data (images, stylesheets, ...) directly, for maximum speed (this frees each site's Apache2/mod_python instance from having to serve all those little requests). Remi. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users -~--~~~~--~~--~--~---
Re: Shared Hosting suggestion
> Any of you have run a django application in a shared hosting > successfully? Yes, we do an we prove it :) http://blog.webfaction.com/django-screencast Remi WebFaction - Hosting for an agile web --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users -~--~~~~--~~--~--~---
Re: ANN: Screencast showing a step by step installation of a real-life Django application on a WebFaction account
> There is now a screencast showing a step by step installation > of a real-life Django application on a WebFaction account. > > The 19 minute screencast shows how to: > > - Install a default Django application using our control panel > - Make it available over HTTPS as well (useful for the admin area) > - Create a database using the control panel > - Change your database password using the control panel > - SSH into your shell account > - Replace the django module with the latest subversion version > - Replace the django default project with your own project > - Configure your project settings, sync your database > - Restart your Apache+mod_python instance > - Play with the admin area > - Play with the actual application > > The screencast can be downloaded from > http://blog.webfaction.com/django-screencast > > Many thanks to Ian Holsman (http://feh.holsman.net) for making this > screencast. Just a quick update: Ian has updated the screencast for Django-0.95 and the sound quality is now much better: http://blog.webfaction.com/django-screencast Remi. http://www.webfaction.com - Hosting for an agile web --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users -~--~~~~--~~--~--~---
Re: ANN: Screencast showing a step by step installation of a real-life Django application on a WebFaction account
> I dont' know if it was mentioned in the screen cast, but is the setup > procedure shown here for a shared environment or the dedicated server? The screencast works on both. Remi. --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users -~--~~~~--~~--~--~---
ANN: Screencast showing a step by step installation of a real-life Django application on a WebFaction account
Hi all, There is now a screencast showing a step by step installation of a real-life Django application on a WebFaction account. The 19 minute screencast shows how to: - Install a default Django application using our control panel - Make it available over HTTPS as well (useful for the admin area) - Create a database using the control panel - Change your database password using the control panel - SSH into your shell account - Replace the django module with the latest subversion version - Replace the django default project with your own project - Configure your project settings, sync your database - Restart your Apache+mod_python instance - Play with the admin area - Play with the actual application The screencast can be downloaded from http://blog.webfaction.com/django-screencast Many thanks to Ian Holsman (http://feh.holsman.net) for making this screencast. Remi. http://www.webfaction.com - Hosting for an agile web PS: Since I'm posting here I'll also answer two questions that we get a lot: yes you can use the latest subversion Django code on our accounts (this is what is done in the screencast) and yes you get your own Apache2+mod_python instance which you can stop/start on your own :) --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users -~--~~~~--~~--~--~---
Wanted: Screencast showing how to setup a real-world Django site at WebFaction
Hi everyone, A few days ago we released the screencast of our control panel (http://blog.webfaction.com/control-panel-demo) which showed, amongst other things, how to setup a default Django site in a few clicks. Now we'd like to make another screencast showing how to setup a real-world Django application on our servers. So we're looking for a Django guru to make that screencast for us. The screencast should show: - How to setup a default Django site using our control panel - How to upgrade the Django code to the latest trunk. - How to setup your database - How to setup your site (you should use a real-world application) - How to make upgrades to your site/database - How to enable HTTPS for the admin pages Reward: $200 + one year of free hosting on our "Shared 2" plan. If you're interested get in touch with me at "remi at webfaction dot com" Remi. http://www.webfaction.com - Hosting for an agile web --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users -~--~~~~--~~--~--~---
ANN: Screencast demo of the WebFaction control panel
Hello everyone, There is now a screencast demo of the WebFaction control panel. This screencast was shown to Adrian and Simon at a London Python meetup and they were quite enthusiastic about the control panel and the way we setup Django sites (we give each Django user their own Apache2 instance with mod_python so they have total control over it to configure it and start/stop it). The 6 minute demo shows how you can setup a Rails, WordPress, Django and TurboGears application in a few clicks, and then "mount" these applications on various domain(s)/URL(s). The "mounting" process provides a flexible way to: - serve different sections of a site using different applications - serve multiple websites from the same application The one-click installer already supports all major tools, including Rails, WordPress, Djano, TurboGears, Plone, Trac and Subversion, but also lightweight tools such as static HTML, CGI or PHP. The demo is available at: http://blog.webfaction.com/control-panel-demo Remi. http://www.webfaction.com - Hosting for an agile web PS: This announcement is also on Digg so if you like the screencast and you've got a digg account feel free to vote for the story :) http://digg.com/programming/Setup_a_Rails,_Wordpress,Django_and_TurboGears_site_in_1min37_and_12_clicks --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users -~--~~~~--~~--~--~---
Re: Getting Django Magic-Removal on Webfaction
Hi, > I just opened a Webfaction account so that I can learn Django in a real > web environment instead of running it locally on my pc. > > The version they install is not magic-removal. Does anyone know how to > install this version on a Webfaction account? I had subversion > installed. > > I'm not very well versed in much of this, so as much detail that can be > provided would be appreciated. Thank you. At WebFaction we install the Django python module in $HOME/lib/python2.4 and the Django scripts in $HOME/bin, so you're free to replace them by whatever version you need. Also, your own Apache instance with mod_python is in $HOME/webapps//apache2/... Regards, Remi. http://www.webfaction.com --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users -~--~~~~--~~--~--~---
Re: Dreamhost - does anyone know a better webhosting?
> I have been using Dreanhost for share webhosting service for a few > months already but I found out it is very unreliable. If there is a > higher traffic my site goes down. From the beginnig I was happy - no > problem - but now when more users come to my site - problems repeat > all over and over again. > Does anyone know a better webhosting? > Or is it a problem of Django that brings very load on a server?? I don't think it's a problem with Django because we host quite a few Django sites with a pretty high traffic on our shared servers and we don't have any problems. Remi http://www.python-hosting.com --~--~-~--~~~---~--~~ You received this message because you are subscribed to the Google Groups "Django users" group. To post to this group, send email to django-users@googlegroups.com To unsubscribe from this group, send email to [EMAIL PROTECTED] For more options, visit this group at http://groups.google.com/group/django-users -~--~~~~--~~--~--~---
ANN: Django hosting available at Python-Hosting.com
Hello everyone, I'm happy to announce that Python-Hosting.com now supports Django. We've been hosting Django sites for a while but we've now added it to our official list of supported software. You can host 5 Django sites with up to 10 MySql or PostgreSql databases for $15/month. When you signup you get a default running Django site using the latest Django version and a blank Django project. The Django python module is installed in your HOME directory so you can change the version if you want to. Your Django site runs on top of mod_python. You actually get your own Apache2 instance with mod_python, which you have total control over (for instance, you can start it and stop it on your own). Remi. http://www.python-hosting.com
