Re: Ways to scale a mod_perl site
-Original Message- >From: Brad Van Sickle >Sent: Sep 17, 2009 12:13 AM >To: Michael Peters >Cc: Mod_Perl >Subject: Re: Ways to scale a mod_perl site > but I was unaware that there might be >an option for doing this without using a DB with mod_perl . As Tina said, how about using memcached for this case? Regards, Jeff Peng
Re: Why people not using mod_perl
Just was curious, is CGI running with perl6 most likely the same as Java with JVM? Regards, Jeff Peng
Re: Ways to scale a mod_perl site
-Original Message- >From: Phil Van >Sent: Sep 18, 2009 4:10 AM >To: Jeff Peng >Cc: modperl-list >Subject: Re: Ways to scale a mod_perl site > >Just curious: since you are already running FastCGI, why not serving >dynamic contents directly via it? we needed some reverse proxies for CDN. for example, our primary webservers were in ISP A, while in ISP B, we put some squid as reverse proxies to serve the users in local ISP. >Also, you may eliminate Squid. Using >Apache for static content is good enough (easy to get 5k static PV per >second per server, or 400 millions per day). > No. I'm sure serving static content Apache is worse than squid. when I was in another department, I maintained the systems for AD union (like google's AD). all content are static, PV of each day was about 200 million. but we had less than 20 squid (IIRC it was 18) boxes for handling this amount of requests. the same amount of Apache couldn't handle that case. Regards, Jeff Peng
Re: Ways to scale a mod_perl site
-Original Message- >From: Cosimo Streppone >Sent: Sep 17, 2009 3:43 AM >To: Mod_perl users >Cc: Jeff Peng >Subject: Re: Ways to scale a mod_perl site > >Jeff Peng wrote: > >> How many servers? >> We have run the systems with about 500 million PV each day, with many >> squid boxes + 200 apache webservers + 200 mysql hosts. >> The applications were written with FastCGI. > >Wow! Why don't you tell or blog a bit about this? >I would love to know more about what challenges >you went through. > Yup, at that time the primary pressure against performance was database. We used distributed Mysql servers with an oracle index server. Each mysql host served 1 - 1.5 million users. When an user logined, the application queried oracle to get the mysql host id with the key of username. Then the application queried to mysql and got anything it wanted. The systems generated 2T data each day (surely we had large amount of store). The front apache servers with FastCGI were running heavily, I remember 8G memory were almost eated. Squid was useful for static resources, but for dynamic applications like CGI, no way to reduce the pressure but adding more machines. Last, the applications are webmail, the best popolar provider here. Regards, Jeff Peng
Re: Ways to scale a mod_perl site
How many servers? We have run the systems with about 500 million PV each day, with many squid boxes + 200 apache webservers + 200 mysql hosts. The applications were written with FastCGI. -Original Message- From: Igor Chudov Sent: Sep 16, 2009 11:49 AM To: Mod_Perl Subject: Ways to scale a mod_perl site My algebra.com server serves about 77k pageviews and a little over a million objects requests per day (with half of it being served in just 4 hours). I peak out at 35 requests per second currently. I use mod_perl, mysql, and perlbal with everything running on one server. The server has a solid state disk to hold mysql data. I believe that it can handle 3x-5x more traffic all by itself. However, I am thinking of ways to scale up a mod_perl installation. 1) Use a load balancer like perlbal (I am already doing that) 2) Separate a MySQL database server from webservers. 3) Being enabled by item 2, add more webservers and balancers 4) Create a separate database for cookie data (Apache::Session objects) ??? -- not sure if good idea -- (next level) 5) Use a separate database handle for readonly database requests (SELECT), as opposed to INSERTS and UPDATEs. Use replication to access multiple slave servers for read only data, and only access the master for INSERT and UPDATE and DELETE. Any thoughts?
Re: Why people not using mod_perl
from what you all stated, does it mean mod_perl is really outmoded comparing to Java? Here Java programmer is cheaper than mod_perl developer. But if mp can get better performance, we may consider it as first choice. Regards, Jeff.
Re: nginx load balance
On Mon, Jun 30, 2008 at 11:07 PM, Perrin Harkins <[EMAIL PROTECTED]> wrote: > On Mon, Jun 30, 2008 at 11:00 AM, Jeff Peng <[EMAIL PROTECTED]> wrote: >> what's the standard module for storing sessions in a database? > > I recommend CGI::Session. > Yes, currently I'm also using CGI::Session. How about Apache::Session? Is it more efficient under modperl? -- Regards, Jeff. - [EMAIL PROTECTED]
Re: nginx load balance
Thanks for all. what's the standard module for storing sessions in a database? On Mon, Jun 30, 2008 at 8:43 PM, Perrin Harkins <[EMAIL PROTECTED]> wrote: > On Mon, Jun 30, 2008 at 3:18 AM, James Smith <[EMAIL PROTECTED]> wrote: >> I would consider using a shared memory solution to save traffic too >> from the database server (consider a solution based on memcached??)... > > No, don't use memcached for sessions. It's a cache, not a database. > It trades reliability for speed. -- Regards, Jeff. - [EMAIL PROTECTED]
Re: nginx load balance
On Sat, Jun 28, 2008 at 10:14 PM, <[EMAIL PROTECTED]> wrote: > http://wiki.codemongers.com/NginxHttpUpstreamModule > > IP hash based distribution is probably what you want Thanks.Source IP hash sounds a possible way. But, if user's gateway (for local network) has a IP pool, it means the first time user's request was outgoing with IP 11.11.11.11, but next time the request maybe will go out with IP 22.22.22.22. How about this case? -- Regards, Jeff. - [EMAIL PROTECTED]
nginx load balance
Hello, We have some modperl application servers. Follow the suggestion on this list, I will use a nginx in front of them to do the load balance. But I have a question, does nginx support for session-keeping? A user's request, should go always to the same original backend server. Otherwise the user's session will get lost. Thanks! -- Regards, Jeff. - [EMAIL PROTECTED]
please recommend the modules for Group application
Hello,lists, I want to run/write an application like Yahoo's Group,which include the membership networking. Is there any mod_perl module which has the Group-like features for me?Thank you. --Jeff
Re: Re: problem with fetching data in mod_perl
hello, It seems that you want to reload the config file when mod_perl programs are running. See here please: http://perl.apache.org/docs/1.0/guide/porting.html#Reloading_Modules_and_Required_Files hope that can help you. Without seeing your code, it's pretty difficult to say. First, I would strongly suggest you look here. Second, it sounds like a buffer issue. mark>>> Senthil Nathan <[EMAIL PROTECTED]> 31-Jan-06 00:53:05 AM >>> Hi All,Im using mod_perl and notice that while fetching data from a directory where the files are present, its not reading those files and getting the data.After some refresh or apache restart the same data is fetched properly. how to solve this issue???thankssenthil Jeff Peng [EMAIL PROTECTED] 2006-01-31
mod_perl or fastcgi
Hi,lists, We have some web applications in the schedule of development.We have not decided under which mode to run the services.They are some applications relative to email system.I think mod_perl or fastcgi should be the best choice.Is there anyone who have those experiences could give me some advice?What are the advantage and disadvantage about both of them?Are there any docs that describe the comparing about them?Thanks. --Jeff _ 与联机的朋友进行交流，请使用 MSN Messenger: http://messenger.msn.com/cn
