Re: [Zope] ZServer threads and pool-size question

2006-01-04 Thread Jens Vagelpohl


On 4 Jan 2006, at 13:23, Pascal Peregrina wrote:


Hi,

Can anyone tell me why, by default in a zope instance config file,  
the connection pool size is 7 while the number of zserver threads  
is 4?


Why not 4 and 4?


Because under some conditions you can actually have more than 4  
connections in use. Not having extra connections available has the  
potential to block the server.


jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )


RE: [Zope] ZServer threads and pool-size question

2006-01-04 Thread Pascal Peregrina
I understand.

So what is the typical value to use for pool-size given a certain threads 
number: n+3 ?

Pascal

-Message d'origine-
De : [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] De la part de Jens Vagelpohl
Envoyé : mercredi 4 janvier 2006 14:31
À : zope list user
Objet : Re: [Zope] ZServer threads and pool-size question


On 4 Jan 2006, at 13:23, Pascal Peregrina wrote:

> Hi,
>
> Can anyone tell me why, by default in a zope instance config file,  
> the connection pool size is 7 while the number of zserver threads  
> is 4?
>
> Why not 4 and 4?

Because under some conditions you can actually have more than 4  
connections in use. Not having extra connections available has the  
potential to block the server.

jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.

This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.

www.mimesweeper.com
**

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


Re: [Zope] ZServer threads and pool-size question

2006-01-04 Thread Jens Vagelpohl


On 4 Jan 2006, at 13:34, Pascal Peregrina wrote:


I understand.

So what is the typical value to use for pool-size given a certain  
threads number: n+3 ?


There is no "typical value". Changing the thread number and pool size  
puts you *way* off-road, fiddling with it should be avoided.


You will have to experiment if you really think you need to change  
that setting. More connections -> more RAM usage.


Makes me wonder why you think that is necessary.

jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )


RE: [Zope] ZServer threads and pool-size question

2006-01-04 Thread Pascal Peregrina
Because I use ZEO, I got lots of often modified objects, and on Zope servers I 
got lots of memory so I can give it a try ;)

Pascal

-Message d'origine-
De : [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] De la part de Jens Vagelpohl
Envoyé : mercredi 4 janvier 2006 14:45
À : zope list user
Objet : Re: [Zope] ZServer threads and pool-size question


On 4 Jan 2006, at 13:34, Pascal Peregrina wrote:

> I understand.
>
> So what is the typical value to use for pool-size given a certain  
> threads number: n+3 ?

There is no "typical value". Changing the thread number and pool size  
puts you *way* off-road, fiddling with it should be avoided.

You will have to experiment if you really think you need to change  
that setting. More connections -> more RAM usage.

Makes me wonder why you think that is necessary.

jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.

This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.

www.mimesweeper.com
**

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


Re: [Zope] ZServer threads and pool-size question

2006-01-04 Thread Jens Vagelpohl


On 4 Jan 2006, at 13:53, Pascal Peregrina wrote:

Because I use ZEO, I got lots of often modified objects, and on  
Zope servers I got lots of memory so I can give it a try ;)


Where do you see the gain? More threads and connection also means  
more caches that need to be updated/invalidated when you modify an  
object. You might slow your system down instead.


jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )


RE: [Zope] ZServer threads and pool-size question

2006-01-04 Thread Pascal Peregrina
So, are you telling me that the ideal configuration is using all default values 
(connection objects cache size, ZEO cache size, threads and connection pool)?

Pascal

-Message d'origine-
De : [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] De la part de Jens Vagelpohl
Envoyé : mercredi 4 janvier 2006 15:02
À : zope list user
Objet : Re: [Zope] ZServer threads and pool-size question


On 4 Jan 2006, at 13:53, Pascal Peregrina wrote:

> Because I use ZEO, I got lots of often modified objects, and on  
> Zope servers I got lots of memory so I can give it a try ;)

Where do you see the gain? More threads and connection also means  
more caches that need to be updated/invalidated when you modify an  
object. You might slow your system down instead.

jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.

This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.

www.mimesweeper.com
**

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


Re: [Zope] ZServer threads and pool-size question

2006-01-04 Thread Jens Vagelpohl


On 4 Jan 2006, at 14:11, Pascal Peregrina wrote:

So, are you telling me that the ideal configuration is using all  
default values (connection objects cache size, ZEO cache size,  
threads and connection pool)?


The default values for thread number and connection pool covers all  
but the most exotic use cases. The cache sizes can benefit greatly  
from experimenting, but there is no standard recipe, it all depends  
on your specific software and hardware environment.


jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
http://mail.zope.org/mailman/listinfo/zope-announce

http://mail.zope.org/mailman/listinfo/zope-dev )


RE: [Zope] ZServer threads and pool-size question

2006-01-04 Thread Pascal Peregrina
Ok, much clearer now... 

I might focus on cache sizes then.

Thanks.

Pascal

-Message d'origine-
De : [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] De la part de Jens Vagelpohl
Envoyé : mercredi 4 janvier 2006 15:17
À : zope list user
Objet : Re: [Zope] ZServer threads and pool-size question


On 4 Jan 2006, at 14:11, Pascal Peregrina wrote:

> So, are you telling me that the ideal configuration is using all  
> default values (connection objects cache size, ZEO cache size,  
> threads and connection pool)?

The default values for thread number and connection pool covers all  
but the most exotic use cases. The cache sizes can benefit greatly  
from experimenting, but there is no standard recipe, it all depends  
on your specific software and hardware environment.

jens

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.

This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.

www.mimesweeper.com
**

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


RE: [Zope] ZServer threads and pool-size question

2006-01-04 Thread Dieter Maurer
Pascal Peregrina wrote at 2006-1-4 13:34 -:
>I understand.
>
>So what is the typical value to use for pool-size given a certain threads 
>number: n+3 ?

It depends on how intensively you are using additional (application level)
threads:

  Each thread using persistent objects requires in general (at least) one
  ZODB connection.

As such threads are relatively rare, additional 3 connections
is not too bad for the general case.



-- 
Dieter
___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists - 
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )


RE: [Zope] ZServer threads and pool-size question

2006-01-05 Thread Pascal Peregrina
Thanks, I will try that ;)

-Message d'origine-
De : Dieter Maurer [mailto:[EMAIL PROTECTED] 
Envoyé : mercredi 4 janvier 2006 19:52
À : Pascal Peregrina
Cc : Jens Vagelpohl; zope list user
Objet : RE: [Zope] ZServer threads and pool-size question

Pascal Peregrina wrote at 2006-1-4 13:34 -:
>I understand.
>
>So what is the typical value to use for pool-size given a certain threads 
>number: n+3 ?

It depends on how intensively you are using additional (application level)
threads:

  Each thread using persistent objects requires in general (at least) one
  ZODB connection.

As such threads are relatively rare, additional 3 connections
is not too bad for the general case.



-- 
Dieter


**
This email and any files transmitted with it are confidential and
intended solely for the use of the individual or entity to whom they
are addressed. If you have received this email in error please notify
the system manager.

This footnote also confirms that this email message has been swept by
MIMEsweeper for the presence of computer viruses.

www.mimesweeper.com
**

___
Zope maillist  -  Zope@zope.org
http://mail.zope.org/mailman/listinfo/zope
**   No cross posts or HTML encoding!  **
(Related lists -
 http://mail.zope.org/mailman/listinfo/zope-announce
 http://mail.zope.org/mailman/listinfo/zope-dev )