Re: [squid-users] Re: What are recommended settings for optimal sharing of cache between SMP workers?

2014-02-19 Thread Alex Rousskov
On 02/19/2014 02:08 AM, Rajiv Desai wrote: > When the cache is nearing capacity, will the collision rate increase > dramatically? The answer depends on what collisions you are talking about: * Hash collisions: Two different URLs having the same hash value. The probability of such a collision depe

Re: [squid-users] Re: What are recommended settings for optimal sharing of cache between SMP workers?

2014-02-19 Thread Rajiv Desai
When the cache is nearing capacity, will the collision rate increase dramatically? Is there any special handling to reduce collisions and follow lru eviction? On Tue, Feb 18, 2014 at 10:30 PM, Rajiv Desai wrote: > On Tue, Feb 18, 2014 at 9:28 PM, Alex Rousskov > wrote: >> On 02/18/2014 04:11 PM,

Re: [squid-users] Re: What are recommended settings for optimal sharing of cache between SMP workers?

2014-02-18 Thread Rajiv Desai
On Tue, Feb 18, 2014 at 9:28 PM, Alex Rousskov wrote: > On 02/18/2014 04:11 PM, Rajiv Desai wrote: > >> It seems like there is a bug where an object overwrites previously >> written object: > > This is not really a bug -- hash collisions do happen, as you have > discovered and Rock store resolves

Re: [squid-users] Re: What are recommended settings for optimal sharing of cache between SMP workers?

2014-02-18 Thread Alex Rousskov
On 02/18/2014 04:11 PM, Rajiv Desai wrote: > It seems like there is a bug where an object overwrites previously > written object: This is not really a bug -- hash collisions do happen, as you have discovered and Rock store resolves them by overwriting older entries if possible (or not caching the

Re: [squid-users] Re: What are recommended settings for optimal sharing of cache between SMP workers?

2014-02-18 Thread Rajiv Desai
I dug deeper into the original issue I reported where some objects were not gettings cache HITs on subsequent reads. It seems like there is a bug where an object overwrites previously written object: For a similar "multiple downloads on same data via squid" test, I directed both store and cache lo

[squid-users] Re: What are recommended settings for optimal sharing of cache between SMP workers?

2014-02-18 Thread Dr.x
Amos Jeffries-2 wrote > On 19/02/2014 12:12 a.m., Dr.x wrote: >> im doubting , >> without smp with same traffic and same users i can save 40Mbps >> >> but in smp with combination of aufs with rock (32KB max obj size) >> i can only save 20Mbps >> >> >> im wondering does large rock will heal me ?

Re: [squid-users] Re: What are recommended settings for optimal sharing of cache between SMP workers?

2014-02-18 Thread Amos Jeffries
On 19/02/2014 12:12 a.m., Dr.x wrote: > im doubting , > without smp with same traffic and same users i can save 40Mbps > > but in smp with combination of aufs with rock (32KB max obj size) > i can only save 20Mbps > > > im wondering does large rock will heal me ? > How many Squid processes ar

[squid-users] Re: What are recommended settings for optimal sharing of cache between SMP workers?

2014-02-18 Thread Dr.x
im doubting , without smp with same traffic and same users i can save 40Mbps but in smp with combination of aufs with rock (32KB max obj size) i can only save 20Mbps im wondering does large rock will heal me ? or return to aufs and wait untill squid relase version that has bigger object size ?

[squid-users] Re: What are recommended settings for optimal sharing of cache between SMP workers?

2014-02-18 Thread Rajiv Desai
On Tue, Feb 18, 2014 at 2:42 AM, Rajiv Desai wrote: > Some more info: > > Following are mgr:storedir stats after back to back downloads for 4 GB > data (ie same 2 GB twice). > Perhaps the 477 StoreEntries with MemObjects AND 468 Hot Object > Cache Items are not shared? Nah ... those are just th

[squid-users] Re: What are recommended settings for optimal sharing of cache between SMP workers?

2014-02-18 Thread Rajiv Desai
Some more info: Following are mgr:storedir stats after back to back downloads for 4 GB data (ie same 2 GB twice). Perhaps the 477 StoreEntries with MemObjects AND 468 Hot Object Cache Items are not shared? Connection information for squid: Number of clients accessing cache: 10 Number of HTTP