[infinispan-dev] Staggering remote GET calls

2013-02-19 Thread Manik Surtani
Guys, I have a topic branch with a fix for ISPN-825, to stagger remote GET calls. (See the JIRA for details on this patch). This should have an interesting effect on greatly reducing the pressure on the OOB thread pool. This isn't a *real* fix for the problem that Radim reported (Pedro is wo

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Radim Vansa
Hi Manik, so I have tried to compile this branch and issued a 20 minute stress test (preceded by 10 minute warmup) on 128 nodes, where each node has 10 stressor threads. While in 5.2.0.CR3 the maximum OOB threadpool size was 553 with this configuration, with t_825 it was 219. This looks good, b

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Dan Berindei
Radim, just to be sure, you are testing embedded mode with RadarGun, right? With HotRod most of the get operations should be initiated from the main owner, so Manik's changes shouldn't make a big difference in the number of active threads. How about throughput, has it also improved compared to 5.2

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Radim Vansa
Berindei" | To: "infinispan -Dev List" | Cc: "Manik Surtani" | Sent: Wednesday, February 20, 2013 3:24:46 PM | Subject: Re: [infinispan-dev] Staggering remote GET calls | | | Radim, just to be sure, you are testing embedded mode with RadarGun, | right? With HotRod most of the g

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Mircea Markus
ll rerun it (and check!), and show performance numbers as well. > > Radim (the dumbass) > > - Original Message - > | From: "Dan Berindei" > | To: "infinispan -Dev List" > | Cc: "Manik Surtani" > | Sent: Wednesday, February 20, 2

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Radim Vansa
dnesday, February 20, 2013 3:46:54 PM | Subject: Re: [infinispan-dev] Staggering remote GET calls | | | So you are testing embedded mode with RadarGun? | Or remotely over hotrod? | | | | | On 20 Feb 2013, at 14:38, Radim Vansa wrote: | | | | Ouch, call me dumbass... I haven't checked the

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Mircea Markus
On 20 Feb 2013, at 14:57, Radim Vansa wrote: > Only library (embeded) mode, as the load is constant (10 threads issuing > requests all the time) I believe that the results are more stable and > comparable between runs. Thanks. As Dan suggested, the staggering of requests should ONLY have an (s

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Bela Ban
Excellent ! On 2/20/13 3:15 PM, Radim Vansa wrote: > Hi Manik, > > so I have tried to compile this branch and issued a 20 minute stress test > (preceded by 10 minute warmup) on 128 nodes, where each node has 10 stressor > threads. > While in 5.2.0.CR3 the maximum OOB threadpool size was 553 with

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Manik Surtani
Awesome. :) Mircea, are you going to finish up my patch, make the staggering timeout configurable, etc? Sent from my mobile phone On 20 Feb 2013, at 15:15, Radim Vansa wrote: > Hi Manik, > > so I have tried to compile this branch and issued a 20 minute stress test > (preceded by 10 minute w

Re: [infinispan-dev] Staggering remote GET calls

2013-02-20 Thread Radim Vansa
Manik, as I have stated in later mails, the test was not executed properly, therefore these good results. Actually, I think there is a bug in the branch, as you set expected responses in FutureCollator to dest.size() but still send only one message, if the first response is not successful but wi

Re: [infinispan-dev] Staggering remote GET calls

2013-02-21 Thread Radim Vansa
quot;infinispan -Dev List" | Sent: Wednesday, February 20, 2013 3:38:49 PM | Subject: Re: [infinispan-dev] Staggering remote GET calls | | Ouch, call me dumbass... I haven't checked the test results. | Something revoked my cluster allocation and the test was prematurely | stopped. | |

Re: [infinispan-dev] Staggering remote GET calls

2013-02-26 Thread Manik Surtani
- Original Message - > | From: "Radim Vansa" > | To: "infinispan -Dev List" > | Sent: Wednesday, February 20, 2013 3:38:49 PM > | Subject: Re: [infinispan-dev] Staggering remote GET calls > | > | Ouch, call me dumbass... I haven't checked the test results.

Re: [infinispan-dev] Staggering remote GET calls

2013-02-26 Thread Mircea Markus
On 26 Feb 2013, at 10:56, Manik Surtani wrote: > I'm not surprised that read performance suffers a bit actually. Which is why > we broadcast the GETs originally. But once the staggering timeout becomes > configurable, this should be something people can tune. +1. Also the performance increase

Re: [infinispan-dev] Staggering remote GET calls

2013-02-26 Thread Erik Salter
Tune in real-time, of course ;) Erik From: infinispan-dev-boun...@lists.jboss.org [mailto:infinispan-dev-boun...@lists.jboss.org] On Behalf Of Mircea Markus Sent: Tuesday, February 26, 2013 7:36 AM To: infinispan -Dev List Subject: Re: [infinispan-dev] Staggering remote GET calls On

Re: [infinispan-dev] Staggering remote GET calls

2013-02-26 Thread Paolo Romano
e ;) Erik *From:*infinispan-dev-boun...@lists.jboss.org [mailto:infinispan-dev-boun...@lists.jboss.org] *On Behalf Of *Mircea Markus *Sent:* Tuesday, February 26, 2013 7:36 AM *To:* infinispan -Dev List *Subject:* Re: [infinispan-dev] Staggering remote GET calls On 26 Feb 2013, at 10:56, Man

Re: [infinispan-dev] Staggering remote GET calls

2013-02-26 Thread Manik Surtani
g] On Behalf Of Mircea Markus >> Sent: Tuesday, February 26, 2013 7:36 AM >> To: infinispan -Dev List >> Subject: Re: [infinispan-dev] Staggering remote GET calls >> >> >> On 26 Feb 2013, at 10:56, Manik Surtani wrote: >> >> >> I&#