Re: Benchmarks (again)

2014-03-26 Thread Robin Clarke
I just pasted output from uname there - that's kernel 3.2.54-2 you're reading there. I think the Debian release is Wheezy (7.0) -Robin- On 26 March 2014 12:17, Steinar Bang s...@dod.no wrote: Robin Clarke ro...@robinclarke.net: Thanks for the tip with the number of masters! java version

Re: Benchmarks (again)

2014-03-26 Thread Steinar Bang
Robin Clarke ro...@robinclarke.net: I just pasted output from uname there - that's kernel 3.2.54-2 you're reading there. I think the Debian release is Wheezy (7.0) OK. The OS version can be found in the /etc/debian_version file. -- You received this message because you are subscribed to

Re: Benchmarks (again)

2014-03-26 Thread Robin Clarke
In that case, *7.4* -Robin- On 26 March 2014 12:43, Steinar Bang s...@dod.no wrote: Robin Clarke ro...@robinclarke.net: I just pasted output from uname there - that's kernel 3.2.54-2 you're reading there. I think the Debian release is Wheezy (7.0) OK. The OS version can be found in

Re: Benchmarks (again)

2014-03-25 Thread Robin Clarke
Each node had 8 cores (2.4GHz Xeon), 32GB RAM, SSD disks (I never saw IOWait, but was also focusing on ingestion rate). I always had 2 master nodes, and in addition tried the configurations 20, 10 and 5 data nodes. Running Elasticsearch 1.0.1 (but with Logstash 1.3.3) -Robin- On 25 March 2014

Re: Benchmarks (again)

2014-03-25 Thread Mark Walkom
Java version? Also what OS? Just as a general note, it's always good to have an uneven number of masters to ensure you get a majority quorum. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 25 March 2014 17:35,

Re: Benchmarks (again)

2014-03-25 Thread Robin Clarke
Thanks for the tip with the number of masters! java version 1.6.0_45 on Debian 3.2.54-2 On 25 March 2014 07:55, Mark Walkom ma...@campaignmonitor.com wrote: Java version? Also what OS? Just as a general note, it's always good to have an uneven number of masters to ensure you get a majority

Re: Benchmarks (again)

2014-03-25 Thread Mark Walkom
Ouch, why such an old version of java? (And is is Open or Oracle?) v7 is the minimum for ES and LS. Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 25 March 2014 18:20, Robin Clarke ro...@robinclarke.net wrote:

Benchmarks (again)

2014-03-24 Thread Robin Clarke
I did some intensive tests last week on a 20-node cluster and had the following insights - I'd be interested if anyone has similar/dissimilar experience. The had 20 nodes had 8 cores each, and 32GB memory each. I set up Elasticsearch to have 15GB of that memory. The sample events I was using

Re: Benchmarks (again)

2014-03-24 Thread Mark Walkom
Can you elaborate what your cluster setup is like? Node specs (disk, RAM, CPU), how many master/data nodes and what version of ES and java you're running? Regards, Mark Walkom Infrastructure Engineer Campaign Monitor email: ma...@campaignmonitor.com web: www.campaignmonitor.com On 25 March