Lucene indexing speed on NVMe drive

2015-04-30 Thread Anahita Shayesteh-SSI
Hi. I am studying Lucene performance and in particular how it benefits from faster I/O such as SSD and NVMe. I am using nightlybench for indexing wiki (1K docs) with similar parameters as used in nightlyBench. (Hardware: Intel Xeon, 2.5GHz, 20 processor ,40 with hyperthreading, 64G Memory) and s

Re: Lucene indexing speed on NVMe drive

2015-04-30 Thread Chris Hostetter
: Hi. I am studying Lucene performance and in particular how it benefits from faster I/O such as SSD and NVMe. : parameters as used in nightlyBench. (Hardware: Intel Xeon, 2.5GHz, 20 : processor ,40 with hyperthreading, 64G Memory) and study indexing speed ... : I get best performance

RE: Lucene indexing speed on NVMe drive

2015-04-30 Thread Anahita Shayesteh-SSI
AM To: java-user@lucene.apache.org Cc: Anahita Shayesteh-SSI Subject: Re: Lucene indexing speed on NVMe drive : Hi. I am studying Lucene performance and in particular how it benefits from faster I/O such as SSD and NVMe. : parameters as used in nightlyBench. (Hardware: Intel Xeon, 2.5GHz, 20 : proc

Re: Lucene indexing speed on NVMe drive

2015-05-01 Thread Michael McCandless
Hyper-threading should help Lucene indexing go faster, when it's not IO bound ... I found 20 threads (on 12 real cores, 24 with HT) to be fastest in the nightly benchmark (http://people.apache.org/~mikemccand/lucenebench/indexing.html). But it's curious you're unable to saturate one of CPU or IO,