Re: Indexing and Disk Writes

2016-11-04 Thread Andrew Dinsmore
e pretty dramatic though, that may well be > where much of this is coming from. > > Best, > Erick > > On Fri, Nov 4, 2016 at 8:51 AM, Andrew Dinsmore <acdinsm...@gmail.com> > wrote: > > We are using Solr 5.4 to index TBs of documents in a bulk fashion to get > > the

Indexing and Disk Writes

2016-11-04 Thread Andrew Dinsmore
We are using Solr 5.4 to index TBs of documents in a bulk fashion to get the cluster up and running. Indexing is over HTTP round robin as directed by zookeeper. Each of the 13 nodes is receiving about 6-8 MB/s on the NIC but solr is writing around 20 to 25 thousand times per second (4k block