Re: High disk write usage

2017-07-11 Thread Antonio De Miguel
Thanks Shawn! I will try to change the values of those parameters 2017-07-10 14:57 GMT+02:00 Shawn Heisey : > On 7/10/2017 2:57 AM, Antonio De Miguel wrote: > > I continue deeping inside this problem... high writing rates continues. > > > > Searching in logs i see this: > > > > 2017-07-10 08:

Re: High disk write usage

2017-07-10 Thread Shawn Heisey
On 7/10/2017 2:57 AM, Antonio De Miguel wrote: > I continue deeping inside this problem... high writing rates continues. > > Searching in logs i see this: > > 2017-07-10 08:46:18.888 INFO (commitScheduler-11-thread-1) [c:ads s:shard2 > r:core_node47 x:ads_shard2_replica3] o.a.s.u.LoggingInfoStrea

Re: High disk write usage

2017-07-10 Thread Antonio De Miguel
>> > thanks Markus! >> >> > >> >> > We already have SSD. >> >> > >> >> > About changing topology we probed yesterday with 10 shards, but >> >> system >> >> > goes more inconsisten

Re: High disk write usage

2017-07-05 Thread Antonio De Miguel
gt;> > why... too many traffic perhaps? > >> > > >> > About merge factor.. we set default configuration for some days... but > >> when > >> > a merge occurs system overload. We probed with mergefactor of 4 to > >> improbe > >> > query times and

Re: High disk write usage

2017-07-05 Thread Erick Erickson
; improbe >> > query times and trying to have smaller merges. >> > >> > 2017-07-05 16:51 GMT+02:00 Markus Jelsma : >> > >> >> Try mergeFactor of 10 (default) which should be fine in most cases. If >> you >> >> got an extreme case, eith

Re: High disk write usage

2017-07-05 Thread Antonio De Miguel
have smaller merges. > > > > 2017-07-05 16:51 GMT+02:00 Markus Jelsma : > > > >> Try mergeFactor of 10 (default) which should be fine in most cases. If > you > >> got an extreme case, either create more shards and consider better > hardware > >> (SS

Re: High disk write usage

2017-07-05 Thread Erick Erickson
De Miguel >> > Sent: Wednesday 5th July 2017 16:48 >> > To: solr-user@lucene.apache.org >> > Subject: Re: High disk write usage >> > >> > Thnaks a lot alessandro! >> > >> > Yes, we have very big physical dedicated machines, with a t

Re: High disk write usage

2017-07-05 Thread Antonio De Miguel
ds and consider better hardware > (SSD's) > > -Original message- > > From:Antonio De Miguel > > Sent: Wednesday 5th July 2017 16:48 > > To: solr-user@lucene.apache.org > > Subject: Re: High disk write usage > > > > Thnaks a lot alessandro! &

RE: High disk write usage

2017-07-05 Thread Markus Jelsma
.org > Subject: Re: High disk write usage > > Thnaks a lot alessandro! > > Yes, we have very big physical dedicated machines, with a topology of 5 > shards and10 replicas each shard. > > > 1. transaction log files are increasing but not with this rate > > 2.  we

Re: High disk write usage

2017-07-05 Thread Antonio De Miguel
h based on whichever limit is hit first. > > 100 > 1000 > > > > > - > --- > Alessandro Benedetti > Search Consultant, R&D Software Engineer, Director > Sease Ltd. - www.sease.io > -- > View this message in context: http://lucene.472066.n3. > nab

Re: High disk write usage

2017-07-05 Thread alessandro.benedetti
this message in context: http://lucene.472066.n3.nabble.com/High-disk-write-usage-tp4344356p4344386.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: High disk write usage

2017-07-05 Thread alessandro.benedetti
High-disk-write-usage-tp4344356p4344383.html Sent from the Solr - User mailing list archive at Nabble.com.

High disk write usage

2017-07-05 Thread Antonio De Miguel
Hi, We are implementing a solrcloud cluster (6.6 version) with NRT requisites. We are indexing 600 docs/sec with 1500 docs/sec peaks, and we are serving about 1500qps. Our documents has 300 fields with some doc values, about 4kb and we have 3 million of documents. HardCommit is set to 15 minutes