Re: Extremly slow troughput on large index

2014-04-22 Thread Yitzhak Kesselman
Pushing up... On Thursday, April 10, 2014 8:13:33 AM UTC+3, Yitzhak Kesselman wrote: > > I am using logstash 1.4.0, if I had understand correctly it uses > automatically the Bulk API. Do I miss something ? > Is there a limit on the size of an Index (on single node machine)? >

Re: Extremly slow troughput on large index

2014-04-09 Thread Yitzhak Kesselman
tant > Author of RavenDB in Action <http://manning.com/synhershko/> > > > On Wed, Apr 9, 2014 at 10:33 PM, Yitzhak Kesselman > > > wrote: > >> Attached the index rate (using bigdesk): >> <https://lh5.googleusercontent.com/-Jve-j75qB9o/U0WgK5ZMvMI/A

Re: Extremly slow troughput on large index

2014-04-09 Thread Yitzhak Kesselman
> >> >> 4. Can you try with embedded=false and see if it makes a difference? >> > Tried before was same behavior. > >> >> -- >> >> Itamar Syn-Hershko >> http://code972.com | @synhershko <https://twitter.com/synhershko> >> Freelan

Re: Extremly slow troughput on large index

2014-04-09 Thread Yitzhak Kesselman
tps://twitter.com/synhershko> > Freelance Developer & Consultant > Author of RavenDB in Action <http://manning.com/synhershko/> > > > On Wed, Apr 9, 2014 at 4:11 PM, Yitzhak Kesselman > > > wrote: > >> Hi, >> >> >

Extremly slow troughput on large index

2014-04-09 Thread Yitzhak Kesselman
Hi, I have configured a single node ES with logstash 1.4.0 (8GB memory) with the following configuration: - index.number_of_shards: 7 - number_of_replicas: 0 - refresh_interval: -1 - translog.flush_threshold_ops: 10 - merge.policy.

Re: Constantly increasing memory outside of Java heap

2014-04-08 Thread Yitzhak Kesselman
Hi, I have experienced same behavior when I have tried to load large amount of data... If you clear the file system cache (hereis a link to a tool), the memory drops to the defined heap size. However this is still looks as a wron