Re: Queue size

2015-02-25 Thread Christopher Bourez
OK, not very great that there is no timeout. It is indeed the search queue that goes to 1000 /_cat/thread_pool?v&h=id,host,suggest.active,suggest.rejected,suggest.completed,search.queue It is a request that breaks all the shards (no replica), because I only find one error in the log file (othe

Re: Queue Size limited?

2015-02-24 Thread Abid Hussain
n.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1@4a94944]] >> >> We didn't change any of the threadpools queue size settings (like >> threadpool.bulk.queue_size). AFAIK in this case the queue size is >> unlimited. &

Re: Queue size

2015-02-23 Thread joergpra...@gmail.com
Once a query is submitted, Elasticsearch will execute the query until it terminates. A query timeout only returns results prematurely, it does not cancel ongoing query threads on nodes. Jörg On Mon, Feb 23, 2015 at 11:48 AM, Christopher Bourez < christopher.bou...@gmail.com> wrote: > Ok for defa

Re: Queue Size limited?

2015-02-23 Thread joergpra...@gmail.com
ExecutionException[rejected execution (queue capacity 50) on > org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1@4a94944 > ]] > > We didn't change any of the threadpools queue size settings (like > threadpool.bulk.qu

Re: Queue size

2015-02-23 Thread Christopher Bourez
Ok for default replica number in index settings... sounds good index_indexing_slowlog and index_indexing_slowlog are void but errors appear in the main logs. let me find them next time But is there any way to put a timeout in the server on queries ? because I thought they would not last more th

Queue Size limited?

2015-02-23 Thread Abid Hussain
[EsRejectedExecutionException[rejected execution (queue capacity 50) on org.elasticsearch.action.support.replication.TransportShardReplicationOperationAction$AsyncShardOperationAction$1@4a94944]] We didn't change any of the threadpools queue size settings (like threadpool.bulk.queue_size). AFA

Re: Queue size

2015-02-22 Thread joergpra...@gmail.com
I assume search actions got stuck and block the subsequent ones, which results in the search queue filling up. Maybe the cause is printed in the server logs. Setting replica to 0 with just one node helps to fix the 15 shards/30 total shards count but that is an unrelated story. Jörg On Fri, Feb

Re: Queue size

2015-02-20 Thread Mark Walkom
It means your cluster is probably overloaded. Your missing shards are probably replicas, which will never be assigned with a one node cluster, head should show these. What is that massive spike right before the end of the graph? Are you also monitoring things like load and other OS level stats? O

Queue size

2015-02-20 Thread Christopher Bourez
I'm having the following problem : "SearchPhaseExecutionException[Failed to execute phase [query], all shards failed; shardFailures {[rlrweRJAQJqaoKfFB8il5A][stt_prod][3]: EsRejectedExecutionException[rejected execution (queue capacity 1000) on org.elasticsearch.action.search.type.TransportSea

Re: Queue Size 5000 exceeded error (Elastic Search Optimization)

2014-12-23 Thread joergpra...@gmail.com
.queue_size: 5000 threadpool.bulk.type: fixed >> threadpool.index.queue_size: 5000 threadpool.index.type: fixed >> >> These settings way too large and will bog down your system. >> >> Jörg >> >> >> >> On Tue, Dec 23, 2014 at 10:56 AM, nilesh makwan

Re: Queue Size 5000 exceeded error (Elastic Search Optimization)

2014-12-23 Thread nilesh makwana
pool.index.queue_size: 5000 threadpool.index.type: fixed > > These settings way too large and will bog down your system. > > Jörg > > > > On Tue, Dec 23, 2014 at 10:56 AM, nilesh makwana > wrote: > >> Here is elasticsearch.yml file for elasticsearch service. Logs a

Re: Queue Size 5000 exceeded error (Elastic Search Optimization)

2014-12-23 Thread joergpra...@gmail.com
10:56 AM, nilesh makwana wrote: > Here is elasticsearch.yml file for elasticsearch service. Logs are showing > queue size error as I told earlier. I don't have logs at time I first time > changed configurations. After that I am tweaking configurations to get > optimized servic

Re: Queue Size 5000 exceeded error (Elastic Search Optimization)

2014-12-23 Thread nilesh makwana
Here is elasticsearch.yml file for elasticsearch service. Logs are showing queue size error as I told earlier. I don't have logs at time I first time changed configurations. After that I am tweaking configurations to get optimized service. ᐧ On Mon, Dec 22, 2014 at 6:42 PM, joergpra...@gmai

Re: Queue Size 5000 exceeded error (Elastic Search Optimization)

2014-12-22 Thread joergpra...@gmail.com
web site which > is world wide event discovery portal.We use elasticsearch for search > operations. I am experiencing issues in elastic search, It stops working > randomly. Qbox client gives error "all shards failed". I looked up the > issue and increased thread pull queue s

Queue Size 5000 exceeded error (Elastic Search Optimization)

2014-12-22 Thread nilesh makwana
looked up the issue and increased thread pull queue size to 5000. Still server stops randomly. I test sever performance using Android Benchmark. Server can not handle 150 simultaneous request. It stops every time I run script using ab. What should I do? I except server to at least handle 1000

Re: best practice for thread pool queue size

2014-10-17 Thread Zaki Agha
Yes the particular error is from July. How can I determine the optimal setting for queue size? On Monday, October 13, 2014 3:21:32 PM UTC-7, Mark Walkom wrote: > > Increasing queues isn't going to help if there are underlying problems > stopping the processing. > > Based on t

Re: best practice for thread pool queue size

2014-10-13 Thread Mark Walkom
s the queue was full. > > Should we increase the default queue size? > > I understand that there are several queue's within elastic search. > > >1. > >Queues in Elastic Search >1. > > Index > > <http://www.elasticsearch.org/gu

best practice for thread pool queue size

2014-10-13 Thread Zaki Agha
Hi We have several elastic search clusters Recently we faced an issue in which one of our nodes experienced queueing. In fact, the queue length was greater than 1000. Subsequent requests were rejected as the queue was full. Should we increase the default queue size? I understand that there are

Re: Increasing thread pool / queue size.

2014-05-19 Thread Greg Murnane
You might also keep an eye on what your disk utilization is like when the search queue is filling up; CPU isn't the only possible bottleneck here. -- The information transmitted in this email is intended only for the person(s) or entity to which it is addressed and may contain confidential and

Re: Increasing thread pool / queue size.

2014-05-19 Thread Ivan Brusic
If search requests are being queued, then that means you probably do not have capacity for more concurrent searches. We are so many searches being queued? A temporary spike in search requests or are some expensive queries using up the existing threads? Try increasing the queue size and monitoring

Increasing thread pool / queue size.

2014-05-18 Thread jcm112388
rejected execution (queue capacity 1000) on org.elasticsearch.transport.netty.MessageChannelHandler$RequestHandler@10970469* My question is, is it safe to increase the thread pool and queue size as a solution? Is it necessary to increase both? If my thoughts are correct, increasing the size of the t