Kibana3 causing high cpu loads on ES

2015-05-22 Thread Kellan Strong
Hi all, I recently been having my cluster CPUs usage going to 100% on a 4 Node cluster for a while now. Load averages were in the 20s across all 4 nodes which is not good. I did a curl "localhost:9200/_nodes/stats/http?pretty" My fluent host is a client node and hosts kibana3 and from this it

Timeouts ignored in multisearch?

2015-05-22 Thread Mike Sukmanowsky
Hi all, We're doing an analysis of our slow queries (via slowlog) and noticing that any queries made with msearch seem to ignore the timeout parameter. We've tried passing it three ways: GET my_index/_msearch?timeout=100 {} {big aggregation query} and GET my_index/_msearch {"timeout": 100}

Re: Shard query cache size

2015-05-22 Thread Mike Sukmanowsky
Thanks for the responses guys. We have an ES setup so that we have: hot, warm and cold ES nodes. Hot nodes are the only ones receiving realtime updates and have refresh intervals fairly low for indices there thus making a query cache pretty useless for data there. Indices on warm nodes on the

Re: wildcard indices patterns on closed indices gives IndexClosedException

2015-05-22 Thread John Bush
Nevermind it was actually an alias causing the issue. On Fri, May 22, 2015 at 7:39 AM, John Bush wrote: > If I do a search like this and that index pattern has a closed index: > > http://custer.s03.filex.com/fps-invs_672dd3cb-f529-4aaa-b10c-8b5076591eb3*/_search > > I get this: > > IndexClosedExc

Are there any comprehensive documents which describe the detailed process of document indexing and searching?

2015-05-22 Thread Shih-Peng Lin
Although I have read a lot of guides and articles, there seems still something I missed in understanding the process of document indexing and searching. I would like to know if there are any comprehensive documents which describe the process very detailly? For example, the document indexing pro

Re: Highlighting doesn't work on numeric and date fields

2015-05-22 Thread Vineet Saju
Any luck with this? I'm facing the same problem On Monday, February 24, 2014 at 9:45:47 PM UTC-6, Preeti Jain wrote: > > Thanks for your response. > I have to use numeric and date fields in range queries so the string field > of mutli-field will not work. > Any other thought? > > On Friday, Febru

Re: SHIELD terms lookup filter : AuthorizationException BUG

2015-05-22 Thread Jay Modi
HI Steve, I think we should move this to a new thread as it is probably a different issue. May I suggest moving this to our new discussion forum with a section specifically for Shield https://discuss.elastic.co/c/shield if you have any followups to my response below? To get you some help and o

wildcard indices patterns on closed indices gives IndexClosedException

2015-05-22 Thread John Bush
If I do a search like this and that index pattern has a closed index: http://custer.s03.filex.com/fps-invs_672dd3cb-f529-4aaa-b10c-8b5076591eb3*/_search I get this: IndexClosedException[[fps-invs_672dd3cb-f529-4aaa-b10c-8b5076591eb3_2014-12] closed] shouldn't a search ignore closed indices ? T

Re: Doc Values vs Field Data Questions

2015-05-22 Thread Robert Muir
On Fri, May 22, 2015 at 10:02 AM, Matt Traynham wrote: > Thanks for the clarification Adrien. If that's the case, is there such a > flag that can enable them by default for all fields (excluding non-analyzed > strings; using ~1.4.3 here)? > > Also, do you guys have more performance metrics on us

Re: Query pre-processing before execution?

2015-05-22 Thread Paolo Ciccarese
Hi Otis, did you find a good way to do this? I have a similar need and I was wondering what would be the best way to do automatically add a filter for each query. In my case that filter will take care of the access restriction at the document level according to the access model provided by Apach

Re: Doc Values vs Field Data Questions

2015-05-22 Thread Matt Traynham
Thanks for the clarification Adrien. If that's the case, is there such a flag that can enable them by default for all fields (excluding non-analyzed strings; using ~1.4.3 here)? Also, do you guys have more performance metrics on using Doc Values vs FDC? I've seen the "10-25%" slower value thr

Re: I dont get results for plurals if I use Snowball

2015-05-22 Thread Vishal Sharma
I see its an issue with match: _all query. Cant we get analyzer work with _all query? Any help is appreciated. *Vishal Sharma* *Team Leader, SFDC*T: +1 30­4 636 7373 E: vish...@grazitti.com www.grazitti.com [image: Description: LinkedIn] [ima

{index_name}/{shard_id}/_state directory is missing and {index_name}/{shard_id}/index directory is empty (all index files are gone) after a few nodes were restarted at the same time

2015-05-22 Thread Lee Chuen Ooi
Hi, I am using ElasticSearch version 1.5.0. Our ElasticSearch cluster has 8 shards with 1 replica, hosted on 7 data nodes + 1 master node with setting below: gateway.recover_after_nodes: 4 gateway.recover_after_time: 5m gateway.expected_nodes: 6 After a few nodes were restarted at the same time

I dont get results for plurals if I use Snowball

2015-05-22 Thread Vishal Sharma
Hi, I want to configure elastic for plurals so that searching for "blog" and "blogs" return same results. I found on internet that the way to go is to use Snowball analyzer. When I use Snowball I get same results for both "blog" and "blogs". But, the results which used to come for "blogs" without

Re: Searching on exponent numbers

2015-05-22 Thread joergpra...@gmail.com
This is a long unresolved issue. One solution would be adding BigDecimal support. See for example https://github.com/elastic/elasticsearch/pull/5683 Jörg On Fri, May 22, 2015 at 8:20 AM, Craig Berry wrote: > Hi there, > > I want to be able to provide a text search against a document that > co