RE: Heavy indexing cause severe delay for searching

2015-01-23 Thread Wang Yong
ES will send one query request to each shard when query on this index. So, if the number of shard is too big, the number of query request will also be too big to use up all query threads. From: elasticsearch@googlegroups.com [mailto:elasticsearch@googlegroups.com] On Behalf Of Hajime S

elk cluster plan with 7000EPS an 100/s search

2014-12-16 Thread Wang Yong
Hi folks, I am building an elk cluster to index and search lots of http access log, about more than 7000Event per second and also there will be more than 100 cocurrent searchs. I have 2 machines. One of them has 24 cpu cores, 64G memory and 2T sata disk(no raid). The other one is much pow

RE: term filter failed on very long fields

2014-11-12 Thread Wang Yong
Hi all, is there any comment on this issues, is this a bug of elasticsearch. This is really a big problem for me cause we have to query on this big long field! thank you! Wang From: Wang Yong [mailto:cnwangy...@gmail.com] Sent: Monday, November 10, 2014 5:33 PM To: elasticsearch

RE: term filter failed on very long fields

2014-11-10 Thread Wang Yong
ou disable analyzer and try again . Thanks Vineeth On Mon, Nov 10, 2014 at 2:07 PM, Wang Yong mailto:cnwangy...@gmail.com> > wrote: Hi folks, I was trying to do a term filter on a very long string field, maybe more then 500 bytes, but I got 0 hit. So, I am wondering i

term filter failed on very long fields

2014-11-10 Thread Wang Yong
Hi folks, I was trying to do a term filter on a very long string field, maybe more then 500 bytes, but I got 0 hit. So, I am wondering if there is a limitation on the length of field while using term filter. The elasticsearch is 1.3.0 with the map like this : curl -XPUT 'http://localhost:92

Re: index size impact on search performance?

2014-08-01 Thread Wang Yong
of strings. Cache is not used. Try with something like "from":"2014-06-01","to":"2015-01-01" for example. Or explicitly set cache to true. -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 1 août 2014 à 06:25, Wang Yong

Re: index size impact on search performance?

2014-07-31 Thread Wang Yong
ugust 2014 12:43, David Pilato wrote: Well. I guess it depends on your query. What does it look like? -- David ;-) Twitter : @dadoonet / @elasticsearchfr / @scrutmydocs Le 1 août 2014 à 04:14, "Wang Yong" a écrit : Hi folks, I have an index storing lots of time serial dat

Re: index size impact on search performance?

2014-07-31 Thread Wang Yong
ical": { "field": "val" } } } } Sent from Surface From: David Pilato Sent: ‎Friday‎, ‎August‎ ‎1‎, ‎2014 ‎10‎:‎43‎ ‎AM To: elasticsearch@googlegroups.com Well. I guess it depends on your query. What does it look like? -- David

index size impact on search performance?

2014-07-31 Thread Wang Yong
Hi folks, I have an index storing lots of time serial data. The data are put into index by : curl -XPUT 'localhost:9200/testindex/action1/1?pretty' -d ' { "val": 23, "timestamp": 1406822400 }' And the only thing I search in this index is histogram facet in a very short time rang

RE: best practice wanted for huge number of index time serial data

2014-07-16 Thread Wang Yong
Thank you Mark, if I use daily index, I have to specify multiple indexes based on the time range. That will make my service a little more complicate. So I am wondering, even if I put all data in one huge index, as long as I limit the time range in my query, it looks like es will locate the data