Re: Questions about dedicated master client node

2015-05-31 Thread Xudong You
at 9:11 AM, Xudong You xudon...@gmail.com javascript: wrote: Thanks Nikolas, How do you think about dedicated client node (the so called load balance node)? Any benefit of dedicated client node? Seems to me, round robin to data nodes is good enough. On Friday, May 29, 2015 at 10:55:01 PM

Re: Questions about dedicated master client node

2015-05-30 Thread Xudong You
but its not a huge problem. On Fri, May 29, 2015 at 10:44 AM, Xudong You xudon...@gmail.com javascript: wrote: Right now we only need 4 ES nodes due to the small data volume, and all 4 nodes are master data nodes. Q1: I am wondering in this case, is it necessary to have dedicated master

Questions about dedicated master client node

2015-05-29 Thread Xudong You
Right now we only need 4 ES nodes due to the small data volume, and all 4 nodes are master data nodes. Q1: I am wondering in this case, is it necessary to have dedicated master and client node? Any benefit of having dedicated master node? Some one said that dedicated master nodes (say, three

Re: How to response null value fields when query using fields

2015-05-27 Thread Xudong You
}} { tags : null } { index: { _id: 5 }} { tags : [search, null] } GET /my_index/_search GET /my_index/_search { fields: [ tags ], query: { match_all: {}} } On 26 May 2015 at 09:33, Xudong You xudon

Is it possible to change the score mode of SHOULD clause?

2015-05-26 Thread Xudong You
For example I have following 2 documents: {id:1, title:elasticsearch, description:elasticsearch } {id:1, title:elasticsearch, description:bing } And following query: { query : { bool: { should: [ { match: { title: {

Re: How to response null value fields when query using fields

2015-05-26 Thread Xudong You
for that document it doesn''t exist Have a look at this https://www.elastic.co/guide/en/elasticsearch/guide/current/_dealing_with_null_values.html On 26 May 2015 at 08:11, Xudong You xudon...@gmail.com javascript: wrote: I used fields to limit only return selected fields: { fields : [Title

How to response null value fields when query using fields

2015-05-26 Thread Xudong You
I used fields to limit only return selected fields: { fields : [Title, Price], query :{ ... } } The Price fields might be null for some of the documents, I found that only when Price field value is NOT null, it is returned in ES response, otherwise, it is missing in response. But if I remove

Re: More memory or more CPU cores help better performance?

2015-04-30 Thread Xudong You
, Apr 30, 2015 at 7:56 AM, Xudong You xudon...@gmail.com javascript: wrote: Thanks! So per your experience, is Elasticsearch query more CPU-bound or IO-bound? Anyway, I will do more perf testing with real data on different VMs to find out the best CPU Memory combination for my case

Re: More memory or more CPU cores help better performance?

2015-04-29 Thread Xudong You
of performance you mean? - mimimal response time for a single query - maximum throughput for all queries For maximum performance, all kind of virtual machines are a bad choice in comparison to physical machines in your own data center. Jörg On Wed, Apr 29, 2015 at 4:17 AM, Xudong You xudon

Re: Is external Load Balance useful?

2015-04-29 Thread Xudong You
to the nodes with the shards it needs, distributing the initial query load across multiple nodes means that you don't have a single node that has to deal with all the indexing and querying results from the end users/clients. On 29 April 2015 at 17:12, Xudong You xudon...@gmail.com javascript

Re: More memory or more CPU cores help better performance?

2015-04-29 Thread Xudong You
in public virtual machines because there are many others using the same resources at the the same time in an unpredictable way. Jörg On Wed, Apr 29, 2015 at 11:02 AM, Xudong You xudon...@gmail.com javascript: wrote: I want better maximum throughput for all queries. As for VM vs Physical

Re: Need suggestion: How to boost specific documents for a given search term

2015-04-29 Thread Xudong You
Any one has good suggestion? On Tuesday, April 28, 2015 at 11:01:40 PM UTC+8, Xudong You wrote: Hi ES experts, I need your help on index design for a real scenario. It might be a long question, let me try explain it as concise as possible. We are building a search engine to provide site

Is it possible to update nested field by query?

2015-04-29 Thread Xudong You
hi, I am using update by query plugin (https://github.com/yakaz/elasticsearch-action-updatebyquery/) to update documents by query. In my case, there is nested field in document, the mapping is something like this: mappings : { mytype : { properties : { Myfield1 : {

More memory or more CPU cores help better performance?

2015-04-28 Thread Xudong You
hi, I am building ES on cloud Virtual machines, the cloud platform provides different tier VMs to choose, say, 4 CPU cores, 28G memory, or 8 CPU cores, 14G memory etc. Different kind VM has different cost. To save our cost, I want to choose the VM whose cost not exceed our budget and has best

Need suggestion: How to boost specific documents for a given search term

2015-04-28 Thread Xudong You
Hi ES experts, I need your help on index design for a real scenario. It might be a long question, let me try explain it as concise as possible. We are building a search engine to provide site search for our customers, the document in index could be something like this: {

What web server Elasticsearch use on windows?

2015-04-22 Thread Xudong You
I deployed ES on my machine and can access via HTTP url, but I did not install IIS on my windows machine yet, so what web server does Elasticsearch use on windows? -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group

What web server does Elasticsearch use on Windows?

2015-04-22 Thread Xudong You
I deployed my ES on windows machine and can access it via HTTP request, but I did not install IIS yet, so what web server does ES used by default on windows? -- You received this message because you are subscribed to the Google Groups elasticsearch group. To unsubscribe from this group and

Re: How to configure max file descriptors on windows OS?

2015-04-20 Thread Xudong You
Thanks Mark! On Friday, April 17, 2015 at 6:22:24 AM UTC+8, Mark Walkom wrote: -1 means unbound, ie unlimited. On 16 April 2015 at 20:54, Xudong You xudon...@gmail.com javascript: wrote: Anyone knows how to change the max_file_descriptors on windows? I built ES cluster on Windows and got

Head shows incorrect docs count if nested type field is defined in mapping

2015-04-16 Thread Xudong You
I was confused by the docs count value displaying in head plugin if there is nest type field define in mapping For example, I created a new index with following mapping: { mappings : { doc : { properties : { QueryClicks : { type :

How to configure max file descriptors on windows OS?

2015-04-16 Thread Xudong You
Anyone knows how to change the max_file_descriptors on windows? I built ES cluster on Windows and got following process information: max_file_descriptors : -1, open_file_descriptors : -1, What does “-1 mean? Is it possible to change the max file descriptors on windows platform? -- You received

Re: Head shows incorrect docs count if nested type field is defined in mapping

2015-04-16 Thread Xudong You
Thanks Glen! On Friday, April 17, 2015 at 11:14:36 AM UTC+8, Glen Smith wrote: Go to the browser tab and select the type. That will show the count you are looking for. On Thursday, April 16, 2015 at 10:44:29 PM UTC-4, Xudong You wrote: Just figured out that the doc count is actually

Re: Head shows incorrect docs count if nested type field is defined in mapping

2015-04-16 Thread Xudong You
-in. Is there anyway let head just show the doc count, regarding if the doc has nested field or not. On Thursday, April 16, 2015 at 5:36:04 PM UTC+8, Xudong You wrote: I was confused by the docs count value displaying in head plugin if there is nest type field define in mapping For example, I

Re: Head shows incorrect docs count if nested type field is defined in mapping

2015-04-16 Thread Xudong You
BTW: If I just remove the type:nested from the mapping, the doc count then is correct after insert one document. Anyone has suggestions resolve this issue? On Thursday, April 16, 2015 at 5:36:04 PM UTC+8, Xudong You wrote: I was confused by the docs count value displaying in head plugin

Re: How does Elasticsearch calculate the field-length norm?

2015-03-29 Thread Xudong You
://lucene.apache.org/core/4_10_2/core/org/apache/lucene/search/similarities/DefaultSimilarity.html http://lucene.apache.org/core/4_10_2/core/index.html Masaru On March 26, 2015 at 14:36:45, Xudong You (xudon...@gmail.com javascript:) wrote: Per this post theory behind relevance scoring

How does Elasticsearch calculate the field-length norm?

2015-03-25 Thread Xudong You
Per this post theory behind relevance scoring http://www.elastic.co/guide/en/elasticsearch/guide/current/scoring-theory.html Elasticsearch calculate the field-length norm as follows: norm(d) = 1 / √numTerms But per my testing, seems the actual result value calculated does not meet above

Re: Help me understand how ES calculate the score to match query

2015-03-10 Thread Xudong You
elasticsearch calculates score: { explain: true, query: { match: { title: xbox } } } On Tuesday, March 10, 2015 at 3:15:50 PM UTC+7, Xudong You wrote: I have two documents as follows: 1. { title:xbox } 2. { title:xbox xbox xbox } Then I search the documents with following query

Re: Help me understand how ES calculate the score to match query

2015-03-10 Thread Xudong You
in) maxDocs reflects the total number of documents on this shard Third maxDocs (and docFreq) do not reflect deletions. Lastly, I presume you can find the documents you think you're adding in the index? Hope that helps -Doug On Tue, Mar 10, 2015 at 9:46 PM, Xudong You xudon...@gmail.com

Help me understand how ES calculate the score to match query

2015-03-10 Thread Xudong You
I have two documents as follows: 1. { title:xbox } 2. { title:xbox xbox xbox } Then I search the documents with following query: { query:{match:{title:xbox}} } ES returns result as follows: {took:133,timed_out:false,_shards:{total:5,successful:5,failed:0},hits:{total:2,max_score:0.30685282,

Ask for suggestion on what analyzer to use

2015-02-27 Thread Xudong You
I have document like this: {Title:This is my test title} This question was asked before, but my reply to the original post was never accepted by the mailing list. So, sorry to re-ask same question again on a new post. I want to return the doc with exactly matched title, but allowing case

How to configure similarity algorithm on index or type level?

2015-02-27 Thread Xudong You
Per ES guide, we can configure similarity on a field in mapping setting like this: { book : { properties : { title : { type : string, similarity : my_similarity } } } Is this possible to configure the similarity on index or type level so that don't have to configure the

Re: Ask for suggestion on what analyzer to use

2015-02-27 Thread Xudong You
| @elasticsearchfr https://twitter.com/elasticsearchfr | @scrutmydocs https://twitter.com/scrutmydocs Le 27 févr. 2015 à 10:40, Xudong You xudon...@gmail.com javascript: a écrit : I have document like this: {Title:This is my test title} This question was asked before, but my reply

How to get the days since some time using groovy script?

2015-02-10 Thread Xudong You
Say, I have a field with date type, I know I can get the total million seconds of the date since the epoch by doc['date'].date.getMillis(), but is there a function to get the total days directly? -- You received this message because you are subscribed to the Google Groups elasticsearch group.

Ask for suggestion on what analyzer to use

2015-02-08 Thread Xudong You
I have document like this: {Title:This is my test title} I want to return the doc with exactly matched title, but allowing case insensitive and redundant white space between words. That is, all of these queries: this is my test TITLE, this is my test title and this is my test