deploying ElasticSearch to a large memory server

2015-04-21 Thread Tzahi jakubovitz
Hi all, I have a server with 1.5 TB memory. I can either use it with a single ES process, or launch few separate instances (using either VM, docker, or just different ports on the same server OS). What will be a reasonable number of instances for such a server ? Thanks, Tzahi -- You received

selecting a server - a single quad socket, or two dual socket

2015-04-21 Thread Tzahi jakubovitz
Today we can buy very performant servers at very reasonable price points. e.g. – the price of two dual socket servers with 512 GB memory is comparable to a single quad socket server with 1024 GB (1 TB) memory. (Assuming same number of cores and MHz on each CPU) My gut feeling is that a singl

Re: is it possible to get query results from document values ?

2014-11-25 Thread Tzahi jakubovitz
> > > Thanks so much. But the answer is very frustrating. Getting large result sets will always be slow - even if I need just a single field. Only aggregations and facets enjoy document fields - we commoners need to dig our fields from the *.fdt file. Bugger – and thanks again -- You

is it possible to get query results from document values ?

2014-11-25 Thread Tzahi jakubovitz
Hi all, I need to query an index with tens of millions of short documents. The result set may contain > 100,000 documents, and I need to process a single field from each document. It those are simple stored fields in *.fdt file - it will take forever +-. I thought document values will ans

Re: scan query that returns document values only is heavily accessing the *.FDT file .

2014-11-24 Thread Tzahi jakubovitz
Thanks Sorry - I did not stress this is *document* values and not *field* values. Document values are stores in DVD file. which is small, compressed format. I defined it to avoide having to access and parse the lucene document from the huge FDT file (in my test- FDT file is 1000 times bigger tha

scan query that returns document values only is heavily accessing the *.FDT file .

2014-11-23 Thread Tzahi jakubovitz
Hi all, I have a tests index with 43 million documenst. there is a string document value for each document. (about 5-10 character value for each document) Mapping is: { "myindex" : { "mappings" : { "num_type" : { "_type" : { "store" : true },

Re: has-child query question

2014-04-03 Thread Tzahi jakubovitz
Thanks so much. I have many small child documents (well - actually records) for each parent - so nested objects will cause all child documents to re-index with each new child. So the only difference between a has_child query and filter is that the query allows you to influence the score?

has-child query question

2014-04-03 Thread Tzahi jakubovitz
Hi All, When my query contains a has-child query - can I get the child documents as part of their parent documents? Thanks -- You received this message because you are subscribed to the Google Groups "elasticsearch" group. To unsubscribe from this group and stop receiving emails from it, send

Retrieving parent document according to relations between child documents

2014-03-30 Thread Tzahi jakubovitz
I am new to ES – so, please bear with me. My data model is parent-child relationship. The parent document contains attributes of people. The child document contains time and location for that person. In a relational model, it would look like: Create Table Parent ( personId i