Re: scan query that returns document values only is heavily accessing the *.FDT file .

2014-11-24 Thread joergpra...@gmail.com
Doc values are stored in the .fdt files. Jörg On Sun, Nov 23, 2014 at 11:52 PM, Tzahi jakubovitz tza...@hotmail.com wrote: Hi all, I have a tests index with 43 million documenst. there is a string document value for each document. (about 5-10 character value for each document) Mapping is:

Re: scan query that returns document values only is heavily accessing the *.FDT file .

2014-11-24 Thread Tzahi jakubovitz
Thanks Sorry - I did not stress this is *document* values and not *field* values. Document values are stores in DVD file. which is small, compressed format. I defined it to avoide having to access and parse the lucene document from the huge FDT file (in my test- FDT file is 1000 times bigger

Re: scan query that returns document values only is heavily accessing the *.FDT file .

2014-11-24 Thread joergpra...@gmail.com
Oh, sorry. Yess, doc values are in .dvd files. I assume that ES still puts hidden type and uid field in .fdt. But I'm also surprised, there should be not much disk access for that. Jörg On Mon, Nov 24, 2014 at 10:04 AM, Tzahi jakubovitz tza...@hotmail.com wrote: Thanks Sorry - I did not

scan query that returns document values only is heavily accessing the *.FDT file .

2014-11-23 Thread Tzahi jakubovitz
Hi all, I have a tests index with 43 million documenst. there is a string document value for each document. (about 5-10 character value for each document) Mapping is: { myindex : { mappings : { num_type : { _type : { store : true },