Re: Elastic Search deleting some files while indexing?

2014-02-07 Thread ZenMaster80
Thanks David, I had duplicates like you mentioned. On Friday, February 7, 2014 12:23:01 PM UTC-5, David Pilato wrote: > > I understood that's a new index. > It does not mean that in your insert script you don't have duplicate IDs. > > I would first check my documents. > > BTW elasticsearch does no

Re: Elastic Search deleting some files while indexing?

2014-02-07 Thread ZenMaster80
Sorry, I misunderstood the first time. It makes sense, I will take a look. On Friday, February 7, 2014 12:23:01 PM UTC-5, David Pilato wrote: > > I understood that's a new index. > It does not mean that in your insert script you don't have duplicate IDs. > > I would first check my documents. > > B

Re: Elastic Search deleting some files while indexing?

2014-02-07 Thread David Pilato
I understood that's a new index. It does not mean that in your insert script you don't have duplicate IDs. I would first check my documents. BTW elasticsearch does not delete documents unless you set _ttl. --  David Pilato | Technical Advocate | Elasticsearch.com @dadoonet | @elasticsearchfr L

Re: Elastic Search deleting some files while indexing?

2014-02-07 Thread ZenMaster80
No, because it is a totally new index. I tried it several times, deleted the index, then created/indexed. On Friday, February 7, 2014 10:27:24 AM UTC-5, David Pilato wrote: > > May be you updated 50 docs (same ID)? > > -- > *David Pilato* | *Technical Advocate* | *Elasticsearch.com* > @dadoonet

Re: Elastic Search deleting some files while indexing?

2014-02-07 Thread David Pilato
May be you updated 50 docs (same ID)? --  David Pilato | Technical Advocate | Elasticsearch.com @dadoonet | @elasticsearchfr Le 7 février 2014 at 15:58:15, ZenMaster80 (sabdall...@gmail.com) a écrit: I am indexing about 5000 documents, when indexing is done, I use "HEAD" plugin, it says it ind

Elastic Search deleting some files while indexing?

2014-02-07 Thread ZenMaster80
I am indexing about 5000 documents, when indexing is done, I use "HEAD" plugin, it says it indexed 4950 docs and deleted 50 files, also verified by curl that only 4950 indexed. I couldn't see anything in the logs, but how/when/why does Elasticsearch decide to delete some of the docs? -- You re