Re: Indexing issue - index get deleted

2015-06-11 Thread Alessandro Benedetti
Hi Chris, Amazing Analysis ! I did actually not investigated the log, because I was first trying to get more information from the user. "We are running full import and delta import crons . Fulll index once a day delta index : every 10 mins last night my index automatically deleted(numdocs=0).

Re: Indexing issue - index get deleted

2015-06-11 Thread Midas A
Thanks . for replying .. please find the data-config On Thu, Jun 11, 2015 at 6:06 AM, Chris Hostetter wrote: > > : The guys was using delta import anyway, so maybe the problem is > : different and not related to the clean. > > that's not what the logs say. > > Here's what i see... > > Log beg

Re: Indexing issue - index get deleted

2015-06-10 Thread Chris Hostetter
: The guys was using delta import anyway, so maybe the problem is : different and not related to the clean. that's not what the logs say. Here's what i see... Log begins with server startup @ "Jun 10, 2015 11:14:56 AM" The DeletionPolicy for the "shopclue_prod" core is initialized at "Jun 10,

Re: Indexing issue - index get deleted

2015-06-10 Thread Alessandro Benedetti
Just taking a look to the code : " if (requestParams.containsKey("clean")) { clean = StrUtils.parseBool( (String) requestParams.get("clean"), true); } else if (DataImporter.DELTA_IMPORT_CMD.equals(command) || DataImporter.IMPORT_CMD.equals(command)) { clean = false; } else { clean = debug ?

Re: Indexing issue - index get deleted

2015-06-10 Thread Upayavira
I was only speaking about full import regarding the default of clean=true. However, looking at the source code, it doesn't seem to differentiate especially between a full and a delta in relation to the default of clean=true, which would be pretty crappy. However, I'd need to try it. Upayavira On

Re: Indexing issue - index get deleted

2015-06-10 Thread Alessandro Benedetti
Wow, Upaya, I didn't know that clean was default=true in the delta import as well! I did know it was default in the full import, but I agree with you that having a default to true for delta import is very dangerous ! But assuming the user was using the delta import so far, if cleaning every time,

Re: Indexing issue - index get deleted

2015-06-10 Thread Alessandro Benedetti
Let me answer in line, to get more info : 2015-06-10 10:59 GMT+01:00 Midas A : > Hi Alessandro, > > Please find the answers inline and help me out to figure out this problem. > > 1) Solr version : *4.2.1* > 2) Solr architecture :* Master -slave/ Replication with requestHandler* > > Where happene

Re: Indexing issue - index get deleted

2015-06-10 Thread Upayavira
Note the clean= parameter to the DIH. It defaults to true. It will wipe your index before it runs. Perhaps it succeeded at wiping, but failed to connect to your database. Hence an empty DB? clean=true is, IMO, a very dangerous default option. Upayavira On Wed, Jun 10, 2015, at 10:59 AM, Midas A

Re: Indexing issue - index get deleted

2015-06-10 Thread Midas A
Hi Alessandro, Please find the answers inline and help me out to figure out this problem. 1) Solr version : *4.2.1* 2) Solr architecture :* Master -slave/ Replication with requestHandler* 3) Kind of data source indexed : *Mysql * 4) What happened to the datasource ? any change in there ? : *No c

Re: Indexing issue - index get deleted

2015-06-10 Thread Alessandro Benedetti
Let me try to help you, first of all I would like to encourage people to post more information about their scenario than "This is my log, index deleted, help me" :) This kind of Info can be really useful : 1) Solr version 2) Solr architecture ( Solr Cloud ? Solr Cloud configuration ? Manual Shard