Re: SOLR Indexed object delete automatically.
Are you using Data Import Handler (DIH?)? The "clean" option there removes all the docs before running. If not, then _someone_ is sending that command, Solr isn't generating it by itself. Best, Erick On Mon, Apr 24, 2017 at 12:35 PM, Saurav Maulickwrote: > No David. this is not in public domain. I have asked server team to check > incoming traffic IP also but they didn't find any thing. > > On Mon, Apr 24, 2017 at 3:28 PM, David Hastings < > hastings.recurs...@gmail.com> wrote: > >> you dont have to log in to the server to send the delete command. is the >> computers ip address public? >> >> >> On Mon, Apr 24, 2017 at 3:13 PM, Saurav Maulick >> wrote: >> >> > thanks Erick for quick replay. >> > >> > I the log file we have found that deleteByQuery entry. but i have checked >> > with windows team they have confirmed no one login the server on that >> time. >> > >> > see the log entry >> > >> > 2017-04-22 03:56:24.452 INFO >> > (coreZkRegister-1-thread-1-processing-n:XX.XX.XX.XX:1988_solr >> > x:ocdsolr_shard2_replica1 s:shard2 c:ocdsolr r:core_node1) [c:ocdsolr >> > s:shard2 r:core_node1 x:ocdsolr_shard2_replica1] >> > o.a.s.u.p.LogUpdateProcessorFactory [ocdsolr_shard2_replica1] >> > {add=[10697.45745.12329.21333 (1565267805698260992), >> > 10697.45745.11554.26776 (1565275671771480064), 10697.45745.13844.32189 >> > (1565282977827520512)],deleteByQuery=*:* (-1565280896874971136)} 0 2353 >> > >> > On Mon, Apr 24, 2017 at 2:35 PM, Erick Erickson > > >> > wrote: >> > >> > > Solr does not delete files/documents by itself with the exception of >> > > TTL (Time To Live, since Solr 4.8. See: >> > > https://lucidworks.com/2014/05/07/document-expiration/). >> > > >> > > so unless you've configured TTL, which I doubt you have if you're >> > > asking this question then I'd suspect several possibilities: >> > > > You have DIH set to clean every time it's run and it didn't run >> > > successfully. So the clean step (which deletes all docs) finished but >> the >> > > index didn't get repopulated. >> > > >> > > > Someone issued a delete-by-query on *:* >> > > >> > > > Someone just deleted the index files from your sever accidentally. >> > > >> > > Best, >> > > Erick >> > > >> > > On Mon, Apr 24, 2017 at 8:55 AM, Saurav Maulick >> > > wrote: >> > > > Hi Team, >> > > > >> > > > We are using Solr 5.4.1 (in Windows with Zookeper). Our problem is >> Solr >> > > > automatically delete all indexed files.from last couple of days. >> > > > >> > > > Is their any Maxout setting which can cause this issue? >> > > > >> > > > This is our production issue and any quick help is highly >> appreciated. >> > > > >> > > > -- >> > > > Thanks and Regards, >> > > > Saurav Maulick >> > > >> > >> > >> > >> > -- >> > Thanks and Regards, >> > Saurav Maulick >> > >> > > > > -- > Thanks and Regards, > Saurav Maulick
Re: SOLR Indexed object delete automatically.
No David. this is not in public domain. I have asked server team to check incoming traffic IP also but they didn't find any thing. On Mon, Apr 24, 2017 at 3:28 PM, David Hastings < hastings.recurs...@gmail.com> wrote: > you dont have to log in to the server to send the delete command. is the > computers ip address public? > > > On Mon, Apr 24, 2017 at 3:13 PM, Saurav Maulick> wrote: > > > thanks Erick for quick replay. > > > > I the log file we have found that deleteByQuery entry. but i have checked > > with windows team they have confirmed no one login the server on that > time. > > > > see the log entry > > > > 2017-04-22 03:56:24.452 INFO > > (coreZkRegister-1-thread-1-processing-n:XX.XX.XX.XX:1988_solr > > x:ocdsolr_shard2_replica1 s:shard2 c:ocdsolr r:core_node1) [c:ocdsolr > > s:shard2 r:core_node1 x:ocdsolr_shard2_replica1] > > o.a.s.u.p.LogUpdateProcessorFactory [ocdsolr_shard2_replica1] > > {add=[10697.45745.12329.21333 (1565267805698260992), > > 10697.45745.11554.26776 (1565275671771480064), 10697.45745.13844.32189 > > (1565282977827520512)],deleteByQuery=*:* (-1565280896874971136)} 0 2353 > > > > On Mon, Apr 24, 2017 at 2:35 PM, Erick Erickson > > > wrote: > > > > > Solr does not delete files/documents by itself with the exception of > > > TTL (Time To Live, since Solr 4.8. See: > > > https://lucidworks.com/2014/05/07/document-expiration/). > > > > > > so unless you've configured TTL, which I doubt you have if you're > > > asking this question then I'd suspect several possibilities: > > > > You have DIH set to clean every time it's run and it didn't run > > > successfully. So the clean step (which deletes all docs) finished but > the > > > index didn't get repopulated. > > > > > > > Someone issued a delete-by-query on *:* > > > > > > > Someone just deleted the index files from your sever accidentally. > > > > > > Best, > > > Erick > > > > > > On Mon, Apr 24, 2017 at 8:55 AM, Saurav Maulick > > > wrote: > > > > Hi Team, > > > > > > > > We are using Solr 5.4.1 (in Windows with Zookeper). Our problem is > Solr > > > > automatically delete all indexed files.from last couple of days. > > > > > > > > Is their any Maxout setting which can cause this issue? > > > > > > > > This is our production issue and any quick help is highly > appreciated. > > > > > > > > -- > > > > Thanks and Regards, > > > > Saurav Maulick > > > > > > > > > > > -- > > Thanks and Regards, > > Saurav Maulick > > > -- Thanks and Regards, Saurav Maulick
Re: SOLR Indexed object delete automatically.
you dont have to log in to the server to send the delete command. is the computers ip address public? On Mon, Apr 24, 2017 at 3:13 PM, Saurav Maulickwrote: > thanks Erick for quick replay. > > I the log file we have found that deleteByQuery entry. but i have checked > with windows team they have confirmed no one login the server on that time. > > see the log entry > > 2017-04-22 03:56:24.452 INFO > (coreZkRegister-1-thread-1-processing-n:XX.XX.XX.XX:1988_solr > x:ocdsolr_shard2_replica1 s:shard2 c:ocdsolr r:core_node1) [c:ocdsolr > s:shard2 r:core_node1 x:ocdsolr_shard2_replica1] > o.a.s.u.p.LogUpdateProcessorFactory [ocdsolr_shard2_replica1] > {add=[10697.45745.12329.21333 (1565267805698260992), > 10697.45745.11554.26776 (1565275671771480064), 10697.45745.13844.32189 > (1565282977827520512)],deleteByQuery=*:* (-1565280896874971136)} 0 2353 > > On Mon, Apr 24, 2017 at 2:35 PM, Erick Erickson > wrote: > > > Solr does not delete files/documents by itself with the exception of > > TTL (Time To Live, since Solr 4.8. See: > > https://lucidworks.com/2014/05/07/document-expiration/). > > > > so unless you've configured TTL, which I doubt you have if you're > > asking this question then I'd suspect several possibilities: > > > You have DIH set to clean every time it's run and it didn't run > > successfully. So the clean step (which deletes all docs) finished but the > > index didn't get repopulated. > > > > > Someone issued a delete-by-query on *:* > > > > > Someone just deleted the index files from your sever accidentally. > > > > Best, > > Erick > > > > On Mon, Apr 24, 2017 at 8:55 AM, Saurav Maulick > > wrote: > > > Hi Team, > > > > > > We are using Solr 5.4.1 (in Windows with Zookeper). Our problem is Solr > > > automatically delete all indexed files.from last couple of days. > > > > > > Is their any Maxout setting which can cause this issue? > > > > > > This is our production issue and any quick help is highly appreciated. > > > > > > -- > > > Thanks and Regards, > > > Saurav Maulick > > > > > > -- > Thanks and Regards, > Saurav Maulick >
Re: SOLR Indexed object delete automatically.
thanks Erick for quick replay. I the log file we have found that deleteByQuery entry. but i have checked with windows team they have confirmed no one login the server on that time. see the log entry 2017-04-22 03:56:24.452 INFO (coreZkRegister-1-thread-1-processing-n:XX.XX.XX.XX:1988_solr x:ocdsolr_shard2_replica1 s:shard2 c:ocdsolr r:core_node1) [c:ocdsolr s:shard2 r:core_node1 x:ocdsolr_shard2_replica1] o.a.s.u.p.LogUpdateProcessorFactory [ocdsolr_shard2_replica1] {add=[10697.45745.12329.21333 (1565267805698260992), 10697.45745.11554.26776 (1565275671771480064), 10697.45745.13844.32189 (1565282977827520512)],deleteByQuery=*:* (-1565280896874971136)} 0 2353 On Mon, Apr 24, 2017 at 2:35 PM, Erick Ericksonwrote: > Solr does not delete files/documents by itself with the exception of > TTL (Time To Live, since Solr 4.8. See: > https://lucidworks.com/2014/05/07/document-expiration/). > > so unless you've configured TTL, which I doubt you have if you're > asking this question then I'd suspect several possibilities: > > You have DIH set to clean every time it's run and it didn't run > successfully. So the clean step (which deletes all docs) finished but the > index didn't get repopulated. > > > Someone issued a delete-by-query on *:* > > > Someone just deleted the index files from your sever accidentally. > > Best, > Erick > > On Mon, Apr 24, 2017 at 8:55 AM, Saurav Maulick > wrote: > > Hi Team, > > > > We are using Solr 5.4.1 (in Windows with Zookeper). Our problem is Solr > > automatically delete all indexed files.from last couple of days. > > > > Is their any Maxout setting which can cause this issue? > > > > This is our production issue and any quick help is highly appreciated. > > > > -- > > Thanks and Regards, > > Saurav Maulick > -- Thanks and Regards, Saurav Maulick
Re: SOLR Indexed object delete automatically.
Solr does not delete files/documents by itself with the exception of TTL (Time To Live, since Solr 4.8. See: https://lucidworks.com/2014/05/07/document-expiration/). so unless you've configured TTL, which I doubt you have if you're asking this question then I'd suspect several possibilities: > You have DIH set to clean every time it's run and it didn't run successfully. > So the clean step (which deletes all docs) finished but the index didn't get > repopulated. > Someone issued a delete-by-query on *:* > Someone just deleted the index files from your sever accidentally. Best, Erick On Mon, Apr 24, 2017 at 8:55 AM, Saurav Maulickwrote: > Hi Team, > > We are using Solr 5.4.1 (in Windows with Zookeper). Our problem is Solr > automatically delete all indexed files.from last couple of days. > > Is their any Maxout setting which can cause this issue? > > This is our production issue and any quick help is highly appreciated. > > -- > Thanks and Regards, > Saurav Maulick
SOLR Indexed object delete automatically.
Hi Team, We are using Solr 5.4.1 (in Windows with Zookeper). Our problem is Solr automatically delete all indexed files.from last couple of days. Is their any Maxout setting which can cause this issue? This is our production issue and any quick help is highly appreciated. -- Thanks and Regards, Saurav Maulick