Re: SOLR Indexed object delete automatically.

[Erick Erickson]

Are you using Data Import Handler (DIH?)? The "clean" option there
removes all the docs before running.

If not, then _someone_ is sending that command, Solr isn't generating
it by itself.

Best,
Erick

On Mon, Apr 24, 2017 at 12:35 PM, Saurav Maulick  wrote:
> No David. this is not in public domain. I have asked server team to check
> incoming traffic IP also but they didn't find any thing.
>
> On Mon, Apr 24, 2017 at 3:28 PM, David Hastings <
> hastings.recurs...@gmail.com> wrote:
>
>> you dont have to log in to the server to send the delete command.  is the
>> computers ip address public?
>>
>>
>> On Mon, Apr 24, 2017 at 3:13 PM, Saurav Maulick 
>> wrote:
>>
>> > thanks Erick for quick replay.
>> >
>> > I the log file we have found that deleteByQuery entry. but i have checked
>> > with windows team they have confirmed no one login the server on that
>> time.
>> >
>> > see the log entry
>> >
>> > 2017-04-22 03:56:24.452 INFO
>> >  (coreZkRegister-1-thread-1-processing-n:XX.XX.XX.XX:1988_solr
>> > x:ocdsolr_shard2_replica1 s:shard2 c:ocdsolr r:core_node1) [c:ocdsolr
>> > s:shard2 r:core_node1 x:ocdsolr_shard2_replica1]
>> > o.a.s.u.p.LogUpdateProcessorFactory [ocdsolr_shard2_replica1]
>> > {add=[10697.45745.12329.21333 (1565267805698260992),
>> > 10697.45745.11554.26776 (1565275671771480064), 10697.45745.13844.32189
>> > (1565282977827520512)],deleteByQuery=*:* (-1565280896874971136)} 0 2353
>> >
>> > On Mon, Apr 24, 2017 at 2:35 PM, Erick Erickson > >
>> > wrote:
>> >
>> > > Solr does not delete files/documents by itself with the exception of
>> > > TTL (Time To Live, since Solr 4.8. See:
>> > > https://lucidworks.com/2014/05/07/document-expiration/).
>> > >
>> > > so unless you've configured TTL, which I doubt you have if you're
>> > > asking this question then I'd suspect several possibilities:
>> > > > You have DIH set to clean every time it's run and it didn't run
>> > > successfully. So the clean step (which deletes all docs) finished but
>> the
>> > > index didn't get repopulated.
>> > >
>> > > > Someone issued a delete-by-query on *:*
>> > >
>> > > > Someone just deleted the index files from your sever accidentally.
>> > >
>> > > Best,
>> > > Erick
>> > >
>> > > On Mon, Apr 24, 2017 at 8:55 AM, Saurav Maulick 
>> > > wrote:
>> > > > Hi Team,
>> > > >
>> > > > We are using Solr 5.4.1 (in Windows with Zookeper). Our problem is
>> Solr
>> > > > automatically delete all indexed files.from last couple of days.
>> > > >
>> > > > Is their any Maxout setting which can cause this issue?
>> > > >
>> > > > This is our production issue and any quick help is highly
>> appreciated.
>> > > >
>> > > > --
>> > > > Thanks and Regards,
>> > > > Saurav Maulick
>> > >
>> >
>> >
>> >
>> > --
>> > Thanks and Regards,
>> > Saurav Maulick
>> >
>>
>
>
>
> --
> Thanks and Regards,
> Saurav Maulick

Re: SOLR Indexed object delete automatically.

[Saurav Maulick]

No David. this is not in public domain. I have asked server team to check
incoming traffic IP also but they didn't find any thing.

On Mon, Apr 24, 2017 at 3:28 PM, David Hastings <
hastings.recurs...@gmail.com> wrote:

> you dont have to log in to the server to send the delete command.  is the
> computers ip address public?
>
>
> On Mon, Apr 24, 2017 at 3:13 PM, Saurav Maulick 
> wrote:
>
> > thanks Erick for quick replay.
> >
> > I the log file we have found that deleteByQuery entry. but i have checked
> > with windows team they have confirmed no one login the server on that
> time.
> >
> > see the log entry
> >
> > 2017-04-22 03:56:24.452 INFO
> >  (coreZkRegister-1-thread-1-processing-n:XX.XX.XX.XX:1988_solr
> > x:ocdsolr_shard2_replica1 s:shard2 c:ocdsolr r:core_node1) [c:ocdsolr
> > s:shard2 r:core_node1 x:ocdsolr_shard2_replica1]
> > o.a.s.u.p.LogUpdateProcessorFactory [ocdsolr_shard2_replica1]
> > {add=[10697.45745.12329.21333 (1565267805698260992),
> > 10697.45745.11554.26776 (1565275671771480064), 10697.45745.13844.32189
> > (1565282977827520512)],deleteByQuery=*:* (-1565280896874971136)} 0 2353
> >
> > On Mon, Apr 24, 2017 at 2:35 PM, Erick Erickson  >
> > wrote:
> >
> > > Solr does not delete files/documents by itself with the exception of
> > > TTL (Time To Live, since Solr 4.8. See:
> > > https://lucidworks.com/2014/05/07/document-expiration/).
> > >
> > > so unless you've configured TTL, which I doubt you have if you're
> > > asking this question then I'd suspect several possibilities:
> > > > You have DIH set to clean every time it's run and it didn't run
> > > successfully. So the clean step (which deletes all docs) finished but
> the
> > > index didn't get repopulated.
> > >
> > > > Someone issued a delete-by-query on *:*
> > >
> > > > Someone just deleted the index files from your sever accidentally.
> > >
> > > Best,
> > > Erick
> > >
> > > On Mon, Apr 24, 2017 at 8:55 AM, Saurav Maulick 
> > > wrote:
> > > > Hi Team,
> > > >
> > > > We are using Solr 5.4.1 (in Windows with Zookeper). Our problem is
> Solr
> > > > automatically delete all indexed files.from last couple of days.
> > > >
> > > > Is their any Maxout setting which can cause this issue?
> > > >
> > > > This is our production issue and any quick help is highly
> appreciated.
> > > >
> > > > --
> > > > Thanks and Regards,
> > > > Saurav Maulick
> > >
> >
> >
> >
> > --
> > Thanks and Regards,
> > Saurav Maulick
> >
>



-- 
Thanks and Regards,
Saurav Maulick

Re: SOLR Indexed object delete automatically.

[David Hastings]

you dont have to log in to the server to send the delete command.  is the
computers ip address public?


On Mon, Apr 24, 2017 at 3:13 PM, Saurav Maulick  wrote:

> thanks Erick for quick replay.
>
> I the log file we have found that deleteByQuery entry. but i have checked
> with windows team they have confirmed no one login the server on that time.
>
> see the log entry
>
> 2017-04-22 03:56:24.452 INFO
>  (coreZkRegister-1-thread-1-processing-n:XX.XX.XX.XX:1988_solr
> x:ocdsolr_shard2_replica1 s:shard2 c:ocdsolr r:core_node1) [c:ocdsolr
> s:shard2 r:core_node1 x:ocdsolr_shard2_replica1]
> o.a.s.u.p.LogUpdateProcessorFactory [ocdsolr_shard2_replica1]
> {add=[10697.45745.12329.21333 (1565267805698260992),
> 10697.45745.11554.26776 (1565275671771480064), 10697.45745.13844.32189
> (1565282977827520512)],deleteByQuery=*:* (-1565280896874971136)} 0 2353
>
> On Mon, Apr 24, 2017 at 2:35 PM, Erick Erickson 
> wrote:
>
> > Solr does not delete files/documents by itself with the exception of
> > TTL (Time To Live, since Solr 4.8. See:
> > https://lucidworks.com/2014/05/07/document-expiration/).
> >
> > so unless you've configured TTL, which I doubt you have if you're
> > asking this question then I'd suspect several possibilities:
> > > You have DIH set to clean every time it's run and it didn't run
> > successfully. So the clean step (which deletes all docs) finished but the
> > index didn't get repopulated.
> >
> > > Someone issued a delete-by-query on *:*
> >
> > > Someone just deleted the index files from your sever accidentally.
> >
> > Best,
> > Erick
> >
> > On Mon, Apr 24, 2017 at 8:55 AM, Saurav Maulick 
> > wrote:
> > > Hi Team,
> > >
> > > We are using Solr 5.4.1 (in Windows with Zookeper). Our problem is Solr
> > > automatically delete all indexed files.from last couple of days.
> > >
> > > Is their any Maxout setting which can cause this issue?
> > >
> > > This is our production issue and any quick help is highly appreciated.
> > >
> > > --
> > > Thanks and Regards,
> > > Saurav Maulick
> >
>
>
>
> --
> Thanks and Regards,
> Saurav Maulick
>

Re: SOLR Indexed object delete automatically.

[Saurav Maulick]

thanks Erick for quick replay.

I the log file we have found that deleteByQuery entry. but i have checked
with windows team they have confirmed no one login the server on that time.

see the log entry

2017-04-22 03:56:24.452 INFO
 (coreZkRegister-1-thread-1-processing-n:XX.XX.XX.XX:1988_solr
x:ocdsolr_shard2_replica1 s:shard2 c:ocdsolr r:core_node1) [c:ocdsolr
s:shard2 r:core_node1 x:ocdsolr_shard2_replica1]
o.a.s.u.p.LogUpdateProcessorFactory [ocdsolr_shard2_replica1]
{add=[10697.45745.12329.21333 (1565267805698260992),
10697.45745.11554.26776 (1565275671771480064), 10697.45745.13844.32189
(1565282977827520512)],deleteByQuery=*:* (-1565280896874971136)} 0 2353

On Mon, Apr 24, 2017 at 2:35 PM, Erick Erickson 
wrote:

> Solr does not delete files/documents by itself with the exception of
> TTL (Time To Live, since Solr 4.8. See:
> https://lucidworks.com/2014/05/07/document-expiration/).
>
> so unless you've configured TTL, which I doubt you have if you're
> asking this question then I'd suspect several possibilities:
> > You have DIH set to clean every time it's run and it didn't run
> successfully. So the clean step (which deletes all docs) finished but the
> index didn't get repopulated.
>
> > Someone issued a delete-by-query on *:*
>
> > Someone just deleted the index files from your sever accidentally.
>
> Best,
> Erick
>
> On Mon, Apr 24, 2017 at 8:55 AM, Saurav Maulick 
> wrote:
> > Hi Team,
> >
> > We are using Solr 5.4.1 (in Windows with Zookeper). Our problem is Solr
> > automatically delete all indexed files.from last couple of days.
> >
> > Is their any Maxout setting which can cause this issue?
> >
> > This is our production issue and any quick help is highly appreciated.
> >
> > --
> > Thanks and Regards,
> > Saurav Maulick
>



-- 
Thanks and Regards,
Saurav Maulick

Re: SOLR Indexed object delete automatically.

[Erick Erickson]

Solr does not delete files/documents by itself with the exception of
TTL (Time To Live, since Solr 4.8. See:
https://lucidworks.com/2014/05/07/document-expiration/).

so unless you've configured TTL, which I doubt you have if you're
asking this question then I'd suspect several possibilities:
> You have DIH set to clean every time it's run and it didn't run successfully. 
> So the clean step (which deletes all docs) finished but the index didn't get 
> repopulated.

> Someone issued a delete-by-query on *:*

> Someone just deleted the index files from your sever accidentally.

Best,
Erick

On Mon, Apr 24, 2017 at 8:55 AM, Saurav Maulick  wrote:
> Hi Team,
>
> We are using Solr 5.4.1 (in Windows with Zookeper). Our problem is Solr
> automatically delete all indexed files.from last couple of days.
>
> Is their any Maxout setting which can cause this issue?
>
> This is our production issue and any quick help is highly appreciated.
>
> --
> Thanks and Regards,
> Saurav Maulick

SOLR Indexed object delete automatically.

[Saurav Maulick]

Hi Team,

We are using Solr 5.4.1 (in Windows with Zookeper). Our problem is Solr
automatically delete all indexed files.from last couple of days.

Is their any Maxout setting which can cause this issue?

This is our production issue and any quick help is highly appreciated.

-- 
Thanks and Regards,
Saurav Maulick