RE: Easy way to tell if there are pending documents

2011-11-16 Thread Latter, Antoine
Excellent. It looks like I can drill down into exactly what I want without 
having to load up the rest of the statistics.

-Original Message-
From: Justin Caratzas [mailto:justin.carat...@gmail.com] 
Sent: Wednesday, November 16, 2011 10:41 AM
To: solr-user@lucene.apache.org
Subject: Re: Easy way to tell if there are pending documents


You can enable the stats handler
(https://issues.apache.org/jira/browse/SOLR-1750), and get inspect the json 
pragmatically.

-- Justin

Latter, Antoine antoine.lat...@legis.wisconsin.gov writes:

 Thank you, that does help - but I am more looking for a way to get at this 
 programmatically.

 -Original Message-
 From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com]
 Sent: Tuesday, November 15, 2011 11:22 AM
 To: solr-user@lucene.apache.org
 Subject: Re: Easy way to tell if there are pending documents

 Antoine,

 On Solr Admin Stats page search for docsPending.  I think this is what you 
 are looking for.

 Otis
 
 Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene 
 ecosystem search :: http://search-lucene.com/



From: Latter, Antoine antoine.lat...@legis.wisconsin.gov
To: 'solr-user@lucene.apache.org' solr-user@lucene.apache.org
Sent: Monday, November 14, 2011 11:39 AM
Subject: Easy way to tell if there are pending documents

Hi Solr,

Does anyone know of an easy way to tell if there are pending documents 
waiting for commit?

Our application performs operations that are never safe to perform  
while commits are pending. We make this work by making sure that all  
indexing operations end in a commit, and stop the unsafe operations  
from running while a commit is running.

This works great most of the time, except when we have enough disk  
space to add documents to the pending area, but not enough disk  space 
to do a commit - then the indexing operations only error out  after 
they've done all of their adds.

It would be nice if the unsafe operation could somehow detect that there are 
pending documents and abort.

In the interim I'll have the unsafe operation perform a commit when it 
starts, but I've been weeding out useless commits from my app recently and I 
don't like them creeping back in.

Thanks,
Antoine






RE: Index format difference between 4.0 and 3.4

2011-11-15 Thread Latter, Antoine
We didn't have to re-index when we upgraded - but if you're using a 
master/slave setup, you won't be able to replicate from a higher version to a 
lower version - old solr cannot read the new indices.

-Original Message-
From: roz dev [mailto:rozde...@gmail.com] 
Sent: Monday, November 14, 2011 7:49 PM
To: solr-user@lucene.apache.org
Subject: Index format difference between 4.0 and 3.4

Hi All,

We are using Solr 1.4.1 in production and are considering an upgrade to newer 
version.

It seems that Solr 3.x requires a complete rebuild of index as the format seems 
to have changed.

Is Solr 4.0 index file format compatible with Solr 3.x format?

Please advise.

Thanks
Saroj


RE: Easy way to tell if there are pending documents

2011-11-15 Thread Latter, Antoine
Thank you, that does help - but I am more looking for a way to get at this 
programmatically.

-Original Message-
From: Otis Gospodnetic [mailto:otis_gospodne...@yahoo.com] 
Sent: Tuesday, November 15, 2011 11:22 AM
To: solr-user@lucene.apache.org
Subject: Re: Easy way to tell if there are pending documents

Antoine,

On Solr Admin Stats page search for docsPending.  I think this is what you 
are looking for.

Otis

Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem 
search :: http://search-lucene.com/



From: Latter, Antoine antoine.lat...@legis.wisconsin.gov
To: 'solr-user@lucene.apache.org' solr-user@lucene.apache.org
Sent: Monday, November 14, 2011 11:39 AM
Subject: Easy way to tell if there are pending documents

Hi Solr,

Does anyone know of an easy way to tell if there are pending documents waiting 
for commit?

Our application performs operations that are never safe to perform while 
commits are pending. We make this work by making sure that all indexing 
operations end in a commit, and stop the unsafe operations from running while 
a commit is running.

This works great most of the time, except when we have enough disk space to 
add documents to the pending area, but not enough disk space to do a commit - 
then the indexing operations only error out after they've done all of their 
adds.

It would be nice if the unsafe operation could somehow detect that there are 
pending documents and abort.

In the interim I'll have the unsafe operation perform a commit when it starts, 
but I've been weeding out useless commits from my app recently and I don't 
like them creeping back in.

Thanks,
Antoine





Easy way to tell if there are pending documents

2011-11-14 Thread Latter, Antoine
Hi Solr,

Does anyone know of an easy way to tell if there are pending documents waiting 
for commit?

Our application performs operations that are never safe to perform while 
commits are pending. We make this work by making sure that all indexing 
operations end in a commit, and stop the unsafe operations from running while a 
commit is running.

This works great most of the time, except when we have enough disk space to add 
documents to the pending area, but not enough disk space to do a commit - then 
the indexing operations only error out after they've done all of their adds.

It would be nice if the unsafe operation could somehow detect that there are 
pending documents and abort.

In the interim I'll have the unsafe operation perform a commit when it starts, 
but I've been weeding out useless commits from my app recently and I don't like 
them creeping back in.

Thanks,
Antoine