Backing up indexes, reliability and robustness

2006-05-12 Thread Marc Dauncey
Hi everyone, Just wanted to get peoples views on an indexing issue. I gather a lot of people have apps where indexing writes to the same index as is used by the searcher. The thing that bothers me about this is if indexing is interrupted (file system crash, out of disk space etc) the index be

Re: Backing up indexes, reliability and robustness

2006-05-12 Thread Otis Gospodnetic
could try making a backup using IndexWriter's addIndexes method, and I imagine hard-links would work, too. Otis - Original Message From: Marc Dauncey <[EMAIL PROTECTED]> To: java-user@lucene.apache.org Sent: Friday, May 12, 2006 7:59:14 AM Subject: Backing up indexes, reliabilit

Re: Backing up indexes, reliability and robustness

2006-05-12 Thread Jeff Rodenburg
Marc - We built our index maintenance operation to assume a breakdown would occur in process (because it happened several times.) We exist in an environment where "always on, always available" is a business requirement. We also do a lot of updates on a cyclical basis (every 10 minutes), so malf

Re: Backing up indexes, reliability and robustness

2006-05-12 Thread Chris Hostetter
: As for backing up, you could try making a backup using IndexWriter's : addIndexes method, and I imagine hard-links would work, too. Hardlinks do in fact work quite well. This is how the Solr backup scripts work... http://svn.apache.org/repos/asf/incubator/solr/trunk/src/scripts/backup -Ho

Re: Backing up indexes, reliability and robustness

2006-05-14 Thread Marc Dauncey
From: Chris Hostetter <[EMAIL PROTECTED]> To: java-user@lucene.apache.org; Otis Gospodnetic <[EMAIL PROTECTED]> Sent: Friday, 12 May, 2006 7:41:33 PM Subject: Re: Backing up indexes, reliability and robustness : As for backing up, you could try making a backup using IndexWriter's :