Index replication strategy

2014-12-04 Thread Vijay B
Hello, We index docs coming from database nightly. Current index is sitting on NFS. Due to obvious performance reasons, we are switching are planning to switch to local index. W have cluster of 4 servers and with NFS it was not a problem for us until now to share the index. but going forward, we

Re: Index replication strategy

2014-12-04 Thread Shai Erera
Do you use Lucene or Solr? Lucene also has a replication module, which will allow you to replicate index changes. On Thu, Dec 4, 2014 at 4:19 PM, Vijay B vijay.nip...@gmail.com wrote: Hello, We index docs coming from database nightly. Current index is sitting on NFS. Due to obvious

Re: Index replication strategy

2014-12-04 Thread Vijay B
As indicated in my post, we use Lucene 4.2.1. On Thu, Dec 4, 2014 at 9:29 AM, Shai Erera ser...@gmail.com wrote: Do you use Lucene or Solr? Lucene also has a replication module, which will allow you to replicate index changes. On Thu, Dec 4, 2014 at 4:19 PM, Vijay B vijay.nip...@gmail.com

Re: Index replication strategy

2014-12-04 Thread Shai Erera
Ooops, didn't notice that :). So you'll need to upgrade to Lucene 4.4.0 in order to use it. You can read some details as well as example code here: http://shaierera.blogspot.com/2013/05/the-replicator.html. Shai On Thu, Dec 4, 2014 at 4:36 PM, Vijay B vijay.nip...@gmail.com wrote: As

Re: Index replication strategy

2014-12-04 Thread Michael Sokolov
There are also Solr replication options - older snapshot-style replication, and newer Solr Cloud, but if you are not using solr now, you will incur some transitional costs since you would need to alter your indexing and possibly querying code to use it -Mike On 12/04/2014 09:38 AM, Shai

Re: Index replication strategy

2014-12-04 Thread Vijay B
Looks very promising. I will check out your blog. On Thu, Dec 4, 2014 at 9:38 AM, Shai Erera ser...@gmail.com wrote: Ooops, didn't notice that :). So you'll need to upgrade to Lucene 4.4.0 in order to use it. You can read some details as well as example code here: