Re: Storing Solr Index on NFS

2013-04-16 Thread Otis Gospodnetic
No. This is about 1 Solr server. You don't need to do anything with caches. Otis -- Solr & ElasticSearch Support http://sematext.com/ On Tue, Apr 16, 2013 at 6:50 PM, Furkan KAMACI wrote: > I don't want to bother but I try to understand that part: > > "When yo perform a commit in solr you h

Re: Storing Solr Index on NFS

2013-04-16 Thread Furkan KAMACI
I don't want to bother but I try to understand that part: "When yo perform a commit in solr you have (for an instant) two versions of the index. The commit produces new segments (with new documents, new deletions, etc). After creating these new segments a new index searcher is created and its cach

Re: Storing Solr Index on NFS

2013-04-16 Thread Otis Gospodnetic
Yesterday, we spent 1 hour with a client looking at their cluster's performance metrics SPM, their indexing logs, etc. trying to figure out why some indexing was slower than it should have been. We traced issues to network hickups, to VMs that would move from host to host, etc. Really fancy and p

Re: Storing Solr Index on NFS

2013-04-16 Thread Yago Riveiro
Furkan, see this post. http://grokbase.com/t/lucene/solr-user/117t1eswyk/multiple-solr-servers-and-a-shared-index-again Cumprimentos -- Yago Riveiro Sent with Sparrow (http://www.sparrowmailapp.com/?sig) On Tuesday, April 16, 2013 at 12:15 PM, Furkan KAMACI wrote: > Hi Walter; > > You sai

Re: Storing Solr Index on NFS

2013-04-16 Thread Furkan KAMACI
Hi Walter; You said: "It is not safe to share Solr index files between two Solr servers". Why do you think like that? 2013/4/16 Tim Vaillancourt > If centralization of storage is your goal by choosing NFS, iSCSI works > reasonably well with SOLR indexes, although good local-storage will always

Re: Storing Solr Index on NFS

2013-04-15 Thread Tim Vaillancourt
If centralization of storage is your goal by choosing NFS, iSCSI works reasonably well with SOLR indexes, although good local-storage will always be the overall winner. I noticed a near 5% degredation in overall search performance (casual testing, nothing scientific) when moving a 40-50GB inde

Re: Storing Solr Index on NFS

2013-04-15 Thread Walter Underwood
Solr 4.2 does have field compression which makes smaller indexes. That will reduce the amount of network traffic. That probably does not help much, because I think the latency of NFS is what causes problems. wunder On Apr 15, 2013, at 9:52 AM, Ali, Saqib wrote: > Hello Walter, > > Thanks for

Re: Storing Solr Index on NFS

2013-04-15 Thread Ali, Saqib
Hello Walter, Thanks for the response. That has been my experience in the past as well. But I was wondering if there new are things in Solr 4 and NFS 4.1 that make the storing of indexes on a NFS mount feasible. Thanks, Saqib On Mon, Apr 15, 2013 at 9:47 AM, Walter Underwood wrote: > On Apr 15

Re: Storing Solr Index on NFS

2013-04-15 Thread Walter Underwood
On Apr 15, 2013, at 9:40 AM, Ali, Saqib wrote: > Greetings, > > Are there any issues with storing Solr Indexes on a NFS share? Also any > recommendations for using NFS for Solr indexes? I recommend that you do not put Solr indexes on NFS. It can be very slow, I measured indexing as 100X slower