RE: Solr Cloud with large synonyms.txt

2013-05-08 Thread Roman Chyla
> -Original Message- > From: Mark Miller [mailto:markrmil...@gmail.com] > Sent: Tuesday, May 07, 2013 11:53 PM > To: solr-user@lucene.apache.org > Subject: Re: Solr Cloud with large synonyms.txt > > I'm not so worried about the large file in zk issue myself. >

RE: Solr Cloud with large synonyms.txt

2013-05-08 Thread David Parks
From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Tuesday, May 07, 2013 11:53 PM To: solr-user@lucene.apache.org Subject: Re: Solr Cloud with large synonyms.txt I'm not so worried about the large file in zk issue myself. The concern is that you start storing and accessing lots

Re: Solr Cloud with large synonyms.txt

2013-05-07 Thread Mark Miller
--Original Message- > From: Mark Miller [mailto:markrmil...@gmail.com] > Sent: Tuesday, May 07, 2013 9:35 PM > To: solr-user@lucene.apache.org > Subject: Re: Solr Cloud with large synonyms.txt > > > On May 7, 2013, at 10:24 AM, Mark Miller wrote: > >> >>

RE: Solr Cloud with large synonyms.txt

2013-05-07 Thread Son Nguyen
l Message- >> From: Jan Høydahl [mailto:jan@cominvent.com] >> Sent: Tuesday, May 07, 2013 4:35 AM >> To: solr-user@lucene.apache.org >> Subject: Re: Solr Cloud with large synonyms.txt >> >> See discussion here >> http://lucene.472066.n3.nabbl

RE: Solr Cloud with large synonyms.txt

2013-05-07 Thread Son Nguyen
Son -Original Message- From: Mark Miller [mailto:markrmil...@gmail.com] Sent: Tuesday, May 07, 2013 9:35 PM To: solr-user@lucene.apache.org Subject: Re: Solr Cloud with large synonyms.txt On May 7, 2013, at 10:24 AM, Mark Miller wrote: > > On May 6, 2013, at 12:32 PM, Son Ng

Re: Solr Cloud with large synonyms.txt

2013-05-07 Thread Mark Miller
On May 7, 2013, at 10:24 AM, Mark Miller wrote: > > On May 6, 2013, at 12:32 PM, Son Nguyen wrote: > >> I did some researches on internet and found out that because Zookeeper znode >> size limit is 1MB. I tried to increase the system property "jute.maxbuffer" >> but it won't work. >> Does a

Re: Solr Cloud with large synonyms.txt

2013-05-07 Thread Mark Miller
On May 6, 2013, at 12:32 PM, Son Nguyen wrote: > I did some researches on internet and found out that because Zookeeper znode > size limit is 1MB. I tried to increase the system property "jute.maxbuffer" > but it won't work. > Does anyone have experience of dealing with it? Perhaps hit up the

Re: Solr Cloud with large synonyms.txt

2013-05-07 Thread Jan Høydahl
Høydahl [mailto:jan@cominvent.com] >> Sent: Tuesday, May 07, 2013 4:35 AM >> To: solr-user@lucene.apache.org >> Subject: Re: Solr Cloud with large synonyms.txt >> >> See discussion here >> http://lucene.472066.n3.nabble.com/gt-1MB-file-to-Zookeeper

RE: Solr Cloud with large synonyms.txt

2013-05-07 Thread Roman Chyla
lr-user@lucene.apache.org > Subject: Re: Solr Cloud with large synonyms.txt > > See discussion here > http://lucene.472066.n3.nabble.com/gt-1MB-file-to-Zookeeper-td3958614.html > > One idea was compression. Perhaps if we add gzip support to SynonymFilter > it > can rea

RE: Solr Cloud with large synonyms.txt

2013-05-06 Thread David Parks
ydahl [mailto:jan@cominvent.com] Sent: Tuesday, May 07, 2013 4:35 AM To: solr-user@lucene.apache.org Subject: Re: Solr Cloud with large synonyms.txt See discussion here http://lucene.472066.n3.nabble.com/gt-1MB-file-to-Zookeeper-td3958614.html One idea was compression. Perhaps if we add gzip suppo

Re: Solr Cloud with large synonyms.txt

2013-05-06 Thread Jan Høydahl
See discussion here http://lucene.472066.n3.nabble.com/gt-1MB-file-to-Zookeeper-td3958614.html One idea was compression. Perhaps if we add gzip support to SynonymFilter it can read synonyms.txt.gz which would then fit larger raw dicts? -- Jan Høydahl, search solution architect Cominvent AS - ww