Re: Solr indexing configuration help

2008-06-01 Thread Gaku Mak
Hi Yonik and other solr dev/users, I have tried Yonik's suggestions with the following: 1) all autowarming are off 2) commented out firstsearch and newsearcher event handlers 3) increased autocommit interval to 600 docs and 30 minutes (previously 50 docs and 5 minutes) In addition, I updated

solr slave configuration help

2008-06-01 Thread Gaku Mak
Hi solr devs/users, I'm setting up solr slave test server now (duo core with 2GB ram), and I'm running into some issues with replication. The index being replication is in the size of about 10G now, and the snappuller and snapinstaller are scheduled to run every 30 mins using crontab. Upon

Re: Solr indexing configuration help

2008-06-01 Thread Yonik Seeley
On Sun, Jun 1, 2008 at 4:43 AM, Gaku Mak [EMAIL PROTECTED] wrote: I have tried Yonik's suggestions with the following: 1) all autowarming are off 2) commented out firstsearch and newsearcher event handlers 3) increased autocommit interval to 600 docs and 30 minutes (previously 50 docs and 5

Re: large data to index

2008-06-01 Thread Yonik Seeley
On Sun, Jun 1, 2008 at 11:39 AM, Kevin Xiao [EMAIL PROTECTED] wrote: Hi, We have large data to index, index size is about 40 G and getting bigger. We are try to figure out a way to speed up indexing. 1. Single solr server, multiple indexers, which will speed up document parsing

Re: solr on ubuntu 8.04

2008-06-01 Thread Chris Hostetter
: Thanks for your suggestions. I have now tried installing Solr on two : different machines. On one machine I installed the Ubuntu solr-tomcat5.5 : package, and on the other I simply dropped solr.war : into /var/lib/tomcat5.5/webapps This may be a silly question, but did you create a solr home

Re: Want to drill down facet search result

2008-06-01 Thread Chris Hostetter
: Is there any way I can group category information together? So that I : know the category_id for the specific category_name? when dealing with stored fields, Solr garuntees that the field values arereturned in the order they were indexed - so if you have a multivalue cat_id field and a

Does SOLR support RAMDirectory ?

2008-06-01 Thread s d
Can i use RAMDirectory in SOLR?Thanks, S

Lots of javax.xml.stream.XMLStreamException: ParseError errors before solr stopped responding

2008-06-01 Thread Gaku Mak
Hi all, I have 2 solr masters that are only doing indexing and no querying (index replicated to slave for searching). I noticed that the masters would occasionally give the javax.xml.stream.XMLStreamException: ParseError error and continued to work, until they started to give a lot of these and

Re: Lots of javax.xml.stream.XMLStreamException: ParseError errors before solr stopped responding

2008-06-01 Thread Otis Gospodnetic
Wow, did you notice this: [row,col]:[1,920837] Does that strike you as a very looong line? I wonder if you are hitting some kind of an XML parser limit or bug. Otis -- Sematext -- http://sematext.com/ -- Lucene - Solr - Nutch - Original Message From: Gaku Mak [EMAIL

Re: ClassCastException trying to use distributed search

2008-06-01 Thread Noble Paul നോബിള്‍ नोब्ळ्
Hoss:Your are right. It has a version byte written first. This can be used for any changes that come later..So , when we introduce any change to the format we can rely on that. If/When we upgrade the format we must ensure that it is backward compatible . The format can be used by SolrJ clients as