RE: *Very* slow Commit after upgrading to solr 1.3

So other than me doing trial error, do you have any guidance on how to configure the merge factor (and ramBufferSizeMB ? ). any formula that supplies the optimal value ? Thanks, Yatir -Original Message- From: [EMAIL PROTECTED] [mailto:[EMAIL PROTECTED] On Behalf Of Yonik Seeley Sent:

Re: still my problem with autoCommit which fire but never ending!!! no idea

Hi, Just a question, I've updated solr1.2 to solr 1.3 but didn't change solrconfig.xml and schema.xml is that a real problem ? thanks, Grant Ingersoll-6 wrote: Hi Sunny, Pretty hard to say what's going on here, other than you don't have the right Lucene libraries in your install.

Re: Tomcat session

could it become a performance issue at some point? JC R wrote: Hello, Does somebody have an idea why a new servlet session is created for each request to solr? thanks -- View this message in context: http://www.nabble.com/Tomcat-session-tp19861244p19873952.html Sent from the Solr -

Problem in using Unique key

hi guys I am indexing values from an oracle db and them performing searching. Since I have to search multiple tables, that is no way related to each other, I have changed the uniquekey constraint in schema.xml to false. uniqueKey required=falseuserID/uniqueKey But when I do indexing, the values

solr 1.2 to solr 1.3, I've some error

Hello, I've updated solr 1.2 to solr 1.3, so I've generated the new .war and add it to tomcat like I used to do and it used to work. For information I didn't change conf files : solrconfig, data-config, schema and scripts. I just changed the name multicore.xml to solr.xml And now I've this

Re: upgrading solr

I've upgraded solr several times from nightly to nightly and then to the 1.3 release without reindexing, with no apparent ill effects. On Oct 8, 2008, at 6:12 AM, dudes dudes wrote: Hello all, I would like to upgrade to the latest Solr from its nightly version. MY understanding is to

RE: upgrading solr

hi again, I guess I'm doing something wrong, I have downloaded the latest stable version... untar it ,,, then I have copied /index directory from the old version to the newer version version under data/ schema are the same... the old default one I have start it via java -jar start... (

solr 1.2 to solr 1.3, manage multilanguage error?

Hi, I've updated recently solr to the last version, but I've an error : How can I manage language with this new version : My bug: Oct 8 11:32:13 solr-test jsvc.exec[29876]: Oct 8, 2008 11:32:13 AM org.apache.solr.request.XSLTResponseWriter init INFO: xsltCacheLifetimeSeconds=5 Oct 8 11:32:13

Re: Problem in using Unique key

uniqueKey required=falseuserID/uniqueKey I do not think there is a required attribute on uniquekey By default uniquekey is required . If you do not want to make it required remove the tag itself means no uniqueKey --Noble On Wed, Oct 8, 2008 at 1:17 PM, con [EMAIL PROTECTED] wrote: hi guys I

Re: Problem in using Unique key

Thanks for your update. But in that case, while doing a full-import I am getting the following error: org.apache.solr.common.SolrException: QueryElevationComponent requires the schema to have a uniqueKeyField at

RE: upgrading solr

thanks for your quick response.. yes it was under the right path... However, the problem was fixed by changing the ownership under index folder :) thanks again ak From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: upgrading solr

Re: upgrading solr

Check again that you put the index directory in the right place. If you're using the example config which comes with the release package, it needs to be in BASE/example/solr/data/index. On Oct 8, 2008, at 8:18 AM, dudes dudes wrote: hi again, I guess I'm doing something wrong, I

RE: upgrading solr

thanks, I will give it a try ,,, any probs will let you know :) ak From: [EMAIL PROTECTED] To: solr-user@lucene.apache.org Subject: Re: upgrading solr Date: Wed, 8 Oct 2008 07:29:33 -0400 I've upgraded solr several times from nightly to nightly and

Re: still my problem with autoCommit which fire but never ending!!! no idea

On Oct 8, 2008, at 3:43 AM, sunnyfr wrote: Just a question, I've updated solr1.2 to solr 1.3 but didn't change solrconfig.xml and schema.xml is that a real problem ? Personally, I'd strongly recommend (to the point of mandating) that whenever going from one version of Solr to another that

Re: solr 1.2 to solr 1.3, I've some error

On Oct 8, 2008, at 4:04 AM, sunnyfr wrote: Hello, I've updated solr 1.2 to solr 1.3, so I've generated the new .war and add it to tomcat like I used to do and it used to work. Define generated the new .war? Is there something wrong with the WAR that comes w/ Solr? What steps did you

upgrading solr

Hello all, I would like to upgrade to the latest Solr from its nightly version. MY understanding is to re-index all the data after upgrading .. Is there a way that doesn't require re-indexing all the data ? for example a solr script or any third party tools ? or do I have to re-index

Solr 1.3 try to fire delta-import.

Hi, I've a wierd problem, my solr seems running. When i go to : http://solr-test.adm.bookclub.com:8180/solr/books/admin/ I've a proper page : Solr Admin (videos) solr-test.adm.bookclub.com:8180 cwd=/data/solr SolrHome=/data/solr/books/ Even

Re: spellcheck: issues

Hi Grant, Here are solr config files (attached) and java code (included below) to recreate the test case. Jason ListPairString, Integer terms = new ArrayListPairString, Integer(); terms.add(new PairString, Integer(chanel, 834)); terms.add(new PairString, Integer(chant,

Re: Solr 1.3 try to fire delta-import.

Is the DataImportHandler defined in the solrconfig.xml for the video core? On Wed, Oct 8, 2008 at 7:26 PM, sunnyfr [EMAIL PROTECTED] wrote: Hi, I've a wierd problem, my solr seems running. When i go to : http://solr-test.adm.bookclub.com:8180/solr/books/admin/ I've a proper page : Solr

Re: Solr 1.3 try to fire delta-import.

sorry it's ok ... it's book but the same error. Shalin Shekhar Mangar wrote: Is the DataImportHandler defined in the solrconfig.xml for the video core? On Wed, Oct 8, 2008 at 7:26 PM, sunnyfr [EMAIL PROTECTED] wrote: Hi, I've a wierd problem, my solr seems running. When i go to :

Re: Solr 1.3 try to fire delta-import.

What you mean? except the name of the core which is books because in solrconfig.xml I've no part about DataImportHandler. thanks, Shalin Shekhar Mangar wrote: Is the DataImportHandler defined in the solrconfig.xml for the video core? On Wed, Oct 8, 2008 at 7:26 PM, sunnyfr [EMAIL

Re: Solr 1.3 try to fire delta-import.

More information : [EMAIL PROTECTED]:/usr/share/tomcat5.5/webapps/solr/WEB-INF/lib# ls README.committers.txt commons-io-1.3.1.jar lucene-snowball-2.4-dev.jar solr-lucene-highlighter-pom.xml.template apache-solr-common-1.4-dev.jar

solr + zookeeper

Hello, I am evaluating Solr on a small cluster (~8 nodes) and will likely deploy it to a cluster of ~128 nodes. Of course, configuration management will be a big concern. Has anyone used Zookeeper for a Solr cluster? I'm looking for any documentation, tutorials, etc. on how to setup Zookeeper

Need help with Solr Performance

Hi, I need some recommendations w/ some issues I'm having w/ solr search performance. Here is my index/hardware config: - CentOS on 8 quad core xeon processors @ 3.16 Ghz - 32 GB RAM - Tomcat and JAVA 1.6 - Solr 1.3 ~15 million documents . - Index size on disk is about 22 GB - 8 quad core xeon

Problems with WordDelimiterFilterFactory

Hello, I am playing arount with WordDelimiterFilterFactory and run into some problems... When I search with RedElectronicLed I got this entries : Red - Electronic - Led = Perfect ! But I don´t get RedElectronicLed entries in my DB :-( Is there a chance I will get both ? Red - Electronic -

Solr Spell check component - SolrJ

Hi, I am trying to use SolrJ java client to do search and the basic search works fine with the code given below. SolrServer server = new CommonsHttpSolrServer( http://localhost:8983/solr;); SolrQuery query = new SolrQuery(). setQuery(searchKey).

Re: Need help with Solr Performance

I don't think you can search a 15 million doc index with any kind of query complexity beyond a low freq query term in under .25 seconds unless its a cached hit (in which case it still might not *quite* make it under .25 every time either I'd think). Would love to be proven wrong though g You

Re: spellcheck: issues

Hi Jason, Here's what I did: 1. Took your code and modified it to be that of [1] below 2. Set up your config, schema, etc. as per the EmbeddedSolrServer paths in the code (a Maven like dir structure w/ src/main/resources/ solr/spell containing your configuration. 3. Ran the code. My output

Re: Need help with Solr Performance

On Oct 8, 2008, at 11:56 AM, Rajiv2 wrote: Hi, I need some recommendations w/ some issues I'm having w/ solr search performance. Here is my index/hardware config: - CentOS on 8 quad core xeon processors @ 3.16 Ghz - 32 GB RAM - Tomcat and JAVA 1.6 - Solr 1.3 ~15 million documents . -

Re: Discarding undefined fields in query

On Tue, Oct 7, 2008 at 12:56 AM, Chris Hostetter [EMAIL PROTECTED] wrote: : req.getSchema().getQueryAnalyzer(); : : I think it's in this analyzer that the undefined field error happens : (because for instance the field 'foo' doesn't exists in the schema, : and so it's impossible to find a

Re: spellcheck: issues

On Wed, Oct 8, 2008 at 1:24 PM, Grant Ingersoll [EMAIL PROTECTED] wrote: Token: chane OMP: false Oct 8, 2008 1:19:56 PM org.apache.solr.core.SolrCore execute INFO: [spell] webapp=null path=/select

Re: Need help with Solr Performance

Hi, thanks for responding so quickly, 6-12 seconds seems really long and 15 million docs is nothing on a machine like this. Are you sure the issue is in Solr? How are you measuring the 6-12 seconds? I'm looking at the QTime value in the Solr response. Assuming it is Solr... How often

Re: Need help with Solr Performance

One other question: are you using real query logs or a set of unique queries? With real query logs, the caches will warm up after a while (tens of minutes) and performance will improve. With a set of unique queries, you are mostly measuring Solr cache misses. For us, that is about 4X slower, and

Spellchecker extended results problem

Hi, I'm having trouble with the spell check component of Solr 1.3. If I request multiple extended results from spell check with a json result format, the results get decoded into a single 'suggestion' array. For example, for the query

Re: Need help with Solr Performance

what is your actual query? Are you doing faceting / highlighting / or anything else? On Oct 8, 2008, at 2:17 PM, Rajiv2 wrote: Hi, thanks for responding so quickly, 6-12 seconds seems really long and 15 million docs is nothing on a machine like this. Are you sure the issue is in Solr?

Re: Solr Spell check component - SolrJ

see the thread spellcheck issues going on right now between Jason Rennie and me. In there is a small sample piece of code that does spell checking through SolrJ. On Oct 8, 2008, at 12:52 PM, Sunil Raj wrote: Hi, I am trying to use SolrJ java client to do search and the basic search

Re: spellcheck: issues

On Wed, Oct 8, 2008 at 3:05 PM, Grant Ingersoll [EMAIL PROTECTED] wrote: chane is in the dictionary. For better or worse, Lucene skips words that are in the dictionary when OMP is false. Ah, I see. I think we'll use OMP=true, which seems like a reasonable setting anyway. Makes sense to

Re: Need help with Solr Performance

On Oct 8, 2008, at 3:30 PM, Rajiv2 wrote: what is your actual query? Are you doing faceting / highlighting / or anything else? I am doing faceting on 5 fields, no highlighting or anything else, debugging is also off. A basic query that I'm doing using dismax is 'cleaning services' over

Re: Need help with Solr Performance

and query times without faceting are... ? solr's built in faceting is simple and has its limits. 15M is higher than i've seen good faceting performance out of, particularly multivalued fields. Erik Hi, My facet fields are multi valued and w/o faceting the query time is about 200ms

Re: Solr 1.3 try to fire delta-import.

Wouldn't life be simpler if you simply used Solr's Jetty container configuration, at least to start with? Is Tomcat a requirement for some reason? You're struggling with things that just work out of the box with Solr, it seems, and I'm wondering why change around what works.

Re: Need help with Solr Performance

On Oct 8, 2008, at 4:03 PM, Rajiv2 wrote: and query times without faceting are... ? solr's built in faceting is simple and has its limits. 15M is higher than i've seen good faceting performance out of, particularly multivalued fields. Erik Hi, My facet fields are multi valued

Practical number of Solr instances per machine

Hello everyone, What is the generally accepted number of solr instances it makes sense to run on a single machine given solr/lucene threading? Servers now commonly have 4 or 8 cpus. Obviously the more instances you run the bigger your JVM heap needs to be and that takes away from OS cache.

Re: Need help with Solr Performance

yes I'm using 1.3 here are the contents of debug.. I'm only pasting the first explain since the whole debug section is very long. lst name=debug str name=rawquerystringcleaning services/str str name=querystringcleaning services/str - str name=parsedquery

Re: Solr 1.3 try to fire delta-import.

Sorry but I can't choose for that very sorry. I will try to make it work with tomcat55, it used to work with solr 1.2 so it should be I don't know a parameter or ??? path or something that I miss for importing? thanks, Erik Hatcher wrote: Wouldn't life be simpler if you simply used

Re: Need help with Solr Performance

- lst name=process double name=time6727.0/double - lst name=org.apache.solr.handler.component.QueryComponent double name=time6457.0/double /lst - lst name=org.apache.solr.handler.component.FacetComponent double name=time0.0/double /lst - So I take it, this is with faceting turned off... what

Re: Need help with Solr Performance

w/ faceting qtime is around +200ms. qtime for a standard query on the default search field is less than 100ms. Usually around 60ms. qtime for id: is around 16ms. ryantxu wrote: - lst name=process double name=time6727.0/double - lst

Re: spellcheck: issues

On Wed, Oct 8, 2008 at 3:31 PM, Jason Rennie [EMAIL PROTECTED] wrote: I just tried J-W and *yes* it seems to do a much better job! I'd certainly vote for that becoming the default :) Ack! I did some more testing and J-W results started to get weird (including suggesting courses for coursets

Re: Need help with Solr Performance

On Oct 8, 2008, at 6:11 PM, Rajiv2 wrote: w/ faceting qtime is around +200ms. if your target time is 250, this will need some work... but lets ignore that for now... qtime for a standard query on the default search field is less than 100ms. Usually around 60ms. qtime for id:

Re: solr + zookeeper

Hi, In such setup, you would definitely want to use zookeeper in conjunction with Solr for at least two things : a) deploy management / (having cron-based pulls for a 128-node setup could be a nightmare without appropriate sync guarantees, coordination, etc) b) configuration distribution

Using the more like this feature in solrj.

Hi! Have been going though the documentation for the more like this/these feature but haven't found anything about how to use it in Solrj. Regards Erik