Re: More terms than documents, impossible to sort on tokenized fields

2009-12-23 Thread Shalin Shekhar Mangar
On Wed, Dec 23, 2009 at 4:05 PM, Pascal Bleser wrote: > Using Solr 1.4 (release) > My complete schema is here, basically a somewhat stripped down version of > the > example's schema.xml, and a few additional fields: > http://pastebin.be/22596 > > I've read past posts on this issue and believe to

Re: Implementing Autocomplete/Query Suggest using Solr

2009-12-23 Thread Shalin Shekhar Mangar
On Thu, Dec 24, 2009 at 2:39 AM, Prasanna R wrote: > On Tue, Dec 22, 2009 at 11:49 PM, Shalin Shekhar Mangar < > shalinman...@gmail.com> wrote: > > > > > > I am curious how an approach that simply uses the wildcard query > > > functionality on an indexed field would work. > > > > > > It works fi

Re: SCHEMA-INDEX-MISMATCH

2009-12-23 Thread johnson hong
Yonik Seeley-2 wrote: > > On Tue, Dec 22, 2009 at 11:41 PM, johnson hong > wrote: >> I use Lucene's NumericField to index "price" field,And query with >> solr.TrieDoubleField. >> When i use "price:[1  TO 5000]" to search,it can return all results that >> price is between 1 and 5000. >> but the

Re: Field Collapsing - disable cache

2009-12-23 Thread rob
Here's the sorlconfig, with a few fields removed from the request (which shouldn't make any difference) http://www.intelcompute.com/solrconfig.xml perhaps an old solrconfig to start with? tho it came no later than a 1.3 standard config file. On Wed 23/12/09 21:33 , Martijn v Groningen wr

Spatial Solr (JTeam)

2009-12-23 Thread Thomas Rabaix
Hello, I would like to set up the spatial solr plugin from http://www.jteam.nl/news/spatialsolr on solr 1.4. However I am getting a error message when solr start. SEVERE: java.lang.NoClassDefFoundError: org/apache/solr/search/QParserPlugin I guess nl.jteam.search.solrext.spatial.SpatialTierQuery

Re: Field Collapsing - disable cache

2009-12-23 Thread Martijn v Groningen
How have you configured field collapsing? I have field collapsing configured without caching like this: and with caching like this: In both situations I don't get NPE. Also the line (in the patch) where the exceptions occurs seems unlikely for a NPE. if (fieldCollapseCache != null) {

Re: Implementing Autocomplete/Query Suggest using Solr

2009-12-23 Thread Prasanna R
On Tue, Dec 22, 2009 at 11:49 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > > > I am curious how an approach that simply uses the wildcard query > > functionality on an indexed field would work. > > > It works fine as long as the terms are not repeated across documents. > > I do n

Re: NOT highlighting synonym

2009-12-23 Thread Erik Hatcher
On Dec 23, 2009, at 2:26 PM, darniz wrote: i have a requirement where we dont want to hightlight synonym matches. for example i search for caddy and i dont want to highlight matched synonym like cadillac. Looking at highlighting parameters i didn't find any support for this. anyone can offer

NOT highlighting synonym

2009-12-23 Thread darniz
Hi Guys. i have a requirement where we dont want to hightlight synonym matches. for example i search for caddy and i dont want to highlight matched synonym like cadillac. Looking at highlighting parameters i didn't find any support for this. anyone can offer any advice. darniz -- View this mess

Re: highlighting and external storage

2009-12-23 Thread Erik Hatcher
Thomas - this is a common need that deserves some implementation. I have a personal interest in seeing this implemented and will do so myself eventually if no one beats me to it. There's a Solr JIRA issue to track this: https://issues.apache.org/jira/browse/SOLR-1397 Erik On Dec

Re: query parsing ( expansion ) in solr

2009-12-23 Thread gudumba l
Hello, Thanks. This would absolutely serve. I thought of doing it in queryparser part which I mentioned in first mail. But if the query is a complex one, then it would become a bit complicated. Thats why I wanted to know whether there is any other way which is similar to the second point

Re: query parsing ( expansion ) in solr

2009-12-23 Thread AHMET ARSLAN
> Hi, >      I have explored > "DisMaxRequestHandler". It could serve for some > of my purposes but not all. > 1) It seems we have to decide that alternative field list > beforehand > and declare them in the config.xml . But the field list for > which > synonyms are to be considered is not definite

Re: query parsing ( expansion ) in solr

2009-12-23 Thread gudumba l
Hi, I have explored "DisMaxRequestHandler". It could serve for some of my purposes but not all. 1) It seems we have to decide that alternative field list beforehand and declare them in the config.xml . But the field list for which synonyms are to be considered is not definite ( at least in the

Re: SolrCore has a large number of SolrIndexSearchers retained in "infoRegistry"

2009-12-23 Thread Grant Ingersoll
On Dec 23, 2009, at 10:15 AM, Jon Poulton wrote: > Hi there, > I'm looking at some problems we are having with some legacy code which uses > Solr (1.3) under the hood. We seem to get repeated OutOfMemory errors on a > 24-48 hour basis searching a relatively small index of 70,000 documents. This

Re: Questions on compound file format

2009-12-23 Thread KennyN
Yonik Seeley wrote: > > Compound was a *lot* slower indexing in past versions of Lucene... > I've noticed the difference with Lucene 2.4.1 and Solr 1.3 of ~40% speed improvement on a RHEL 5.1 system while processing a fresh index of ~500,000 files by turning of the compound file. However, if

SolrCore has a large number of SolrIndexSearchers retained in "infoRegistry"

2009-12-23 Thread Jon Poulton
Hi there, I'm looking at some problems we are having with some legacy code which uses Solr (1.3) under the hood. We seem to get repeated OutOfMemory errors on a 24-48 hour basis searching a relatively small index of 70,000 documents. This may be an error in the way Solr is configured, or it may

Solr 1.4 - stats page slow

2009-12-23 Thread Stephen Weiss
We've been using Solr 1.4 for a few days now and one slight downside we've noticed is the stats page comes up very slowly for some reason - sometimes more than 10 seconds. We call this programmatically to retrieve the last commit date so that we can keep users from committing too frequentl

RE: Implementing Autocomplete/Query Suggest using Solr

2009-12-23 Thread Ankit Bhatnagar
In addition to what Shalin said, you could use the TermsComponent. However you will be better off using the Dismax request handler Ankit -Original Message- From: Shalin Shekhar Mangar [mailto:shalinman...@gmail.com] Sent: Wednesday, December 23, 2009 2:49 AM To: solr-user@lucene.apache.

Re: SCHEMA-INDEX-MISMATCH

2009-12-23 Thread Yonik Seeley
On Tue, Dec 22, 2009 at 11:41 PM, johnson hong wrote: > I use Lucene's NumericField to index "price" field,And query with > solr.TrieDoubleField. > When i use "price:[1  TO 5000]" to search,it can return all results that > price is between 1 and 5000. > but the price value return is > :ERROR:SCHEM

Re: Field Collapsing - disable cache

2009-12-23 Thread rob
Still seeing the same error when trying to comment out the fieldCollapsing block, or even just the fieldCollapseCache block inside it to disable the cache. fresh trunk and latest patch. message null java.lang.NullPointerException at org.apache.solr.search.fieldcollapse.AbstractDocumentCollap

Re: Field Collapsing - disable cache

2009-12-23 Thread rob
Thanks, that latest update to the patch works fine now. On Wed 23/12/09 13:13 , Martijn v Groningen wrote: > Latest SOLR-236.patch is for the trunk, if have updated the latest > patch so it should patch now without conflicts. If I remember > correctly the latest field-collapse-5.patch should

Re: Field Collapsing - disable cache

2009-12-23 Thread Martijn v Groningen
Latest SOLR-236.patch is for the trunk, if have updated the latest patch so it should patch now without conflicts. If I remember correctly the latest field-collapse-5.patch should work for 1.4, but it doesn't for the trunk. 2009/12/23 : > > Sorry, that was when trying to patch the 1.4 branch > >

Re: Field Collapsing - disable cache

2009-12-23 Thread rob
Sorry, that was when trying to patch the 1.4 branch attempting to patch the trunk gives... patching file src/test/test-files/fieldcollapse/testResponse.xml patching file src/test/org/apache/solr/BaseDistributedSearchTestCase.java Hunk #2 FAILED at 502. 1 out of 2 hunks FAILED -- saving rejects t

Re: Field Collapsing - disable cache

2009-12-23 Thread rob
I'm currently trying to patch aginst trunk, using SOLR-236.patch from 18/12/2009 but getting the following error... [...@intelcompute solr]$ patch -p0 < SOLR-236.patch patching file src/test/test-files/solr/conf/solrconfig-fieldcollapse.xml patching file src/test/test-files/solr/conf/schema-fi

Re: Profiling Solr

2009-12-23 Thread Grant Ingersoll
I usually use YourKit or JProfiler, but there are free ones too, like VisualVM. Check out: http://www.lucidimagination.com/blog/2009/09/19/java-garbage-collection-boot-camp-draft/ and http://www.lucidimagination.com/blog/2009/02/09/investigating-oom-and-other-jvm-issues/ On Dec 22, 2009, at 9

More terms than documents, impossible to sort on tokenized fields

2009-12-23 Thread Pascal Bleser
Using Solr 1.4 (release) My complete schema is here, basically a somewhat stripped down version of the example's schema.xml, and a few additional fields: http://pastebin.be/22596 I've read past posts on this issue and believe to mostly understand what caused it, but I cannot find that problem in m

Re: SynonymFilterFactory parseRules

2009-12-23 Thread Kevin Jackson
Hi > I am still looking at "synonyms", and the possibility of having synonyms > loaded via another mechanism than reading from a text file. I am also looking at creating a DBSynonymFilterFactory which will allow us to load the synonyms from a db. I haven't done much apart from getting solr-trun

SynonymFilterFactory parseRules

2009-12-23 Thread Peter A. Kirk
Hi I am still looking at "synonyms", and the possibility of having synonyms loaded via another mechanism than reading from a text file. A few questions: Does anyone know why, in SynonymFilterFactory, the method "parseRules" is package private (actually I'm not sure of the terminology - what I m

Re: Multi Solr

2009-12-23 Thread Yurish
Olala wrote: > > Hi all! > > I have developed Solr on Tomcat, but now I want to building many Solr on > only one Tomcat server.Is that can be done or not??? > I configured my SOLR to use multiple cores. For more information, you can see multicore example, which is in example folder of SOLR.

Re: Search both diacritics and non-diacritics

2009-12-23 Thread Yurish
Olala wrote: > > Hi all! > > I am developing a seach engine with Solr, and now I want to search both > with and without diacritics, for example: if I query kho, it will response > kho, khó, khò,... But if I query khó, it will response only khó. > > Who anyone have solution? I have used class

Re: suggestions for DIH batchSize

2009-12-23 Thread Marc Sturlese
If you want to retrieve a huge volume of rows you will end up with an OutOfMemoryException due to the jdbc driver. Setting batchSize to -1 in your data-config.xml (that internally will set it to Integer.MIN_VALUE) will make the query to be executed in streaming, avoiding the memory exception. Joe