Re: background merge hit exception

2011-03-15 Thread Anurag
Do you mean that earlier it was doing indexing well then all of sudden you started getting this exception? - Kumar Anurag -- View this message in context: http://lucene.472066.n3.nabble.com/background-merge-hit-exception-tp2680625p2680979.html Sent from the Solr - User mailing list archive

Re: Query on facet field¹s count

2011-03-15 Thread William Bell
My patch is for 4.0 trunk. On Fri, Mar 11, 2011 at 10:05 PM, rajini maski rajinima...@gmail.com wrote: Thanks Bill Bell . .This query works after applying the patch you refered to, is it? Please can you let me know how do I need to update the current war (apache solr 1.4.1 )file with this new

Solr query POST and not in GET

2011-03-15 Thread Gastone Penzo
Hi, is possible to change Solr sending query method from get to post? because my query has a lot of OR..OR..OR and the log says to me Request URI too large Where can i change it?? thanx -- Gastone Penzo www.solr-italia.it The first italian blog about SOLR

Re: Solr query POST and not in GET

2011-03-15 Thread Geert-Jan Brits
Yes it's possible. Assuming your using SolrJ as a client-library: set: QueryRequest req = new QueryRequest(); req.setMethod(METHOD.POST); Any other client-library should have a similar method. hth, Geert-Jan 2011/3/15 Gastone Penzo gastone.pe...@gmail.com Hi, is possible to change Solr

Re: Solr query POST and not in GET

2011-03-15 Thread Upayavira
Please do not cross-post between lists - yours seems like a user query to me, so I'm answering it here. As to your question - Solr does not select the request method - you do. I've just tested it and Solr happily accepts a query via a POST request. However, you'd probably do well to look at

Re: keeping data consistent between Database and Solr

2011-03-15 Thread onlinespend...@gmail.com
Solandra is great for adding better scalability and NRT to Solr, but it pretty much just stores the index in Cassandra and insulates that from the user. It doesn't solve the problem of allowing quick and direct retrieval of data that need not be searched. I could certainly just use a Solr search

Re: background merge hit exception

2011-03-15 Thread Isha Garg
On Tuesday 15 March 2011 01:31 PM, Anurag wrote: Do you mean that earlier it was doing indexing well then all of sudden you started getting this exception? - Kumar Anurag -- View this message in context:

Solrj performance bottleneck

2011-03-15 Thread rahul
Hi, I am using Solrj as a Solr client in my project. While searching, for a few words, it seems Solrj takes more time to send response, for eg (8 - 12 sec). While searching most of the other words it seems Solrj take less amount of time only. For eg, if I post a search url in browser, it shows

Re: Solrj performance bottleneck

2011-03-15 Thread Yonik Seeley
On Tue, Mar 15, 2011 at 8:12 AM, rahul asharud...@gmail.com wrote: I am using Solrj as a Solr client in my project. While searching, for a few words, it seems Solrj takes more time to send response, for eg (8 - 12 sec). While searching most of the other words it seems Solrj take less amount

Re: keeping data consistent between Database and Solr

2011-03-15 Thread Shawn Heisey
On 3/14/2011 9:38 PM, onlinespend...@gmail.com wrote: But my main question is, how do I guarantee that data between my Cassandra database and Solr index are consistent and up-to-date? Our MySQL database has two unique indexes. One is a document ID, implemented in MySQL as an autoincrement

Solrj Performance check.

2011-03-15 Thread rahul
Hi, I am using Solrj as a Solr client in my project. While searching, for a few words, it seems Solrj takes more time to send response, for eg (8 - 12 sec). While searching most of the other words it seems Solrj take less amount of time only. For eg, if I post a search url in browser, it shows

Dismax: field not returned unless in sort clause?

2011-03-15 Thread mrw
We have a D field (string, indexed, stored, not required) that is returned * when we search with the standard request handler * when we search with dismax request handler _and the field is specified in the sort parameter_ but is not returned when using the dismax handler and the field is not

RE: keeping data consistent between Database and Solr

2011-03-15 Thread Tim Gilbert
I use Solr + MySql with data coming from several DHI type loaders that I have written to move data from many different databases into my BI solution. I don't use DHI because I am not simply replicating the data, but I am moving/merging/processing the incoming data during the loading. For me, I

Solrj (1.4.1) Performance related query

2011-03-15 Thread rahul
Hi, I am using Solrj as a Solr client in my project. While searching, for a few words, it seems Solrj takes more time to send response, for eg (8 - 12 sec). While searching most of the other words it seems Solrj take less amount of time only. For eg, if I post a search url in browser, it shows

Re: Dismax: field not returned unless in sort clause?

2011-03-15 Thread Ahmet Arslan
--- On Tue, 3/15/11, mrw mikerobertsw...@gmail.com wrote: From: mrw mikerobertsw...@gmail.com Subject: Dismax: field not returned unless in sort clause? To: solr-user@lucene.apache.org Date: Tuesday, March 15, 2011, 3:21 PM We have a D field (string, indexed, stored, not required) that

Re: Solr performance issue

2011-03-15 Thread Shawn Heisey
My solr+jetty+java6 install seems to work well with these GC options. It's a dual processor environment: -XX:+UseConcMarkSweepGC -XX:+CMSIncrementalMode I've never had a real problem with memory, so I've not done any kind of auditing. I probably should, but time is a limited resource.

Re: Solr performance issue

2011-03-15 Thread Markus Jelsma
CMS is very good for multicore CPU's. Use incremental mode only when you have a single CPU with only one or two cores. On Tuesday 15 March 2011 16:03:38 Shawn Heisey wrote: My solr+jetty+java6 install seems to work well with these GC options. It's a dual processor environment:

Sorting 0 values last

2011-03-15 Thread MOuli
Hi @everyone. I want so sort ASC on a price field, but some of the docs got a 0 (not NULL) value. Now I want that this docs are at the end when i sort the price field ascending. Is it possible? Thanks in advance. MOuli -- View this message in context:

Faceting help

2011-03-15 Thread McGibbney, Lewis John
Hello list, I'm trying to use facet's via widget's within Ajax-Solr. I have tried the wiki for general help on configuring facets and constraints and also attended the recent Lucidworks webinar on faceted search. Can anyone please direct me to some reading on how to formally configure facets

Re: Solr performance issue

2011-03-15 Thread Shawn Heisey
The host is dual quad-core, each Xen VM has been given two CPUs. Not counting dom0, two of the hosts have 10/8 CPUs allocated, two of them have 8/8. The dom0 VM is also allocated two CPUs. I'm not really sure how that works out when it comes to Java running on the VM, but if at all

Sorting on multiValued fields via function query

2011-03-15 Thread harish.agarwal
Hello, I believe the most recent builds of Solr have started explicitly throwing an error around sorting on multiValued fields. I'd actually been sorting on multiValued fields for some time without any problems before this, not sure how Solr was able to handle this in the past... In any case,

Solr Query

2011-03-15 Thread Vishal Patel
I am a bit new for Solr. I am running below query in query browser admin interface +RetailPriceCodeID:1 +MSRP:[16001.00 TO 32000.00] I think it should return only results with RetailPriceCode = 1 ad MSRP between 16001 and 32000. But it returns all resuts with MSRP = 1 and doesnt consider 2nd

Re: Sorting 0 values last

2011-03-15 Thread Gora Mohanty
On Tue, Mar 15, 2011 at 9:04 PM, Yonik Seeley yo...@lucidimagination.com wrote: On Tue, Mar 15, 2011 at 10:35 AM, MOuli zar...@hotmail.de wrote: I want so sort ASC on a price field, but some of the ouldocs got a 0 (not NULL) value. Now I want that this docs are at the end when i sort the

Re: Solr Query

2011-03-15 Thread Geert-Jan Brits
But it returns all resuts with MSRP = 1 and doesnt consider 2nd query at all. I believe you mean: 'it returns all results with RetailPriceCodeID = 1 while ignoring the 2nd query?' If so, please check that your default operator is set to AND in your schema config. Other than that, your syntax

Re: Dynamically boost search scores

2011-03-15 Thread Brian Lamb
Thank you for the advice. I looked at the page you recommended and came up with: http://localhost:8983/solr/search/?q=dogfl=boost_score,genus,species,scorerows=15bf=%22ord%28sum%28boost_score,1%29%29 ^10%22 But appeared to have no effect. The results were in the same order as they were when I

Re: keeping data consistent between Database and Solr

2011-03-15 Thread onlinespend...@gmail.com
That's pretty interesting to use the autoincrementing document ID as a way to keep track of what has not been indexed in Solr. And you overwrite this document ID even when you modify an existing document. Very cool. I suppose the number can even rotate back to 0, as long as you handle that. I

Re: problem using dataimporthandler

2011-03-15 Thread sivaram
Regarding the DIH problem: I'm encountering content not allowed in prolog only when I'm deploying solr on tomcat. I'm using the same data-config.xml in the solr example through jetty and it works fine and I can index the data. Please let me know what should be changed while using tomcat. Thanks,

Re: Dynamically boost search scores

2011-03-15 Thread Ahmet Arslan
the page you recommended and came up with: http://localhost:8983/solr/search/?q=dogfl=boost_score,genus,species,scorerows=15bf=%22ord%28sum%28boost_score,1%29%29 ^10%22 But appeared to have no effect. The results were in the same order as they were when I left off the bf parameter. So

partial optimize does not reduce the segment number to maxNumSegments

2011-03-15 Thread Renee Sun
I have a core with 120+ segment files and I tried partial optimize specify maxNumSegments=10, after the optimize the segment files reduced to 64 files; I did the same optimize again, it reduced to 30 something; this keeps going and eventually it drops to teen number. I was expecting seeing the

Re: problem using dataimporthandler

2011-03-15 Thread sivaram
I got rid of the problem by just copying the other schema and config files( which sound like nothing to do with the error on the dataconfig file but I gave it a try) and it worked I don't know if I'm missing something here but its working now. Thanks, Ram. -- View this message in context:

Re: problem using dataimporthandler

2011-03-15 Thread Peter Sturge
Could possibly be your original xml file was in unicode (with a BOM header - FFFE or FEFF) - xml will see it as content if the underlying file system doesn't handle it. On Tue, Mar 15, 2011 at 10:00 PM, sivaram yogendra.bopp...@gmail.com wrote: I got rid of the problem by just copying the other

Re: Faceting help

2011-03-15 Thread Upayavira
I'm not sure if I get what you are trying to achieve. What do you mean by constraint? Are you saying that you effectively want to filter the facets that are returned? e.g. for source field, you want to show html/pdf/email, but not, say xls or doc? Upayavira On Tue, 15 Mar 2011 15:38 +,

Re: accessing the analyzers in a component?

2011-03-15 Thread Paul Libbrecht
Thanks Ahmet, I indicated that in the wiki at http://wiki.apache.org/solr/AnalyzersTokenizersTokenFilters My solution was a little bit different since I wanted to get the analyzer per field name: rb.getSchema().getField(name).getFieldType().getAnalyzer() thanks again! paul Le 15 mars 2011

stopFilterFactor and SnowballPorterFilterFactory not work for Spanish

2011-03-15 Thread cyang2010
I am using solr 1.4.1. I am trying to index a spanish field using the following tokenizer/filters: Using field analysis solr Admin i can tell StopFilterFactory and SnowballPorterFilterFactory with Spanish not working right: 1. after

Re: stopFilterFactor and SnowballPorterFilterFactory not work for Spanish

2011-03-15 Thread Robert Muir
On Tue, Mar 15, 2011 at 7:07 PM, cyang2010 ysxsu...@hotmail.com wrote: I just copied the text from this URL to form my stopwords_es.txt: http://svn.apache.org/repos/asf/lucene/dev/trunk/modules/analysis/common/src/resources/org/apache/lucene/analysis/snowball/spanish_stop.txt you cannot use

Re: Getting Category ID (primary key)

2011-03-15 Thread Chris Hostetter
: If it works, it's performant and not too messy it's a good way :-) . You can : also consider just faceting on Id, and use the id to fetch the categoryname : through sql / nosql. : That way your logic is seperated from your presentation, which makes : extending (think internationalizing, etc.)

Re: background merge hit exception

2011-03-15 Thread Erick Erickson
The stack trace indicates there's an issue with optimizing. How are you kicking off optimizing? Is it automatic or manual? 34G for an index with that many documents does seem excessive. Are you re-indexing the same content with the same unique key? In other words do you have a large number of

Re: Sorting 0 values last

2011-03-15 Thread Chris Hostetter
: Not sure how you are indexing, but in addition to the above : suggestion by Yonik, one could ignore 0's at indexing time, : i.e., ensure that 0 values for that field are not indexed, and : use sortMissingLast. Once upon a time i had a usecase where i was indexing product data, and in thta

Re: stopFilterFactor and SnowballPorterFilterFactory not work for Spanish

2011-03-15 Thread cyang2010
Robert, Thanks for your advice. I modified my stopword text file. Now the stopwordFilter start to work. But the stemming related filter (SnowballPorterFilterFactory-- spanish) still not working. Anyone have any idea on that? Thanks, cyang -- View this message in context:

Re: stopFilterFactor and SnowballPorterFilterFactory not work for Spanish

2011-03-15 Thread Robert Muir
On Tue, Mar 15, 2011 at 8:50 PM, cyang2010 ysxsu...@hotmail.com wrote: Robert, Thanks for your advice.  I modified my stopword text file.  Now the stopwordFilter start to work. But the stemming related filter (SnowballPorterFilterFactory-- spanish) still not working.  Anyone have any idea

Re: stopFilterFactor and SnowballPorterFilterFactory not work for Spanish

2011-03-15 Thread cyang2010
Sorry Robert. I just use some text translated by someone. Maybe that translation is not right. Could you please give me a spanish term which i can show the spanish stemming factory is working? Thanks, cyang -- View this message in context:

Tokenizing Chinese multi-language search

2011-03-15 Thread Andy
Hi, I remember reading in this list a while ago that Solr will only tokenize on whitespace even when using CJKAnalyzer. That would make Solr unusable on Chinese or any other languages that don't use whitespace as separator. 1) I remember reading about a workaround. Unfortunately I can't find

Re: stopFilterFactor and SnowballPorterFilterFactory not work for Spanish

2011-03-15 Thread cyang2010
I just tried with some real spanish text: Alquileres -- = org.apache.solr.analysis.LowerCaseFilterFactory {} term position 1 term text alquileres term type word source start,end4,14 payload

Trunk Compile failure/ hang

2011-03-15 Thread Viswa S
Hello, I am trying to build source out of trunk (to apply a patch) and ran into an issue were the build process hangs ( below output) during build lucene at sanity-load-lib. Just when build sanity-load-lib starts, I see an dialog box asking for applet access permission The applet is

noobie question: sorting

2011-03-15 Thread James Lin
Hi Guys, came across this sorting query query ({!v=category: 445}) desc I understand it is sorting on exact match of category = 445, I don't quite understand the syntax, could someone please elaborate a bit for me? So I can reuse this syntax in the future. Regards James

Re: Tokenizing Chinese multi-language search

2011-03-15 Thread Otis Gospodnetic
Hi Andy, Is the I don't know what language the query is in something you could change by... - asking the user - deriving from HTTP request headers - identifying the query language (if queries are long enough and texty) - ... Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch

Re: Sorting on multiValued fields via function query

2011-03-15 Thread David Smiley (@MITRE.org)
Hi Harish. Did sorting on multiValued fields actually work correctly for you before? I'd be surprised if so. I could be wrong but I think you previously always got the sorting affects of whatever was the last indexed value. It is indeed the case that the FieldCache only supports up to one

SOLR DIH importing MySQL text column as a BLOB

2011-03-15 Thread Kaushik Chakraborty
I've a column for posts in MySQL of type `text`, I've tried corresponding `field-type` for it in Solr `schema.xml` e.g. `string, text, text-ws`. But whenever I'm importing it using the DIH, it's getting imported as a BLOB object. I checked, this thing is happening only for columns of type `text`

Re: Different options for autocomplete/autosuggestion

2011-03-15 Thread Otis Gospodnetic
Hi, I actually don't follow how field collapsing helps with autocompletion...? Over at http://search-lucene.com we eat our own autocomplete dog food: http://sematext.com/products/autocomplete/index.html . Tasty stuff. Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene

Re: Problem with field collapsing of patched Solr 1.4

2011-03-15 Thread Otis Gospodnetic
Kai, try SOLR-1086 with Solr trunk instead if trunk is OK for you. Otis Sematext :: http://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ - Original Message From: Kai Schlamp kai.schl...@googlemail.com To: solr-user@lucene.apache.org

Re: Tokenizing Chinese multi-language search

2011-03-15 Thread Andy
Hi Otis, It doesn't look like the last 2 options would work for me. So I guess my best bet is to ask the user to specify the language when they type in the query. Once I get that information from the user, how do I dynamically pick an analyzer for the query string? Thanks Andy --- On Tue,

Stemming question

2011-03-15 Thread Bill Bell
When I use the Porter Stemmer in Solr, it appears to take works that are stemmed and replace it with the root work in the index. I verified this by looking at analysis.jsp. Is there an option to expand the stemmer to include all combinations of the word? Like include 's, ly, etc? Other options

Re: noobie question: sorting

2011-03-15 Thread David Smiley (@MITRE.org)
Hi. Where did you find such an obtuse example? Recently, Solr supports sorting by function query. One such function is named query which takes a query and uses the score of the result of that query as the function's result. Due to constraints of where this query is placed within a function