synonyms problem

2011-06-02 Thread deniz
Hi all, here is a piece from my solfconfig: fieldType name=string class=solr.StrField sortMissingLast=true omitNorms=true analyzer type=query tokenizer class=solr.WhitespaceTokenizerFactory/ filter class=solr.SynonymFilterFactory synonyms=synonyms.txt ignoreCase=true

Re: Solr memory consumption

2011-06-02 Thread Dennis Schafroth
I ran out of memory on some big indexes when using solr 1.4. Found out that increasing termInfosIndexDivisor in solrconfig.xml could help a lot. It may slow down your searching your index. cheers, :-Dennis On 02/06/2011, at 01.16, Alexey Serba wrote: Hey Denis, * How big is your

Re: Faceting on distance in Solr: how do you generate links that search withing a given range of distance?

2011-06-02 Thread Fergus McDowall
On Fri, May 20, 2011 at 12:40 AM, Chris Hostetter hossman_luc...@fucit.org wrote: : It is fairly simple to generate facets for ranges or 'buckets' of : distance in Solr: : http://wiki.apache.org/solr/SpatialSearch#How_to_facet_by_distance. : What isnt described is how to generate the links

How to display search results of solr in to other application.

2011-06-02 Thread Romi
Hi, I am creating indexes using solr which is running on jetty server port 8983, and my application is running on tomcat server port 8080. Now my problem is i want to display the results of search on my application. i created a ajax-javascript page for parsing Json object. now please suggest me

tika and solr 3,1 integration

2011-06-02 Thread Naveen Gupta
Hi I am trying to integrate solr 3.1 and tika (which comes default with the version) and using curl command trying to index few of the documents, i am getting this error. the error is attr_meta field is unknown. i checked the solrconfig, it looks perfect to me. can you please tell me what i am

how to request for Json object

2011-06-02 Thread Romi
How to parse Json through ajax when your ajax pager is on one server(Tomcat)and Json object is of onther server(solr server). i mean i have to make a request to another server, how can i do it . - Thanks Regards Romi -- View this message in context:

Standard Request Handler Boosting

2011-06-02 Thread Sujatha Arun
I want to know what is the difference between the normal Boosting and boosting using functionQuery for the standard request handler In the example below I want to boost the field 2 with higher influence on score Example: field1:query value field2:query value^boost value Example :

Re: how to request for Json object

2011-06-02 Thread olivier sallou
ajax does not allow request to an other domain. Only sway, unless using server side requests, is going through a proxy that would hide the host origin so that ajax request think both servers are the same 2011/6/2 Romi romijain3...@gmail.com How to parse Json through ajax when your ajax pager is

Re: how to request for Json object

2011-06-02 Thread Romi
look at d uploaded file here here it is making request from my local server for Json to server http://api.flickr.com i juss want the same i want to request for Json from local server to solr server. http://lucene.472066.n3.nabble.com/file/n3014191/Jquery_Json.html Jquery_Json.html - Thanks

Re: how to request for Json object

2011-06-02 Thread Romi
sorry for the inconvenience, please look at this file http://lucene.472066.n3.nabble.com/file/n3014224/JsonJquery.text JsonJquery.text - Thanks Regards Romi -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-request-for-Json-object-tp3014138p3014224.html Sent from

Re: Solr memory consumption

2011-06-02 Thread Denis Kuzmenok
Hey Denis, * How big is your index in terms of number of documents and index size? 5 cores, average 250.000 documents, one with about 1 million (but without text, just int/float fields), one with about 10 million id/name documents, but with n-gram. Size: 4 databases about 1G (sum),

Multilingual text analysis

2011-06-02 Thread Juan Antonio Farré Basurte
Hello, Some of the possible analyzers that can be applied to a text field, depend on the language of the text to analyze and can be configured for a concrete language. In my case, the text fields can be in many different languages, but each document also includes a field containing the language

Re: synonyms problem

2011-06-02 Thread Gora Mohanty
On Thu, Jun 2, 2011 at 11:58 AM, deniz denizdurmu...@gmail.com wrote: Hi all, here is a piece from my solfconfig: [...] but somehow synonyms are not read... I mean there is no match when i use a word in the synonym file... any ideas? [...] Please provide further details, e.g., is your field

Question about sorting by coordination factor

2011-06-02 Thread Jesus Gabriel y Galan
Hi, I am trying to solve a sorting problem using Solr. The sorting requirements are a bit complicated. I have to sort the documents by three different criteria: - First by number of keywords that match (coordination factor) - Then, within the documents that match the same number of keywords,

Sorting algorithm

2011-06-02 Thread Richard Hodsdon
Hi, I want to do a similar sorting function query to the way reddit handles its ranking. I have the date stored in a fieldType name=tdate class=solr.TrieDateField omitNorms=true precisionStep=6 positionIncrementGap=0/ I also have the number of twitter, facebook and reads from our site stored.

Re: synonyms problem

2011-06-02 Thread lee carroll
Deniz, it looks like you are missing an index anlayzer ? or have you removed that for brevity ? lee c On 2 June 2011 10:41, Gora Mohanty g...@mimirtech.com wrote: On Thu, Jun 2, 2011 at 11:58 AM, deniz denizdurmu...@gmail.com wrote: Hi all, here is a piece from my solfconfig: [...] but

Re: synonyms problem

2011-06-02 Thread lee carroll
oh and its a string field change this to be text if you need analysis class=solr.StrField lee c On 2 June 2011 11:45, lee carroll lee.a.carr...@googlemail.com wrote: Deniz, it looks like you are missing an index anlayzer ? or have you removed that for brevity ? lee c On 2 June 2011

Re: Multilingual text analysis

2011-06-02 Thread lee carroll
Juan I don't think so. you can try indexing fields like myfield_en. myfield_fr, my field_xx if you now what language you are dealing with at index and query time. you can also have seperate cores for your documents for each language if you don't want to complicate your schema again you will

Re: synonyms problem

2011-06-02 Thread François Schiettecatte
Are you sure solr.StrField is the way to go with this? solr.StrField stores the entire text verbatim and I am pretty sure skips any analysis. Perhaps you should use solr.TextField instead. François On Jun 2, 2011, at 2:28 AM, deniz wrote: Hi all, here is a piece from my solfconfig:

query routing with shards

2011-06-02 Thread Dmitry Kan
Hello all, We have currently several pretty fat logically isolated shards with the same schema / solrconfig (indices are separate). We currently have one single front end SOLR (1.4) for the client code calls. Since a client code query usually hits only one shard, we are considering making a smart

Re: How to display search results of solr in to other application.

2011-06-02 Thread lee carroll
this is from another post and could help Can you use a javascript library which handles ajax and json / jsonp You will end up with much cleaner client code for example a jquery implementation looks quite nice using solrs neat jsonp support: queryString = *:* $.getJSON(

Re: how to request for Json object

2011-06-02 Thread lee carroll
use solrs jasonp format On 2 June 2011 08:54, Romi romijain3...@gmail.com wrote: sorry for the inconvenience, please look at this file http://lucene.472066.n3.nabble.com/file/n3014224/JsonJquery.text JsonJquery.text - Thanks Regards Romi -- View this message in context:

Re: Result Grouping always returns grouped output

2011-06-02 Thread Martijn v Groningen
Hi Karel, group.main=true should do the trick. When that is set to true the group.format is always simple. Martijn On 27 May 2011 19:13, kare...@gmail.com kare...@gmail.com wrote: Hello, I am using the latest nightly build of Solr 4.0 and I would like to use grouping/field collapsing while

Re: how to request for Json object

2011-06-02 Thread François Schiettecatte
This is not really an issue with SOLR per se, and I have run into this before, you will need to read up on 'Access-Control-Allow-Origin' which needs to be set in the http headers that your ajax pager is returning. Beware that not all browsers obey it and Olivier is right when he suggested

tika and solr 3,1 integration error

2011-06-02 Thread Naveen Gupta
Hi I am trying to integrate solr 3.1 and tika (which comes default with the version) and using curl command trying to index few of the documents, i am getting this error. the error is attr_meta field is unknown. i checked the solrconfig, it looks perfect to me. can you please tell me what i am

Re: Question about sorting by coordination factor

2011-06-02 Thread Erick Erickson
Say you're trying to match terms A, B, C. Would something like (A AND B AND C)^1000 OR (A AND B)^100 OR (A AND C)^100 OR (B AND C)^100 OR A OR B OR C work? It wouldn't be an absolute ordering, but it would tend to push the documents where all three terms matched toward the top. It would get

Function Query not getting picked up by Standard Query Parser

2011-06-02 Thread Savvas-Andreas Moysidis
Hello, I'm trying to find out why my Function Query isn't getting picked up by the Standard Parser. More specifically I send the following set of http params (I'm using the _val_ syntax): . lst name=params str name=_val_creationDate^0.01/str str

Re: how to request for Json object

2011-06-02 Thread lee carroll
just to re-iterate jasonp gets round ajax same server policy 2011/6/2 François Schiettecatte fschietteca...@gmail.com: This is not really an issue with SOLR per se, and I have run into this before, you will need to read up on 'Access-Control-Allow-Origin' which needs to be set in the http

Re: how to request for Json object

2011-06-02 Thread Romi
I did this: $(document).ready(function(){ $.getJSON(http://[remotehost]:8983/solr/select/?q=diamondwt=jsonjson.wrf=?;, function(result){ alert(hello + result.response.docs[0].name); }); }); But i am not getting any result, what i did wrong ?? - Thanks Regards Romi -- View this

'deltaImportQuery' attribute is not specified for entity : user

2011-06-02 Thread ZiLi
Hi,I'm try to build a delta index . I really have a entity calls 'user' in data-config.xml like 'entity name=user query= deltaQuery=select p.UserId *** ' but when the index building starts, it always told me failed , when I check the tomcat's log ,it told me that warning then then a java's

Re: How to display search results of solr in to other application.

2011-06-02 Thread Romi
I did this: $(document).ready(function(){ $.getJSON(http://[remotehost]:8983/solr/select/?q=diamondwt=jsonjson.wrf=?;, function(result){ alert(hello + result.response.docs[0].name); }); }); But i am not getting any result, what i did wrong ?? - Thanks Regards Romi -- View this

Re: 'deltaImportQuery' attribute is not specified for entity : user

2011-06-02 Thread Romi
take a look at the following url it might help you. http://wiki.apache.org/solr/DataImportHandler#Using_delta-import_command - Thanks Regards Romi -- View this message in context: http://lucene.472066.n3.nabble.com/how-to-request-for-Json-object-tp3014138p3014805.html Sent from the Solr -

Re: Function Query not getting picked up by Standard Query Parser

2011-06-02 Thread Erik Hatcher
For this to work, _val_: goes *in* the q parameter, not as a separate parameter. See here for more details: http://wiki.apache.org/solr/SolrQuerySyntax#Differences_From_Lucene_Query_Parser Erik On Jun 2, 2011, at 07:46 , Savvas-Andreas Moysidis wrote: Hello, I'm trying to

Re: Sorting algorithm

2011-06-02 Thread Tomás Fernández Löbbe
Hi Richard, all your data seem to be available at indexing time, am I correct? Why don't you do the math at index time and just index the result on a field, on which you can sort later at query time? On Thu, Jun 2, 2011 at 7:26 AM, Richard Hodsdon hodsdon.rich...@gmail.comwrote: Hi, I want

Re: how to request for Json object

2011-06-02 Thread Romi
$.getJSON(http://192.168.1.9:8983/solr/db/select/?q=diamondwt=jsonjson.wrf=?;, function(result){ alert(hello + result.response.docs[0].name); }); }); using this i got the result. But as you can see it is hard coded, i am passing a query in the url how can i make it as user choice. -

Re: NRT facet search options comparison

2011-06-02 Thread Nagendra Nagarajayya
Andy: I did not actually measure and benchmark facet search performance with and without NRT. The screenshots though show the performance impact if you look at the QTime parameter in Fig 1 and Fig 2. I did not notice any appreciable difference in performance when I tested faceting with NRT.

how to make getJson parameter dynamic

2011-06-02 Thread Romi
$.getJSON(http://192.168.1.9:8983/solr/db/select/?q=diamondwt=jsonjson.wrf=?;, function(result){ alert(hello + result.response.docs[0].name); }); }); using this i am parsing solr json response, but as you can see it is hard coded (q=diamond) how can i make it user's choice. i mean user can

Re: Sorting algorithm

2011-06-02 Thread Richard Hodsdon
Thanks for the response, You are correct, but my pseudo code was not. this line var t = (CreationDate - 1131428803) / 1000; should be var t = (CreationDate - now()) / 1000; This will cause the items ranking to depreciate over time. Richard -- View this message in context:

Re: Question about sorting by coordination factor

2011-06-02 Thread Jesus Gabriel y Galan
On 02/06/11 13:32, Erick Erickson wrote: Say you're trying to match terms A, B, C. Would something like (A AND B AND C)^1000 OR (A AND B)^100 OR (A AND C)^100 OR (B AND C)^100 OR A OR B OR C work? It wouldn't be an absolute ordering, but it would tend to push the documents where all three

Re: Function Query not getting picked up by Standard Query Parser

2011-06-02 Thread Savvas-Andreas Moysidis
great, that did it! I can now see the Function Query part in the calculation. Thanks very much Eric, Savvas On 2 June 2011 13:28, Erik Hatcher erik.hatc...@gmail.com wrote: For this to work, _val_: goes *in* the q parameter, not as a separate parameter. See here for more details:

Re: Question about sorting by coordination factor

2011-06-02 Thread Erick Erickson
Ahhh, you're right. I know there's been some discussion in the past about how to find out the number of terms that matched, but don't remember the outcome off-hand. You might try searching the mail archive for something like number of matching terms or some such. Sorry I'm not more help Erick On

Re: Sorting algorithm

2011-06-02 Thread Tomás Fernández Löbbe
OK, then (everything that's available at index time, I'll say it's constant): (Math.log(z) / Math.LN10) (not sure what you mean with Math.LN10) is constant, I'll call it c1 ((y * t) / 45000) = (y/4500)*t -- y/4500 is constant, I'll call it c2. c1+(c2 * t) = c1 + (c2 * (CreationDate - now) /

Re: Multilingual text analysis

2011-06-02 Thread Paul Libbrecht
Juan, An easy way in solr, I think, is indeed to use different fields at index time and expand on multiple fields at query time. I believe using field-names' wildcards allows you to specify a different analyzer per language doing this. There's been long discussions on the

Re: Multilingual text analysis

2011-06-02 Thread Juan Antonio Farré Basurte
Thank you both Paul and Lee for your answer. Luckily in my case there's no problem about knowing language at index time nor we have really to bother about the language of the query, as users can specify the language they are interested in. So I guess our solution would be to use different

Re: Multilingual text analysis

2011-06-02 Thread Paul Libbrecht
Le 2 juin 2011 à 16:27, Juan Antonio Farré Basurte a écrit : Paul, what do you mean when you say it would make sense to start a page at the solr website? I meant the solr wiki. I just had wondered whether it was possible to parametrize the analyzers in function of one field value. I

Re: How to display search results of solr in to other application.

2011-06-02 Thread lee carroll
did you include the jquery lib, make sure you use the jsasoncallback ie $.getJSON( http://[server]:[port]/solr/select/?jsoncallback=?;, {q: queryString, version: 2.2, start: 0, rows: 10, indent: on,

Re: how to make getJson parameter dynamic

2011-06-02 Thread lee carroll
Hi Romi, this is the third thread you have created on this subject. Its not good and will get you ignored by many people who could help. The question relates to js rather than SOLR now. See any good js manual or site for how to assign values to a variable and then concatanate these into a string.

Need Schema help

2011-06-02 Thread Denis Kuzmenok
Hi) What i need: Index prices to products, each product has multiple prices, to each region, country, and price itself. I tried to do with field type long multiple:true, and form value as country code + region code + price (1004000349601, for example), but it has strange

Re: Need Schema help

2011-06-02 Thread lee carroll
Denis, would dynamic fields help: field defined as *_price in schema at index time you index fields named like: [1-9]_[0-99]_price at query time you search the price field for a given country region 1_10_price:[10 TO 100] This may work for some use-cases i guess lee 2011/6/2 Denis Kuzmenok

Re: return unaltered complete multivalued fields with Highlighted results

2011-06-02 Thread alexei
Hi, Here is the code for Solr 3.1 that will preserve all the text and will disable sorting. This goes in solrconfig.xml request handler config or which ever way you pass params: str name=hl.preserveOrdertrue/str This line goes into HighlightParams class: public static final String

RE: Spellcheck Phrases

2011-06-02 Thread Dyer, James
Actually, someone just pointed out to me that a patch like this is unnecessary. The code works as-is if configured like this: float name=thresholdTokenFrequency.01/float (correct) instead of this: str name=thresholdTokenFrequency.01/str (incorrect) I tested this and it seems to work. I'm

Re: Need Schema help

2011-06-02 Thread Denis Kuzmenok
Thursday, June 2, 2011, 6:29:23 PM, you wrote: Wow. This sounds nice. Will try this way. Thanks! Denis, would dynamic fields help: field defined as *_price in schema at index time you index fields named like: [1-9]_[0-99]_price at query time you search the price field for a given country

SolrJ and Range Faceting

2011-06-02 Thread Jamie Johnson
Currently the range and date faceting in SolrJ acts a bit differently than I would expect. Specifically, range facets aren't parsed at all and date facets end up generating filterQueries which don't have the range, just the lower bound. Is there a reason why SolrJ doesn't support these? I have

Re: return unaltered complete multivalued fields with Highlighted results

2011-06-02 Thread Erick Erickson
Hmmm, I don't know a thing about the highlighter code, but if you can just make a patch and create a JIRA (https://issues.apache.org/jira/browse/SOLR) and attach it, it'll get in the system. I suspect you've seen this page, but just in case: http://wiki.apache.org/solr/HowToContribute See,

Re: Need Schema help

2011-06-02 Thread Erick Erickson
This range behavior doesn't make sense. Are you completely sure you're not dropping a digit out someplace? Best Erick 2011/6/2 Denis Kuzmenok forward...@ukr.net: Hi) What i need: Index  prices  to  products, each product has multiple prices, to each region, country, and price itself. I  

Is there a way to get all the hits and score them later?

2011-06-02 Thread arian487
Basically I don't want the hits and the scores at the same time. I want to get a list of hits but I want to score them myself externally (there is a dedicated server that will do the scoring given a list of id's). Thanks! -- View this message in context:

Large number of dynamic fields

2011-06-02 Thread Santiago Bazerque
Hello, I have a 7Gb index having 2MM documents. Each document has about 400 fields, but fields are dynamic and in total I have ~200k fields. We're using SOLR 3.1 and tomcat 5.5. We are seeing very slow start-up times (from tomcat startup to SOLR ready to answer queries about 5 minutes). We have

Re: return unaltered complete multivalued fields with Highlighted results

2011-06-02 Thread Jonathan Rochkind
I could use this feature too, encourage you to submit a patch in JIRA. I wouldn't call the param preserveOrder though -- what it's really doing is returning the whole entire field, with highlighting markers, not just preserving order of fragments. Not sure what to call it, but not

Re: Is there a way to get all the hits and score them later?

2011-06-02 Thread arian487
To clarify. I want to do this all underneath solr. I don't want to get a bunch of hits from solr in my app and then go to my server and score them again. I'd like to score them myself underneath solr before I return the results to my app. -- View this message in context:

Re: Is there a way to get all the hits and score them later?

2011-06-02 Thread Jonathan Rochkind
Well, you can get all the hits by setting rows to a very high value, say a value one more than the total number of docs you have int he database, so all hits will be returned. If there are a lot of them, it won't be quick. If you choose to sort by something other than 'score', I don't know if

Re: Is there a way to get all the hits and score them later?

2011-06-02 Thread Jonathan Rochkind
It sounds to me like maybe you want to implement a custom scoring algorithm in Solr? I have no experience with that, but maybe if you ask and/or google using those words, you'll have more luck. I know it's possible to implement a custom scoring algorithm, but I believe it's kind of tricky,

Re: Searching using a PDF

2011-06-02 Thread Brian Lamb
I mean instead of typing http://localhost:8983/?q=mysearch, I would send a PDF file with the contents of mysearch and search based on that. I am leaning toward handling this before it hits solr however. Thanks, Brian Lamb On Wed, Jun 1, 2011 at 3:52 PM, Erick Erickson

Re: Is there a way to get all the hits and score them later?

2011-06-02 Thread Upayavira
don't know if this is what you mean: you can add 'score' to the fl field list, and it will show you the score for each item. Upayavira On Thu, 02 Jun 2011 11:30 -0700, arian487 akarb...@tagged.com wrote: Basically I don't want the hits and the scores at the same time. I want to get a list of

Re: Searching using a PDF

2011-06-02 Thread Erick Erickson
Not that I know of, you'll probably have to handle this before it hits Solr. Best Erick On Thu, Jun 2, 2011 at 3:10 PM, Brian Lamb brian.l...@journalexperts.com wrote: I mean instead of typing http://localhost:8983/?q=mysearch, I would send a PDF file with the contents of mysearch and search

RE: Anyway to know changed documents?

2011-06-02 Thread Robert Petersen
...and it works really well!!! :) -Original Message- From: Jonathan Rochkind [mailto:rochk...@jhu.edu] Sent: Wednesday, June 01, 2011 5:37 AM To: solr-user@lucene.apache.org Subject: Re: Anyway to know changed documents? On 6/1/2011 6:12 AM, pravesh wrote: SOLR wiki will provide help

Re: tika and solr 3,1 integration

2011-06-02 Thread Juan Grande
Hi Naveen, Check if there is a dynamic field named attr_* in the schema. The uprefix=attr_ parameter means that if Solr can't find an extracted field in the schema, it'll add the prefix attr_ and try again. *Juan* On Thu, Jun 2, 2011 at 4:21 AM, Naveen Gupta nkgiit...@gmail.com wrote: Hi

Sorting

2011-06-02 Thread Clecio Varjao
Hi, When using the following URL: http://localhost:8080/solr/StatReg/select?version=2.2sort=path+ascfl=pathstart=0q=paths%3A%222%2Froot%2FStatReg%2F--+C+--%22hl=offrows=500 I get the result in the following order: [...] /-- C --/Community Care Facility Act [RSBC 1996] c. 60/00_96060REP_01.xml

Re: Is there a way to get all the hits and score them later?

2011-06-02 Thread arian487
Actually I was thinking I wanted to do something before the sharding (like in the layer where faceting happens for example). I wanna hack a plugin in the middle to go to my server after I have a bunch of hits. Just not sure where to do this... Though I've decided I can do scoring from solr

Re: Sorting

2011-06-02 Thread Juan Grande
Hi Clécio, Your problem may be caused by case sensitiveness of string fields. Try using the lowercase field type that comes in the example. Regards, *Juan* On Thu, Jun 2, 2011 at 6:13 PM, Clecio Varjao cleciovar...@gmail.comwrote: Hi, When using the following URL:

Indexes in ramdisk don't show performance improvement?

2011-06-02 Thread Parker Johnson
Hey everyone. Been doing some load testing over the past few days. I've been throwing a good bit of load at an instance of solr and have been measuring response time. We're running a variety of different keyword searches to keep solr's cache on its toes. I'm running two exact same load testing

Re: Solr memory consumption

2011-06-02 Thread Alexey Serba
Commits are divided into 2 groups: - often but small (last changed info) 1) Make sure that it's not too often and you don't have commit overlapping problem. http://wiki.apache.org/solr/FAQ#What_does_.22PERFORMANCE_WARNING:_Overlapping_onDeckSearchers.3DX.22_mean_in_my_logs.3F 2) You may

Hitting the URI limit, how to get around this?

2011-06-02 Thread JohnRodey
I have a master solr instance that I sent my request to, it hosts no documents it just farms the request out to a large number of shards. All the other solr instances that host the data contain multiple cores. Therefore my search string looks like

Re: Indexes in ramdisk don't show performance improvement?

2011-06-02 Thread Erick Erickson
What I expect is happening is that the Solr caches are effectively making the two tests identical, using memory to hold the vital parts of the code in both cases (after disk warming on the instance using the local disk). I suspect if you measured the first few queries (assuming no auto-warming)

Re: Sorting algorithm

2011-06-02 Thread Erick Erickson
It hasn't been committed yet, but you may want to track this JIRA: https://issues.apache.org/jira/browse/SOLR-2136 I happened to notice it over on the dev list, it's about adding if () to function queries. Best Erick 2011/6/2 Tomás Fernández Löbbe tomasflo...@gmail.com: OK, then (everything

Better to have lots of smaller cores or one really big core?

2011-06-02 Thread JohnRodey
I am trying to decide what the right approach would be, to have one big core and many smaller cores hosted by a solr instance. I think there may be trade offs either way but wanted to see what others do. And by small I mean about 5-10 million documents, large may be 50 million. It seems like

DeltaImport records not commited using DIH.

2011-06-02 Thread Anandha Ranganathan
Hi, 1) When I run full-import it works fine and commits all the records. The document count matches table and dataImport.properties is updated with last_index timestamp. 2) After some time I ran the delta import and it is giving enough information but it is not adding the new record into the

Re: Is there a way to get all the hits and score them later?

2011-06-02 Thread arian487
Hmm, looks like I can inherit the Similarity Class and do my own thing there. -- View this message in context: http://lucene.472066.n3.nabble.com/Is-there-a-way-to-get-all-the-hits-and-score-them-later-tp3016424p3018001.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Better to have lots of smaller cores or one really big core?

2011-06-02 Thread Erick Erickson
Take another approach G? Cores are often used for isolation purposes. That is, the data in one core may have nothing to do with another core, the schemas don't have to match etc. They #may# be both logically and physically separate. I don't have measurements for this, so I'm guessing a little.

Re: Indexes in ramdisk don't show performance improvement?

2011-06-02 Thread Parker Johnson
That¹s just the thing. Even the initial queries have similar response times as the later ones. WEIRD! I was considering running from /dev/shm in production, but for slaves only (master remains on disk). At this point though, I'm not seeing a benefit to ramdisk so I think I'm going back to

Re: Indexes in ramdisk don't show performance improvement?

2011-06-02 Thread Trey Grainger
Linux will cache the open index files in RAM (in the filesystem cache) after their first read which makes the ram disk generally useless. Unless you're processing other files on the box with a size greater than your total unused ram (and thus need to micro-manage what stays in RAM), then I

Re: synonyms problem

2011-06-02 Thread deniz
oh thank you for reminding me about string and text issues... I will change it asap... and about index analyzer i just removed if for brevity... i will try again and if it fails will post here again... thank you so much - Zeki ama calismiyor... Calissa yapar... -- View this message in

Re: Hitting the URI limit, how to get around this?

2011-06-02 Thread Jayendra Patil
just a suggestion ... If the shards are know, you can add them as the default params in the requesthandler so they are added always. and the URL would just have the qt parameter. As the limit for uri is browser dependent. How are you querying solr .. any client api ?? through browser ?? is

Re: Debugging a Solr/Jetty Hung Process

2011-06-02 Thread Michael Sokolov
If you have an SNMP infrastructure available (nagios or similar) you should be able to set up a polling monitor that will keep statistics on the number of threads in your jvm and even allow you to inspect their stacks remotely. You can set alarms so you will be notified if cpu thread count

Re: Index vs. Query Time Aware Filters

2011-06-02 Thread Michael Sokolov
It doesn't look like this is supported in any way that is at all straightforward. http://wiki.apache.org/solr/SolrPlugins talks about the easy ways to parameterize plugins, and they don't include what you're after. I think maybe you could extend the query parser you are currently using,

Re: Newbie question: how to deal with different # of search results per page due to pagination then grouping

2011-06-02 Thread Michael Sokolov
Just keep one extra facet value hidden; ie request one more than you need to show the current page. If you get it, there are more (show the next button), otherwise there aren't. You can't page arbitrarily deep like this, but you can have a next button reliably enabled or disabled. On

Re: tika and solr 3,1 integration

2011-06-02 Thread Naveen Gupta
Hi This is fixed .. yes, schema.xml was the culprit and i fixed it looking at the sample schema provided in the sample. But in windows, i am getting slf4j (illegalacess exception) which looks like jar problem. looking at the fixes, suggested in their FAQs, they are suggesting to use 1.5.5

Strategy -- Frequent updates in our application

2011-06-02 Thread Naveen Gupta
Hi We are having an application where every 10 mins, we are doing indexing of users docs repository, and eventually, if some thread is being added in that particular discussion, we need to index the thread again (please note we are not doing blind indexing each time, we have various rules to

RE: solr Invalid Date in Date Math String/Invalid Date String

2011-06-02 Thread Ellery Leung
Hi Erick Here is the error message: Fieldtype: tdate (I use the default one in solr schema.xml) Field value(Index): 2006-12-22T13:52:13Z Field value(query): [2006-12-22T00:00:00Z TO 2006-12-22T23:59:59Z] with '[' and ']' And it generates the result below: ---Start--- HTTP ERROR: 500

Re: Strategy -- Frequent updates in our application

2011-06-02 Thread Otis Gospodnetic
Naveen, Solr does support incremental indexing. Solr currently doesn't make use of Lucene's NRT support, but that is starting to change. If you provide more specifics about issues you are having and your architecture, data and query volume, we may be able to help better. Otis Sematext

Re: Indexes in ramdisk don't show performance improvement?

2011-06-02 Thread Otis Gospodnetic
Park, I think there is no way initial queries will be the same IF: * your index in ramfs is really in RAM * your index in regular FS is not already in RAM due to being previously cached (you *did* flush OS cache before the test, right?) Having said that, if you update your index infrequently

Re: query routing with shards

2011-06-02 Thread Otis Gospodnetic
Hi Dmitry (you may not want to additionally copy Yonik, he's subscribed to this list, too) It sounds like you have the knowledge of which query maps to which shard. If so, why not control/change the value of shards param in the request to your front-end Solr (aka distributed request

java.io.IOException: The specified network name is no longer available

2011-06-02 Thread Gaurav Shingala
Hi, I am using solr 1.4.1 and at the time of updating index getting following error: 2011-06-03 05:54:06,943 ERROR [org.apache.solr.core.SolrCore] (http-10.38.33.146-8080-4) java.io.IOException: The specified network name is no longer available at java.io.RandomAccessFile.readBytes(Native