Re: Rebuild index after database change

2012-07-31 Thread Rodrigo P. Bregalanti
Thank you very much Chantal! As I am not too much familiar with Solr, will read some tutorials and try to setup a Solr server using the existent configuration files. In addition, I will post the results here. Thanks a lot! Best regards. -- View this message in context: http://lucene.472066

Re: Memory leak?? with CloseableThreadLocal with use of Snowball Filter

2012-07-31 Thread Erick Erickson
I wasn't in on tracking down the original issue, but I know at least one client ran into a problem with weak hash references that was a bug in the JVM here: http://bugs.sun.com/bugdatabase/view_bug.do?bug_id=7112034 Here's the summary: Parallel CMS (ie with more than one CMS marking thread) does

Re: Is SOLR best suited to this application - Finding co-ordinates

2012-07-31 Thread Lance Norskog
How many unique places, coordinates and results do you have? Solr works very well when you denormalize your data into one document per searchable combination. It can handle tens of millions of these records without a problem. On Tue, Jul 31, 2012 at 3:17 AM, Spadez wrote: > I already have a SOLR

Re: solr/tomcat stops responding

2012-07-31 Thread roz dev
You are referring to a very old thread Did you take any heap dump and thread dumo? They can help you get more insight. -Saroj On Tue, Jul 31, 2012 at 9:04 AM, Suneel wrote: > Hello Kevin, > > I am also facing same problem After few hours or few day my solr server > getting crash. > I try t

Re: leaks in solr

2012-07-31 Thread Karthick Duraisamy Soundararaj
Just in case, if someone else is stomping on to the same kind of issue, check the tomcat webapps directory and try deploying it after cleaning it out.. I had a version without subQueries.get(i).close(); deployed earlier and then added a new version with subQueries.get(i).close(); But the tomca

Solr upgrade from 1.4 to 3.6

2012-07-31 Thread Manepalli, Kalyan
Hi all, We are trying to upgrade our solr instance from 1.4 to 3.6. We use SolrJ API to fetch the data from index. We see that SolrJ 3.6 version is not compatible with index generated with 1.4. Is this known issue and is there a workaround for this. Thanks, Kalyan Manepalli

Re: Updating document with the Solr Java API

2012-07-31 Thread Jonatan Fournier
On Tue, Jul 31, 2012 at 10:16 AM, Jonatan Fournier wrote: > Hi, > > What is the Java syntax to create an update document? > > I was using this in JSON to update/reset some fields of document 12345 > (it contains other fields, only updating those): > > { > "add" : { > "doc" : { > "id":"

Memory leak?? with CloseableThreadLocal with use of Snowball Filter

2012-07-31 Thread roz dev
Hi All I am using Solr 4 from trunk and using it with Tomcat 6. I am noticing that when we are indexing lots of data with 16 concurrent threads, Heap grows continuously. It remains high and ultimately most of the stuff ends up being moved to Old Gen. Eventually, Old Gen also fills up and we start

Re: Word Delimiter issue

2012-07-31 Thread Michael Della Bitta
It looks like the fact that this duplicate token is generated by WordDelimiter after StopFilter means that it's not filtered out. In any case, a search on "david david" against this field does find documents with values like "David's" as well as "David, David, David..." Michael Della Bitta -

Re: Word Delimiter issue

2012-07-31 Thread Michael Della Bitta
Yes, that had occurred to me too, but I wasn't exposed to the original query from the developer who was having the trouble, just the text and strange analysis. I'll confer with him to make sure there's actually something to work on here. Michael Della Bitta ---

Re: solr 1872

2012-07-31 Thread Sujatha Arun
Thanks,Peter .Will try this. Regards Sujatha On Tue, Jul 31, 2012 at 3:55 PM, Peter Sturge wrote: > Hi, > > The acl file usually goes in the conf folder, so if you specify different > conf folders for each core, you could have a different one for each. > The acl file can also be specified in sol

BitSet field type in solr

2012-07-31 Thread Dazhi Jiao
Hi, I am new to solr and I apologize if I am not using the right terms in my question. I want to use solr to store and search for some chemistry data. For each molecule (represented as a string), I can convert it into a bitset representation (fixed length). To search for the molecule, the similari

Re: Word Delimiter issue

2012-07-31 Thread Jack Krupansky
I agree that it would make more sense for the catenated word ("johnsons") to be at the same position as the leading word ("johnson"). But, what are some example queries that would "fail" given this behavior? "johnson and johnson" would not falsely match since you have position increment enable

Word Delimiter issue

2012-07-31 Thread Michael Della Bitta
Hello all, We're running into a weird issue with Word Delimiter and apostrophes. For a text field that uses the out of the box field definition: (note that com.jodange.solr.KStemFilterFactory is a backport of KStem for Solr 1.4 we hacked together.) The phrase "That is not tru

Re: solr/tomcat stops responding

2012-07-31 Thread Suneel
Hello Kevin, I am also facing same problem After few hours or few day my solr server getting crash. I try to download following patch but its not accessible now. i am using 3.1 version of solr. http://people.apache.org/~yonik/solr/current/solr.war - Regards, Suneel Pandey Sr. Software

Updating document with the Solr Java API

2012-07-31 Thread Jonatan Fournier
Hi, What is the Java syntax to create an update document? I was using this in JSON to update/reset some fields of document 12345 (it contains other fields, only updating those): { "add" : { "doc" : { "id":"12345", "foo":{"set":null}, "bar":{"set":"baz"} } } } Now I

Re: solrconfig.xml | registration of JSPs

2012-07-31 Thread Paul Libbrecht
Le 31 juil. 2012 à 14:07, Roland Ucker a écrit : > Is it possible to map a request URL to a JSP in the solrconfig.xml? Roland, not in the solrconfig.xml but it's not too hard to make a wrapper that can do that... I have code here that does this (actually forwards the requests to anything, not j

solrconfig.xml | registration of JSPs

2012-07-31 Thread Roland Ucker
Is it possible to map a request URL to a JSP in the solrconfig.xml?

Re: Expression Sort in Solr

2012-07-31 Thread Mikhail Khludnev
how exactly? On Tue, Jul 31, 2012 at 1:19 PM, lavesh wrote: > yes i have, its not working as per need > > > > -- > View this message in context: > http://lucene.472066.n3.nabble.com/Expression-Sort-in-Solr-tp3998050p3998310.html > Sent from the Solr - User mailing list archive at Nabble.com. >

Re: solr 1872

2012-07-31 Thread Peter Sturge
Hi, The acl file usually goes in the conf folder, so if you specify different conf folders for each core, you could have a different one for each. The acl file can also be specified in solrconfig.xml, under the SolrACLSecurity section: acl.xml If you use a different solrconfig.xml for each c

Re: Is SOLR best suited to this application - Finding co-ordinates

2012-07-31 Thread Spadez
I already have a SOLR server up and running which is designed to receive keywords and co-ordinates and result item results. The way I see it I have three options: 1. Have one "geocode" solr server to convert place names to co-ordinates and another seperate Solr server to turn the items results. 2

Re: Rebuild index after database change

2012-07-31 Thread Chantal Ackermann
Hi Rodrigo, as I understand it, you know where the index is located. If you can also find out where the configuration files are - if they are simply accessible on the FS - you could start a regular SOLR server that simply uses that config directory as SOLR_HOME (it will automatically use the co

Re: Is SOLR best suited to this application - Finding co-ordinates

2012-07-31 Thread Paul Libbrecht
Solr is definitely well suited for this. Depending on your client, getting json or xml is definitely super high performance for such a data set that barely changes. Make sure you make the right params in the queries, solr caching will then provide you amazing performances. paul Le 31 juil. 201

Re: Rebuild index after database change

2012-07-31 Thread Rodrigo P. Bregalanti
Hi Chantal, thanks for replying. It is very helpfull, and I think I am in the right path. As the database is not changed during the night, my idea is to add a cron job to re-index that at this time. The main problem is there is no separate service indexing the data. The applicaton is using Java+Gr

Re: Expression Sort in Solr

2012-07-31 Thread lavesh
yes i have, its not working as per need -- View this message in context: http://lucene.472066.n3.nabble.com/Expression-Sort-in-Solr-tp3998050p3998310.html Sent from the Solr - User mailing list archive at Nabble.com.

Is SOLR best suited to this application - Finding co-ordinates

2012-07-31 Thread Spadez
I am trying to make a system that returns co-ordinates for a given "town", "city", "country" or "postcode" query. I want to return the data in the fastest way possible since the server is going to be hammered and is going to need real concurency. Is Solr a good software solution to this? Would I

Re: Bulk Indexing

2012-07-31 Thread Mikhail Khludnev
Usually collecting whole array hurts client's jvm JVM, sending doc-by-doc bloats sever by huge number of small requests. You need just rewrite your code from the eager loop to pulling iterator to be able to submit all docs via single http request http://wiki.apache.org/solr/Solrj#Streaming_document

Re: Expression Sort in Solr

2012-07-31 Thread Mikhail Khludnev
Hello, have you tried http://wiki.apache.org/solr/FunctionQuery/#if ? On Mon, Jul 30, 2012 at 3:05 PM, lavesh wrote: > I am working on solr for search. I required to perform a expression sort > such > that : > > say str = ((IF AVAILABLE IN (1,2,3),100,IF(AVAILABLE IN (4,5,6),80,100)) + > IF(PRI

Re: Rebuild index after database change

2012-07-31 Thread Chantal Ackermann
Hi Rodrigo, the data will only show in SOLR if the index is built after the data has been committed to the database it reads the data from. If the data does not show up in the index there could be several reasons why that is: a) different database b) permissions prevent that the data is visible