Re: Listening on SolrCloud events

2014-07-04 Thread Ugo Matrangolo
Hi, thank you very much for the answers. I think the best way is to write a little Zookeeper watcher myself and react on event of interest. Thank you, Ugo On Thu, Jul 3, 2014 at 9:42 PM, Jeff Wartes jwar...@whitepages.com wrote: If you¹re using SolrJ, CloudSolrServer exposes the

Re: How to get related facets using Solr query ?

2014-07-04 Thread Erik Hatcher
Why isn't IJK not under AB too? Are the Facet field names different? Pivot facets looks like what you want. facet.pivot=field1,field2 if they are different field names. Erik On Jul 3, 2014, at 20:15, Shamik Bandopadhyay sham...@gmail.com wrote: Hi, I've trying construct a facet

Using solr for image retrieval - very long response time

2014-07-04 Thread Yossi Biton
Hello there, Recently I was trying to implement the bag-of-words model for image retrieval by using Solr. Shortly this model consists of extracting visual words from images and then use tf-idf schema for fast querying (usually include also re-ranking stage). I found solr as a suitable platform

Re: Using solr for image retrieval - very long response time

2014-07-04 Thread Jack Krupansky
I would expect an excessively long query (greater than dozens or low hundreds of terms) to run significantly slower, but 100 seconds does seem excessively slow even for a 1000-term query. Add the debugQuery=true parameter to your query request and checking the timing section to see if the

Re: Using solr for image retrieval - very long response time

2014-07-04 Thread Yossi Biton
1. debugQuery shows almost all of the time spent in query. 2. i cant look right now at the heap, but i remember i allocated 4gb for the JVM and it's far from being fully used. Regarding GC im not sure how to check it (gc.log ?). 3. The whole index fits in memory during the query. On Jul 4, 2014

multilingual search

2014-07-04 Thread benjelloun
Hello, what i need to do is to detect language of my fields then when i search with /select RequestHandler how can i define for a search to detect the language of words to choose which field_langid use. my conf: updateRequestProcessorChain name=langid processor

Re: multilingual search

2014-07-04 Thread Jack Krupansky
What leads you to believe that the user is not interested in occurrences of the French phrase in English text? I mean, we English-speakers and writers like to use French phrases to show how sophisticated we are! It's part of our... raison d'être. If I do a Google search for raison d'être, it

Solr 4.7 Payload

2014-07-04 Thread Ranjith Venkatesan
Hi all, I am evaluating Payload of lucene. I am using solr4.7.2 for this. I could able to index with payload, but i couldnt able to retrieve payload from DocsAndPositionsEnum. It is returning just null. But terms.hasPayloads() is returning true. And i can able to see payload value in luke (image

Re: multilingual search

2014-07-04 Thread Paul Libbrecht
To do just what Jack described, I often write a solr query component that does query expansion. Based on some parameters I can recognize to be a language hint (e.g. the language of the environment they search in, the browser's accept-language) I reformulate the query into a query in the fields

Re: Field for 'species' data?

2014-07-04 Thread Dan Bolser
The problem is that each document has a single species (or super-species, or sub-species), and needs to get information about it's place in the hierarchy 'elsewhere', i.e. in an externally encoded hierarchy. I don't, for example, have data in this format: SPECIES: Hordeum / Hordeum vulgare /

Re: multilingual search

2014-07-04 Thread Jack Krupansky
Indeed, a Solr search component to customize the incoming query for query language can work as well. Add it to the search components before the query component, have it call the language detection code on the q parameter, and then modify the qf parameter based on the language discovered. Two

Re: multilingual search

2014-07-04 Thread Paul Libbrecht
1. Modify the qf parameter directly by either adding the _xx language suffix to each field in qf, or replacing the xx for any qf fields that already have an _xx suffix. 2. Have separate qf_xx parameters which are customized for specific languages and then copy the language-specific qf_xx

Re: java.net.SocketException: Connection reset

2014-07-04 Thread heaven
Today this had happened again + this one: null:java.net.SocketException: Broken pipe at java.net.SocketOutputStream.socketWrite0(Native Method) at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:113) at

Re: Field for 'species' data?

2014-07-04 Thread Jack Krupansky
I haven't fully digested your species hierarchy requirements, but you can do just about anything in a Solr update processor. So you can parse the string and then put pieces into different fields to represent portions of the hierarchy. Then at query time, your application facet navigation is

Re: Field for 'species' data?

2014-07-04 Thread Dan Bolser
I think I need to lookup the given species value in a taxonomy, build the 'path' and pass the result to the path hierarchy tokenizer or similar. I figure I'll do this with a field analyzer. On 4 Jul 2014 22:30, Jack Krupansky j...@basetechnology.com wrote: I haven't fully digested your species

Re: How to get related facets using Solr query ?

2014-07-04 Thread shamik
Thanks for the pointer Eric. You are right, I forgot to include IJK under AB. Also, facet field names are different. Unfortunately, I'm using Solrcloud and facet pivot doesn't seem to work in a distributed mode. I'll get back some result if I use distrib=false, but then it's not the right data.

Re: Field for 'species' data?

2014-07-04 Thread Alexandre Rafalovitch
Do that with a custom update request processor. Just remember Solr is there to find things not to preserve structure. So mangle your data until you can find it. Also check if SirenDB would fit your requirements if you want to encode the information as complex structure. Regards, Alex