Json facet 6.1 Filter based on command query's output

2016-11-15 Thread Jai
Hi is it possible to filter results based on out put of command query in json facet solr6.1. For example in below query i am converting duration_seconds to average time in minutes. i want to return results where time in minute is greator than 30 minutes? json.facet:{files:{type:terms,

getting following error while building solr wit ant

2016-11-15 Thread Midas A
io problem while parsing ivy file: http://repo1.maven.org/maven2/org/apache/ant/ant/1.8.2/ant-1.8.2.pom:

Re: Measuring the entropy of a field

2016-11-15 Thread Joel Bernstein
You may be interested in: https://github.com/apache/lucene-solr/blob/master/solr/core/src/java/org/apache/solr/search/IGainTermsQParserPlugin.java This iterates through a training set and scores terms in a text field using Information Gain. You'll see entropy calculations in the implementation.

Re: book for Solr 3.4?

2016-11-15 Thread HelponR
Thank you. Just found one here https://wiki.apache.org/solr/SolrResources "Apache Solr 3 Enterprise Search Server by David Smiley and Eric Pugh. This is the 2nd edition of the first book, published by Packt. Essential reading for developers, this book

Re: book for Solr 3.4?

2016-11-15 Thread Deeksha Sharma
BTW its Apache Solr 4 Cookbook From: Deeksha Sharma Sent: Tuesday, November 15, 2016 2:06 PM To: solr-user@lucene.apache.org Subject: Re: book for Solr 3.4? Apache solr cookbook will definitely help you get started. This is in

Re: book for Solr 3.4?

2016-11-15 Thread Deeksha Sharma
Apache solr cookbook will definitely help you get started. This is in addition to the Apache Solr official documentation. Thanks Deeksha From: HelponR Sent: Tuesday, November 15, 2016 2:03 PM To: solr-user@lucene.apache.org

Re: empty strings outputting to numeric field types

2016-11-15 Thread Chris Hostetter
: fields storing dollar values as tdouble. they don't always exist in the : outputted rows, however, at which point they throw an error and fail at : indexing because the field is seen as an empty string (the log message: str : = ''). : : for now i've gotten around this by skipping out of any

book for Solr 3.4?

2016-11-15 Thread HelponR
Hello! Is there a good book for Solr 3.4? The "Solr in Action" is for 4.4. googling did not help:( Thanks!

empty strings outputting to numeric field types

2016-11-15 Thread John Blythe
hi all. i'm outputting our data to xml format for solr to consume. i have several fields storing dollar values as tdouble. they don't always exist in the outputted rows, however, at which point they throw an error and fail at indexing because the field is seen as an empty string (the log message:

Re: Issue with empty strings not being indexed/stored?

2016-11-15 Thread Chris Hostetter
You'll have to give us more details on what exactly you are doing to reproduce the problem you are seeing, and more detals on how exactly you upgraded (and what version you upgraded from) ... https://wiki.apache.org/solr/UsingMailingLists When i launch 6.3.0 using "bin/solr -e

Re: solr shutdown

2016-11-15 Thread Mark Miller
That is probably partly because of hdfs cache key unmapping. I think I improved that in some issue at some point. We really want to wait by default for a long time though - even 10 minutes or more. If you have tons of SolrCores, each of them has to be torn down, each of them might commit on

Re: autoAddReplicas:true not working

2016-11-15 Thread Mark Miller
Look at the Overseer host and see if there are any relevant logs for autoAddReplicas. - Mark On Mon, Oct 24, 2016 at 3:01 PM Chetas Joshi wrote: > Hello, > > I have the following configuration for the Solr cloud and a Solr collection > This is Solr on HDFS and Solr

Re: ClassNotFoundException with Custom ZkACLProvider

2016-11-15 Thread Mark Miller
Could you file a JIRA issue so that this report does not get lost? - Mark On Tue, Nov 15, 2016 at 10:49 AM Solr User wrote: > For those interested, I ended up bundling the customized ACL provider with > the solr.war. I could not stomach looking at the stack trace in the

Re: index and data directories

2016-11-15 Thread Erick Erickson
Oh, and to make matters even more "interesting", for docValues=true fields there's no need to even store anything, you can return the fields in the fl list that are docValues=true, stored=false... On Tue, Nov 15, 2016 at 1:53 AM, Prateek Jain J wrote: > > Thanks

Re: 5.5.3: fieldValueCache auto-warming error

2016-11-15 Thread Erick Erickson
Thanks for letting us know. I raised a JIRA but I won't have time to work on it in the foreseeable future. Erick On Tue, Nov 15, 2016 at 6:24 AM, Bram Van Dam wrote: > On 11/11/16 18:08, Bram Van Dam wrote: >> On 10/11/16 17:10, Erick Erickson wrote: >>> Just facet on the

Issue with empty strings not being indexed/stored?

2016-11-15 Thread Michael Joyner
Hello all, We've been indexing documents with empty strings for some fields. After our latest round of Solr/SolrJ updates to 6.3.0 we have discovered that fields with empty strings are no longer being stored, effectively storing documents with those fields as being NULL/NOT-PRESENT instead of

Re: ClassNotFoundException with Custom ZkACLProvider

2016-11-15 Thread Solr User
For those interested, I ended up bundling the customized ACL provider with the solr.war. I could not stomach looking at the stack trace in the logs. On Mon, Nov 7, 2016 at 4:47 PM, Solr User wrote: > This is mostly just an FYI regarding future work on issues like SOLR-8792.

RE: Multi word synonyms

2016-11-15 Thread Davis, Daniel (NIH/NLM) [C]
Midas, I apparently I didn't read carefully enough, Ted Sullivan has in the configuration of this AutoPhrasingTokenFilter a configuration file "autophrases.txt". It only recognizes phrases that are in that file. Because of this, it doesn't seem directly applicable to your problem of

RE: Multi word synonyms

2016-11-15 Thread Davis, Daniel (NIH/NLM) [C]
I'm not as expert as some on this list, but reading the article suggested, https://lucidworks.com/blog/2014/07/12/solution-for-multi-term-synonyms-in-lucenesolr-using-the-auto-phrasing-tokenfilter/, what you do is this: - Have one field that takes text as normal - Copy that field to another

Measuring the entropy of a field

2016-11-15 Thread Davis, Daniel (NIH/NLM) [C]
Does Lucene/Solr include any tools for measuring the entropy/information of a field? My intuition is that this would only work if the field were a single-value field and the analysis identified characters rather than tokens. Also, Unicode does through a wrench in it - I suppose such a

Re: 5.5.3: fieldValueCache auto-warming error

2016-11-15 Thread Bram Van Dam
On 11/11/16 18:08, Bram Van Dam wrote: > On 10/11/16 17:10, Erick Erickson wrote: >> Just facet on the text field yourself ;) Quick update: you were right. One of the users managed to find a bug in our application which enabled them to facet on the text field. It would be still be nice if

Re: DIH problem with multiple (types of) resources

2016-11-15 Thread Peter Blokland
hi, On Tue, Nov 15, 2016 at 02:54:49AM +1100, Alexandre Rafalovitch wrote: >> >> > Attribute names are case sensitive as far as I remember. Try > 'dataSource' for the second definition. oh wow... that's sneaky. in the old version the case didn't seem to matter, but now it certainly

Re: how to tell SolrHttpServer client to accept/ignore all certs?

2016-11-15 Thread Shawn Heisey
On 11/14/2016 2:44 PM, Robert Hume wrote: > I'm using HttpSolrServer (in Solr 3.6) to connect to a Solr web > service and perform a query. That's quite old, and if you do find a but, it won't be fixed in that version. If your server is running at least version 3.6 and has configs that originated

Re: Multi word synonyms

2016-11-15 Thread Michael Kuhlmann
Wow, that's great news! I didn't notice that. Am 15.11.2016 um 13:05 schrieb Vincenzo D'Amore: > Hi Michael, > > an update, reading the article I double checked if at least one of the > issues were fixed. > The good news is that https://issues.apache.org/jira/browse/LUCENE-2605 has > been closed

Re: Multi word synonyms

2016-11-15 Thread Midas A
I am new with solr . How i should solve this problem ? Can we do something at query time ? On Tue, Nov 15, 2016 at 5:35 PM, Vincenzo D'Amore wrote: > Hi Michael, > > an update, reading the article I double checked if at least one of the > issues were fixed. > The good news

Re: Multi word synonyms

2016-11-15 Thread Vincenzo D'Amore
Hi Michael, an update, reading the article I double checked if at least one of the issues were fixed. The good news is that https://issues.apache.org/jira/browse/LUCENE-2605 has been closed and is available in 6.2. On Tue, Nov 15, 2016 at 12:32 PM, Michael Kuhlmann wrote: >

Re: Multi word synonyms

2016-11-15 Thread Michael Kuhlmann
This is a nice reading though, but that solution depends on the precondition that you'll already know your synonyms at index time. While having synonyms in the index is mostly the better solution anyway, it's sometimes not feasible. -Michael Am 15.11.2016 um 12:14 schrieb Vincenzo D'Amore: > Hi

Re: Multi word synonyms

2016-11-15 Thread Vincenzo D'Amore
Hi Midas, I suggest this interesting reading: https://lucidworks.com/blog/2014/07/12/solution-for-multi-term-synonyms-in-lucenesolr-using-the-auto-phrasing-tokenfilter/ On Tue, Nov 15, 2016 at 11:00 AM, Michael Kuhlmann wrote: > It's not working out of the box, sorry. > >

Re: Filtering a field when some of the documents don't have the value

2016-11-15 Thread Gintautas Sulskus
Thanks Erick, it works exactly as required! Gintas On Mon, Nov 14, 2016 at 7:02 PM, Erick Erickson wrote: > You want something like: > name:x=population:[10 TO *] OR (*:* -population:*:*) > > Best, > Erick > > On Mon, Nov 14, 2016 at 10:29 AM, Gintautas Sulskus >

Re: Multi word synonyms

2016-11-15 Thread Michael Kuhlmann
It's not working out of the box, sorry. We're using this plugin: https://github.com/healthonnet/hon-lucene-synonyms#getting-started It's working nicely, but can lead to OOME when you add many synonyms with multiple terms. And I'm not sure whether it#s still working with Solr 6.0. -Michael Am

RE: index and data directories

2016-11-15 Thread Prateek Jain J
Thanks a lot Erick Regards, Prateek Jain -Original Message- From: Erick Erickson [mailto:erickerick...@gmail.com] Sent: 14 November 2016 09:14 PM To: solr-user Subject: Re: index and data directories Theoretically, perhaps. And it's quite true that

Multi word synonyms

2016-11-15 Thread Midas A
- i have to use multi word synonyms at query time . Please suggest how can i do it . and let me know it whether it would be visible in debug query or not .

Re: Sorl shards: very sensitive to swap space usage !?

2016-11-15 Thread Toke Eskildsen
On Mon, 2016-11-14 at 16:29 -0800, Chetas Joshi wrote: > Hi Toke, can you explain exactly what you mean by "the aggressive IO > for the memory mapping caused the kernel to start swapping parts of > the JVM heap to get better caching of storage data"? I am not sure what you are asking for. I'll