Re: solr query latency spike when replicating index

2015-04-03 Thread Shalin Shekhar Mangar
In Solr 5.0 you can throttle the replication and limit the bandwidth it uses. The Sematext guys wrote a nice blog post about it. See http://blog.sematext.com/2015/01/26/solr-5-replication-throttling/ On Thu, Apr 2, 2015 at 1:53 PM, wei wrote: > I noticed the solr query latency spike on slave nod

Re: Solr 5.0.0 and HDFS

2015-04-03 Thread Joseph Obernberger
Hi - I've been able to replicate the error, and I'm also getting the following error that might be related: null:org.apache.solr.common.SolrException: CLUSTERSTATUS the collection time out:180s at org.apache.solr.handler.admin.CollectionsHandler.handleResponse(CollectionsHandler.java:630)

Re: solr query latency spike when replicating index

2015-04-03 Thread Timothy Ehlers
Replication uses allot of disk io. What kind of hardware is this do you have the specs? Can you provide sar -d and sar -b outputs. What is your GC throughput like? On Apr 2, 2015 3:55 PM, "wei" wrote: > I noticed the solr query latency spike on slave node when replicating index > from master. E

Re: DOcValues

2015-04-03 Thread Shalin Shekhar Mangar
On Fri, Apr 3, 2015 at 12:52 PM, Toke Eskildsen wrote: > Shalin Shekhar Mangar wrote: > > The UnInvertedField method of faceting is no longer used in Solr. > > True. Un-inversion still takes place for non-DV-fields though (see > UnivertingReader, which seems to lead to > FieldCacheImpl.SortedDoc

Re: Config join parse in solrconfig.xml

2015-04-03 Thread Erick Erickson
You have to show us several more things: 1> what exactly does the query look like? 2> what do you expect? 3> output when you specify &debug=query 4> anything else that would help. You might review: http://wiki.apache.org/solr/UsingMailingLists Best, Erick On Fri, Apr 3, 2015 at 10:58 AM, Frank

Re: DOcValues

2015-04-03 Thread Toke Eskildsen
Shalin Shekhar Mangar wrote: > The UnInvertedField method of faceting is no longer used in Solr. True. Un-inversion still takes place for non-DV-fields though (see UnivertingReader, which seems to lead to FieldCacheImpl.SortedDocValuesCache). But the wrapping is far nicer as everything looks li

Re: DOcValues

2015-04-03 Thread Shalin Shekhar Mangar
Sorry I should have been more clear. The UnInvertedField method of faceting is not used in Solr since Solr 5.0. On Fri, Apr 3, 2015 at 12:17 PM, Shalin Shekhar Mangar < shalinman...@gmail.com> wrote: > The UnInvertedField method of faceting is no longer used in Solr. > > See https://issues.apache

Re: Solr -indexing from csv file having 28 cols taking lot of time ..plz help i m new to solr

2015-04-03 Thread Toke Eskildsen
avinash09 wrote: > regex="^(.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*), > (.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*),(.*)$" A better solution seems to have been presented, but for the record I would like to note that the regexp above is quite an ef

Re: DOcValues

2015-04-03 Thread Shalin Shekhar Mangar
The UnInvertedField method of faceting is no longer used in Solr. See https://issues.apache.org/jira/browse/SOLR-7190 On Fri, Apr 3, 2015 at 10:33 AM, Toke Eskildsen wrote: > William Bell wrote: > > [docValues activation?] > > > Also, does it help with "*Too many values for UnInvertedField fac

Config join parse in solrconfig.xml

2015-04-03 Thread Frank li
Hi, I am starting using join parser with our solr. We have some default fields. They are defined in solrconfig.xml: edismax explicit 10 all_text number party name all_code ent_name all_text number^3 name^5 party^3 all_code^2 ent_name^7 id descripti

Re: sort param could not be parsed as a query, and is not a field that exists in the index: geodist()

2015-04-03 Thread Niraj
I am not able to see the logs, seems like don't have admin privilege for the same. Below is my schema details: * * Below are the version specifications: "responseHeader":{ "status":0, "QTime":447}, "mode":"solrcloud", * "lucene":{ "solr-spec-version":"4.4.0-cdh5.3.2", "sol

Re: DOcValues

2015-04-03 Thread Toke Eskildsen
William Bell wrote: [docValues activation?] > Also, does it help with "*Too many values for UnInvertedField faceting" ?* Yes. There is an internal limit using UnInverted (aka fc without docValues) of 16M somewhere - I am not sure exactly what it takes to trigger it, but many unique values and

Re: Unable to update config file using zkcli or RELOAD

2015-04-03 Thread shamik
Thanks Shawn for the pointer, really appreciate it. -- View this message in context: http://lucene.472066.n3.nabble.com/Unable-to-update-config-file-using-zkcli-or-RELOAD-tp4197376p4197494.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Measuring QPS

2015-04-03 Thread Shawn Heisey
On 4/3/2015 9:37 AM, Davis, Daniel (NIH/NLM) [C] wrote: > I wanted to gather QPS for our production Solr instances, but I was surprised > that the Admin UI did not contain this information. We are running a mix of > versions, but mostly 4.10 at this point. We are not using SolrCloud at > pre

Measuring QPS

2015-04-03 Thread Davis, Daniel (NIH/NLM) [C]
I wanted to gather QPS for our production Solr instances, but I was surprised that the Admin UI did not contain this information. We are running a mix of versions, but mostly 4.10 at this point. We are not using SolrCloud at present; that's part of why I'm checking - I want to validate the s

Re: distributed search on tables

2015-04-03 Thread Erick Erickson
You can do what you want either by using two queries or using grouping/field collapsing. Best, Erick On Fri, Apr 3, 2015 at 8:03 AM, avinash09 wrote: > Hi, > > I have a use case search all the name="*test*" from two tables (product and > department) > i need distributed result 5 result from prod

Re: Example of sorting by custom function

2015-04-03 Thread david.w.smi...@gmail.com
ValueSourceParser — yes. You’ll find a ton of them in Solr to get ideas from. In your example you forgot the “asc” or “desc”. ~ David Smiley Freelance Apache Lucene/Solr Search Consultant/Developer http://www.linkedin.com/in/davidwsmiley On Fri, Apr 3, 2015 at 9:44 AM, Robert Krüger wrote: >

distributed search on tables

2015-04-03 Thread avinash09
Hi, I have a use case search all the name="*test*" from two tables (product and department) i need distributed result 5 result from product and 5 from department but i am getting first all result from which is 434 and then department as shared below http://localhost:8983/solr/test_core/select?q=

Re: DOcValues

2015-04-03 Thread Tomoko Uchida
Dear Shawn, Thank you for the detailed explanation! Many users would need such guidelines about memory consumption (and performance trade-offs) for facets. Thanks, Tomoko 2015-04-03 22:26 GMT+09:00 Shawn Heisey : > On 4/3/2015 6:53 AM, Tomoko Uchida wrote: > > According to line 430 in SImpleFac

Example of sorting by custom function

2015-04-03 Thread Robert Krüger
Hi, I have been looking around on the web for information on sorting by a custom function but the results are inconclusive to me and some of it seems so old that I suspect it's outdated. What I want to do is the following: I have a field "fingerprint" in my schema that contains a binary data (e.g

Re: DOcValues

2015-04-03 Thread Shawn Heisey
On 4/3/2015 6:53 AM, Tomoko Uchida wrote: > According to line 430 in SImpleFacet.java (Solr 5.0.0), facet method is > forced to "fc" when we set docValues=true. > https://github.com/apache/lucene-solr/blob/lucene_solr_5_0_0/solr/core/src/java/org/apache/solr/request/SimpleFacets.java#L430 > > So w

Re: DOcValues

2015-04-03 Thread Tomoko Uchida
Hi, According to line 430 in SImpleFacet.java (Solr 5.0.0), facet method is forced to "fc" when we set docValues=true. https://github.com/apache/lucene-solr/blob/lucene_solr_5_0_0/solr/core/src/java/org/apache/solr/request/SimpleFacets.java#L430 So we need not set facet.method to use doc values.