Re: solr 3.5 taking long to index

2012-04-15 Thread Lance Norskog
You're doing more commits than you need. You may want to turn off autocommit since you are running commit yourself. Every commit causes segment activity, so if you want to minimize that, you don't need autocommit. About memory sizing: you should drop the memory assigned to Solr until it slows

Questions about the query function

2012-04-15 Thread Benson Margulies
I've been pestering you all with a series of questions about disassembling and partially rescoring queries. Every helpful response (thanks) has led me to further reading, and this leads to more questions. If I haven't before, I'll apologize now for the high level of ignorance at which I'm

Re: solr 3.5 taking long to index

2012-04-15 Thread Yonik Seeley
On Thu, Apr 12, 2012 at 10:42 PM, Rohit ro...@in-rev.com wrote: The machine has a total ram of around 46GB. My Biggest concern is Solr index time gradually increasing and then the commit stops because of timeouts, out commit rate is very high, but I am not able to find the root cause of the

Re: Questions about the query function

2012-04-15 Thread Erik Hatcher
Why doesn't this example have to use _val_? Is there an assumed defType of fund? Yeah, that wiki page is misleading there, as it is implying a non-specified defType=func. Wanna fix up the wiki to make this clear? _val_ would work too, or of course using that function as a parameter to

Re: Questions about the query function

2012-04-15 Thread Benson Margulies
On Sun, Apr 15, 2012 at 9:03 AM, Erik Hatcher erik.hatc...@gmail.com wrote: Why doesn't this example have to use _val_? Is there an assumed defType of fund? Yeah, that wiki page is misleading there, as it is implying a non-specified defType=func.  Wanna fix up the wiki to make this clear?

Re: Questions about the query function

2012-04-15 Thread Erik Hatcher
_val_ would work too, or of course using that function as a parameter to (e)dismay's bf, or dismay's boost params. oops damn you autocorrect. I've been fighting this one since upgrading to Lion and will turn it off. s/dismay/dismax/! :) Erik

Re: Questions about the query function

2012-04-15 Thread Benson Margulies
Since I ended up with 'fund' instead of 'func' we're even. I made the edit. I'd make some more if you answered more of my questions :-) On Sun, Apr 15, 2012 at 9:42 AM, Erik Hatcher erik.hatc...@gmail.com wrote: _val_ would work too, or of course using that function as a parameter to

Re: Monitoring SolrCloud health

2012-04-15 Thread Stefan Matheis
Mark, while thinking about it .. perhaps it'd would a good idea to compute the needed information somewhere in a request-handler/servlet, so that not every tool which shows the health needs to do that on their own? On Sunday, April 15, 2012 at 3:00 AM, Jamie Johnson wrote: Otis, Is SMP a

Re: Options for automagically Scaling Solr (without needing distributed index/replication) in a Hadoop environment

2012-04-15 Thread Jason Rutherglen
This was done in SOLR-1301 going on several years ago now. On Sat, Apr 14, 2012 at 4:11 PM, Lance Norskog goks...@gmail.com wrote: It sounds like you really want the final map/reduce phase to put Solr index files into HDFS. Solr has a feature to do this called 'Embedded Solr'. This packages

It's hard to google on _val_

2012-04-15 Thread Benson Margulies
So, I've been experimenting to learn how the _val_ participates in scores. It seems to me that http://wiki.apache.org/solr/FunctionQuery should explain the *effect* of including an _val_ term in an ordinary query, starting with a constant.

Re: It's hard to google on _val_

2012-04-15 Thread Yonik Seeley
On Sun, Apr 15, 2012 at 11:34 AM, Benson Margulies bimargul...@gmail.com wrote: So, I've been experimenting to learn how the _val_ participates in scores. It seems to me that http://wiki.apache.org/solr/FunctionQuery should explain the *effect* of including an _val_ term in an ordinary query,

Re: It's hard to google on _val_

2012-04-15 Thread Benson Margulies
On Sun, Apr 15, 2012 at 12:14 PM, Yonik Seeley yo...@lucidimagination.com wrote: On Sun, Apr 15, 2012 at 11:34 AM, Benson Margulies bimargul...@gmail.com wrote: So, I've been experimenting to learn how the _val_ participates in scores. It seems to me that

Re: Monitoring SolrCloud health

2012-04-15 Thread Mark Miller
On Apr 15, 2012, at 11:01 AM, Stefan Matheis wrote: Mark, while thinking about it .. perhaps it'd would a good idea to compute the needed information somewhere in a request-handler/servlet, so that not every tool which shows the health needs to do that on their own? Yeah, I guess the hard

Re: It's hard to google on _val_

2012-04-15 Thread Yonik Seeley
On Sun, Apr 15, 2012 at 12:14 PM, Yonik Seeley yo...@lucidimagination.com wrote: That's just because Lucene normalizes scores.  By default, this is really just multiplying scores by a magic constant (that by default is the inverse of the sum of squared weights) Sorry... I missed the square

Re: dynamic analyzer based on condition

2012-04-15 Thread Erick Erickson
You'll have to create a field per language... The 3.6 example code has the fieldType definitions for a lot of languages, that might be a good place to start. Best Erick On Fri, Apr 13, 2012 at 8:32 PM, srinir sramasw...@nextag.com wrote: Hi, I want to pick different analyzers for the same

Re: Category the result search

2012-04-15 Thread Erick Erickson
Faces are query-time construct, so you can easily facet on the _values_ of fields by specifying the field name in your query. See: http://wiki.apache.org/solr/SimpleFacetParameters Best Erick On Sat, Apr 14, 2012 at 2:06 AM, hadi md.anb...@gmail.com wrote: hi I am new to solr, I crawled

Re: custom org.apache.lucene.store.Directory

2012-04-15 Thread Erick Erickson
Please review: http://wiki.apache.org/solr/UsingMailingLists I have no clue what you mean by supported here. Best Erick 2012/4/14 Radim Kolar h...@filez.com: is custom /org.apache.lucene.store.Directory ///supported in Solr? I want to try infinispan. //

Re: dynamic analyzer based on condition

2012-04-15 Thread srinir
Hi Erick, Thanks a lot for your reply. I have around 10-15 searchable text fields (and 5-6 languages). If I create one per language will that increase the memory occupied by my index. Even though only one field will have a value at a time, will there be a case the empty fields in the index will

Re: Monitoring SolrCloud health

2012-04-15 Thread Jamie Johnson
I took a quick look at Zabbix and specifically the lucid imagination template for solr but in trying to import it into Zabbix I don't see the template show up in the list to choose from. What version of zabbix is recommended to use with LWE and specifically the provided zabbix templates? I tried

Re: Monitoring SolrCloud health

2012-04-15 Thread Jamie Johnson
I think I found the answer here http://lucidworks.lucidimagination.com/display/lweug/Integrating+Monitoring+Services#IntegratingMonitoringServices-HowtointegratewithZabbix2.0%281.9.x%29 I'll go ahead and try on the 1.9 baseline and see if I have any different result. On Sun, Apr 15, 2012 at 3:46

Re: dynamic analyzer based on condition

2012-04-15 Thread Erick Erickson
Before you start worrying about memory, do you have any proof at all that memory is a problem? Are you expecting to have a lot of documents in your index (as in multiple tens of millions)? If you try to put multiple languages in a single field, the results will be problematic for some set

Re: custom org.apache.lucene.store.Directory

2012-04-15 Thread Chris Male
I think what Radim is referring to is can he use the Infinispan Lucene Directory https://docs.jboss.org/author/display/ISPN/Infinispan+as+a+Directory+for+Lucene in Solr. To do this Radim, I think you'll need to create an implementation of Solr's DirectoryFactory that can load your Directory

Is SOLR-2623 fixed ? Still issue with SOLR 3.6

2012-04-15 Thread Ravi Solr
Hello folks, We are trying to access JMX data from SOLR 3.6 multi-core setup and feed it into Nagios. Once we reload the core the JMX no more works and we cannot get any data. Prior to moving to SOLR 3.6, I heard that SOLR-2623 might have fixed the core reload issue. I reloaded one of the