Re: Tuning StatsComponent

2011-01-13 Thread Johannes Goll
What field type do you recommend for a float stats.field for optimal Solr 1.4.1 StatsComponent performance ? float, pfloat or tfloat ? Do you recommend to index the field ? 2011/1/12 stockii > > my field Type is "double" maybe "sint" is better ? but i need double ... > =( > -- > View this m

Re: Tuning StatsComponent

2011-01-12 Thread stockii
my field Type is "double" maybe "sint" is better ? but i need double ... =( -- View this message in context: http://lucene.472066.n3.nabble.com/Tuning-StatsComponent-tp2225809p2241903.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: Tuning StatsComponent

2011-01-12 Thread stockii
i try this: > http://host:port /solr/select?q=YOUR_QUERY&stats=on&stats.field=amount&f.amount.stats.facet=currency&rows=0 and this: > http://host:portsolr /select?q=amount_us:*+OR+amount_eur:*[+OR+amount_...:*]&stats=on&stats.field=amount_usd&stats.field=amount_eur[&stats.field=amount_...]&ro

Re: Tuning StatsComponent

2011-01-11 Thread Grant Ingersoll
On Jan 11, 2011, at 9:37 AM, stockii wrote: > > simplest solution is more RAM !? > > sometimes i think, that is a standard solution for problems with solr ;-) FWIW, it's a solution for most computing problems, right? > > i going to buy 100 GB RAM :P That won't do it. More RAM is sometime

Re: Tuning StatsComponent

2011-01-11 Thread stockii
simplest solution is more RAM !? sometimes i think, that is a standard solution for problems with solr ;-) i going to buy 100 GB RAM :P -- View this message in context: http://lucene.472066.n3.nabble.com/Tuning-StatsComponent-tp2225809p2234557.html Sent from the Solr - User mailing list arch

Re: Tuning StatsComponent

2011-01-10 Thread Grant Ingersoll
StatsComponent, like many things, relies on FieldCache (and the related uninverted version in Solr for multivalued fields), which takes up memory and is related to the number of documents in the index. Strings in FieldCache can also be expensive. -Grant On Jan 10, 2011, at 4:10 PM, Jonathan R

Re: Tuning StatsComponent

2011-01-10 Thread Jonathan Rochkind
I found StatsComponent to be slow only when I didn't have enough RAM allocated to the JVM. I'm not sure exactly what was causing it, but it was pathologically slow -- and then adding more RAM to the JVM made it incredibly fast. On 1/10/2011 4:58 AM, Gora Mohanty wrote: On Mon, Jan 10, 2011 a

Re: Tuning StatsComponent

2011-01-10 Thread stockii
when i start statsComponent i get this message: INFO: UnInverted multi-valued field {field=product,memSize=4336,tindexSize=46,time=0,phase1=0,nTerms=1,bigTerms=1,termInstances=0,uses=0} what means this ? -- View this message in context: http://lucene.472066.n3.nabble.com/Tuning-StatsComponent-

Re: Tuning StatsComponent

2011-01-10 Thread stockii
oh thx for your fast reply. i will try the suggestions. in meanwhile more information about my index. i have 2 solr instances with 6 cores. each core have his own index and one core`s index is about 30 million documents. each document have:(stats-relevant) amount amount_euro currency_id user

Re: Tuning StatsComponent

2011-01-10 Thread Tanguy Moal
Hello, You could try taking advantage of Solr's facetization feature : provided that you have the amount stored in the amount field and the currency stored in the currency field, try the following request : http://host:port /solr/select?q=YOUR_QUERY&stats=on&stats.field=amount&f.amount.stats.facet

Re: Tuning StatsComponent

2011-01-10 Thread Gora Mohanty
On Mon, Jan 10, 2011 at 2:28 PM, stockii wrote: > > Hello. > > i`m using the StatsComponent to get the sum of amounts. but solr > statscomponent is very slow on a huge index of 30 Million documents. how can > i tune the statscomponent ? Not sure about this problem. > the problem is, that i have