Re: SOLR 4 not utilizing multi CPU cores

2014-04-26 Thread Erick Erickson
its return 0 but multiple > document have the same word. > > i have try with different field type : text_gen, text_en_splitting, String > but i didnt get exact result > can you please help for this. > > > > > > -- > View this message in context: > http://l

Re: SOLR 4 not utilizing multi CPU cores

2014-04-26 Thread ksmith
dnt get exact result can you please help for this. -- View this message in context: http://lucene.472066.n3.nabble.com/SOLR-4-not-utilizing-multi-CPU-cores-tp4105058p4133256.html Sent from the Solr - User mailing list archive at Nabble.com.

Re: SOLR 4 not utilizing multi CPU cores

2013-12-05 Thread Salman Akram
After debugging it seems that Query Parser code in Surround Parser is giving an issue in queries with Common Words. Has anyone tried Surround and Common Grams with SOLR 4? On Thu, Dec 5, 2013 at 7:00 PM, Daniel Collins wrote: > Fair enough, I'm not famiilar with Surround parser, but it does look

Re: SOLR 4 not utilizing multi CPU cores

2013-12-05 Thread Daniel Collins
Fair enough, I'm not famiilar with Surround parser, but it does look like some logic has changed there. On 5 December 2013 12:38, Salman Akram wrote: > Here is the response to your 2 questions: > > 1- Started from fresh Solr 4 config and modified custom stuff. > > 2- Index is same and optimized.

Re: SOLR 4 not utilizing multi CPU cores

2013-12-05 Thread Salman Akram
Here is the response to your 2 questions: 1- Started from fresh Solr 4 config and modified custom stuff. 2- Index is same and optimized. However, as I said in a previous mail the issue seems to be Surround Query Parser which is parsing the query in a different format. On Thu, Dec 5, 2013 at 2:

Re: SOLR 4 not utilizing multi CPU cores

2013-12-05 Thread Salman Akram
I am not using Shards. I gave more info in a previous mail but I know its a single index and what you are saying makes sense but from what I could see in 1.4.1 that it was better 'utilizing' the hardware resources available. I mean if the CPU is free then why not do multi threading (if possible of

Re: SOLR 4 not utilizing multi CPU cores

2013-12-05 Thread Salman Akram
So I think I found one issue that somewhat explains the time difference but not sure why this is happening. We are using Surround Query Parser. Below is a two words query, both of them are in Common Grams list. Query = "only be" Here is what debug shows. I have highlighted the red part which is d

Re: SOLR 4 not utilizing multi CPU cores

2013-12-05 Thread Daniel Collins
Not sure if you are really stating the problem here. If you don't use Solr sharding, (I also assume you aren't using SolrCloud), and I'm guessing you are a single core (but can you confirm). As I understand Solr's logic, for a single query on a single core, that will only use 1 thread (ignoring u

Re: SOLR 4 not utilizing multi CPU cores

2013-12-05 Thread Salman Akram
More info on Cpu consumption: We have a server with 32 physical cores. Same search when executed on SOLR 4.6 takes quite long and throughout only uses 3% cpu (1 core). Same search when executed on SOLR 1.4.1 takes much less time and on average uses around 40-50% cpu. On Thu, Dec 5, 2013 at 2:05

Re: SOLR 4 not utilizing multi CPU cores

2013-12-05 Thread Salman Akram
I missed one imp piece of info. Due to large size we have indexed the date with Common Grams. All of the words in slow search are in common grams and when I debug it, they query is made properly with common grams. In debug all of the time is shown in process query time. Let me know what other inf

Re: SOLR 4 not utilizing multi CPU cores

2013-12-04 Thread Andrea Gazzarini
Hi, I did moreless the same but didn't get that behaviour...could you give us more details Best, Gazza On 5 Dec 2013 06:54, "Salman Akram" wrote: > Hi, > > We recently upgraded to SOLR 4.6 from SOLR 1.4.1. Overall the performance > went down for large phrase queries. On some analysis we have see

SOLR 4 not utilizing multi CPU cores

2013-12-04 Thread Salman Akram
Hi, We recently upgraded to SOLR 4.6 from SOLR 1.4.1. Overall the performance went down for large phrase queries. On some analysis we have seen that 1.4.1 utilized multiple cpu cores for such queries but SOLR 4.6 is only utilizing single cpu core. Any idea on what could be the reason? Note: We ar

Re: Multi CPU Cores

2011-10-17 Thread Robert Brown
ene ecosystem search :: http://search-lucene.com/ > > > > >> >>From: Robert Brown >>To: solr-user@lucene.apache.org >>Sent: Monday, October 17, 2011 4:01 AM >>Subject: Re: Multi CPU Cores >> >>Where exactly do you set this up? 

Re: Multi CPU Cores

2011-10-17 Thread Otis Gospodnetic
://sematext.com/ :: Solr - Lucene - Nutch Lucene ecosystem search :: http://search-lucene.com/ > >From: Robert Brown >To: solr-user@lucene.apache.org >Sent: Monday, October 17, 2011 4:01 AM >Subject: Re: Multi CPU Cores > >Where exactly do yo

Re: Multi CPU Cores

2011-10-17 Thread Johannes Goll
Yes, same thing. This was for the jetty servlet container not tomcat. I would refer to the tomcat documentation on how to modify/configure the java runtime environment (JRE) arguments for your running instance. Johannes On Oct 17, 2011, at 4:01 AM, Robert Brown wrote: > Where exactly do you se

Re: Multi CPU Cores

2011-10-17 Thread Robert Brown
Where exactly do you set this up? We're running Solr3.4 under tomcat, OpenJDK 1.6.0.20 btw, is the JRE just a different name for the VM? Apologies for such a newbie Java question. On Sun, 16 Oct 2011 12:51:44 -0400, Johannes Goll wrote: > we use the the following in production > > java -ser

Re: Multi CPU Cores

2011-10-16 Thread Mikhail Khludnev
nnes Goll > Reply-to: solr-user@lucene.apache.org > To: solr-user@lucene.apache.org > Subject: Re: Multi CPU Cores > Date: Sun, 16 Oct 2011 08:18:47 -0400 > > Try using -useParallelGc as vm option. > > Johannes > > On Oct 16, 2011, at 7:51 AM, Ken Krugler >

Re: Multi CPU Cores

2011-10-16 Thread Johannes Goll
we use the the following in production java -server -XX:+UseParallelGC -XX:+AggressiveOpts -XX:+DisableExplicitGC -Xms3G -Xmx40G -Djetty.port= -Dsolr.solr.home= jar start.jar more information http://www.oracle.com/technetwork/java/javase/tech/vmoptions-jsp-140102.html Johannes

Re: Multi CPU Cores

2011-10-16 Thread Li Li
for indexing, your can make use of multi cores easily by call IndexWriter.addDocument with multi-threads as far as I know, for searching, if there is only one request, you can't make good use of cpus. On Sat, Oct 15, 2011 at 9:37 PM, Rob Brown wrote: > Hi, > > I'm running Solr on a machine with

Re: Multi CPU Cores

2011-10-16 Thread Rob Brown
-user@lucene.apache.org To: solr-user@lucene.apache.org Subject: Re: Multi CPU Cores Date: Sun, 16 Oct 2011 08:18:47 -0400 Try using -useParallelGc as vm option. Johannes On Oct 16, 2011, at 7:51 AM, Ken Krugler wrote: > > On Oct 16, 2011, at 1:44pm, Rob Brown wrote: > >> Looks

Re: Multi CPU Cores

2011-10-16 Thread Johannes Goll
> -- Ken > > >> -Original Message- >> From: Johannes Goll >> Reply-to: solr-user@lucene.apache.org >> To: solr-user@lucene.apache.org >> Subject: Re: Multi CPU Cores >> Date: Sat, 15 Oct 2011 21:30:11 -0400 >> >> Did you try to subm

Re: Multi CPU Cores

2011-10-16 Thread Ken Krugler
e background GC, depending on what you've got your JVM configured to use. Though that shouldn't stay at 100% for very long. -- Ken > -Original Message- > From: Johannes Goll > Reply-to: solr-user@lucene.apache.org > To: solr-user@lucene.apache.org > Subject: Re: Multi

Re: Multi CPU Cores

2011-10-16 Thread Rob Brown
-Original Message- From: Johannes Goll Reply-to: solr-user@lucene.apache.org To: solr-user@lucene.apache.org Subject: Re: Multi CPU Cores Date: Sat, 15 Oct 2011 21:30:11 -0400 Did you try to submit multiple search requests in parallel? The apache ab tool is great tool to simulate simultaneous

Re: Multi CPU Cores

2011-10-15 Thread Otis Gospodnetic
Brown >To: solr-user@lucene.apache.org >Sent: Saturday, October 15, 2011 7:32 PM >Subject: Multi CPU Cores > >Hi, > >I'm running Solr on a machine with 16 CPU cores, yet watching "top" >shows that java is only apparently using 1 and maxing it out. > >

Re: Multi CPU Cores

2011-10-15 Thread Johannes Goll
Did you try to submit multiple search requests in parallel? The apache ab tool is great tool to simulate simultaneous load using (-n and -c). Johannes On Oct 15, 2011, at 7:32 PM, Rob Brown wrote: > Hi, > > I'm running Solr on a machine with 16 CPU cores, yet watching "top" > shows that java i

Multi CPU Cores

2011-10-15 Thread Rob Brown
Hi, I'm running Solr on a machine with 16 CPU cores, yet watching "top" shows that java is only apparently using 1 and maxing it out. Is there anything that can be done to take advantage of more CPU cores? Solr 3.4 under Tomcat [root@solr01 ~]# java -version java version "1.6.0_20" OpenJDK Runt

Re: Multi CPU Cores

2011-10-15 Thread Chris Hostetter
: Subject: Multi CPU Cores : In-Reply-To: <1318672302307-3423799.p...@n3.nabble.com> : References: <1318672302307-3423799.p...@n3.nabble.com> http://people.apache.org/~hossman/#threadhijack Thread Hijacking on Mailing Lists When starting a new discussion on a mailing list, please

Multi CPU Cores

2011-10-15 Thread Rob Brown
Hi, I'm running Solr on a machine with 16 CPU cores, yet watching "top" shows that java is only apparently using 1 and maxing it out. Is there anything that can be done to take advantage of more CPU cores? Solr 3.4 under Tomcat [root@solr01 ~]# java -version java version "1.6.0_20" OpenJDK Run