Hi Mark,
SOLR-3929 rocks!
A nigthly build of 4.1 with maxIndexingThreads configured to 24, takes
80% to 100% of the cpu resources :-)
Thank you, Otis and Gora
"mpstat 10"
CPU minf mjf xcal intr ithr csw icsw migr smtx srw syscl usr sys wt idl
00 0 13 607 241 234 78 100
On Jan 3, 2013, at 5:40 AM, Uwe Reh wrote:
> "use more threads" vs. "use less threads"
> It is a bit confusing.
My point was to make sure you are using more than one thread. With 32 cores,
probably a lot more than one thread.
Otis' point was that you can also use too many threads.
Both are
Hi,
thank you for the hints.
On 3 January 2013 05:55, Mark Miller wrote:
32 cores eh? You probably have to raise some limits to take advantage of
that.
32 cores isn't that much anymore. You can buy amd servers from
Supermicro with two sockets and 32G of ram for less than 2500$. Systems
with
I, too, was going to point out to the number of threads, but was going to
suggest using fewer of them because the server has 32 cores and there was a
mention of 100 threads being used from the client. Thus, my guess was that
the machine is busy juggling threads and context switching (how's vmstat
On 3 January 2013 05:55, Mark Miller wrote:
>
> 32 cores eh? You probably have to raise some limits to take advantage of
> that.
>
> https://issues.apache.org/jira/browse/SOLR-4078
> support configuring IndexWriter max thread count in solrconfig
>
> That's coming in 4.1 and is likely important - t
32 cores eh? You probably have to raise some limits to take advantage of that.
https://issues.apache.org/jira/browse/SOLR-4078
support configuring IndexWriter max thread count in solrconfig
That's coming in 4.1 and is likely important - the default is only 8.
You might always want to experiment
Am 02.01.2013 22:39, schrieb Uwe Reh:
To get an idea whats going on, I've done some statistics with visualvm.
(see attachement)
"merde" the listserver stripes attachments.
You'll find the screen shot at
>http://fantasio.rz.uni-frankfurt.de/solrtest/HotSpot.gif
uwe
Hi,
while trying to optimize our indexing workflow I reached the same
endpoint like gabriel shen described in his mail. My Solr server won't
utilize more than 40% of the computing power.
I made some tests, but i'm not able to find the bottleneck. Could
anybody help to solve this quest?
At fi
On 8 March 2012 16:18, gabriel shen wrote:
> Our indexing process is to adding a bundle of solr documents(for example
> 5000) to solr each time, and we observed that before commiting(which might
> be io bounded) it uses less than half the CPU capacity constantly, which
> sounds strange to us why i
How are you sending documents to solr ?
If you push solr input documents via HTTP (which is what SolrJ does),
you could increase CPU consumption (and therefor reduce indexing time)
by sending your update requests asynchronously, using multiple updating
threads, to your single solr core.
Some
Our indexing process is to adding a bundle of solr documents(for example
5000) to solr each time, and we observed that before commiting(which might
be io bounded) it uses less than half the CPU capacity constantly, which
sounds strange to us why it doesn't use full cpu power. As for RAM, I don't
kn
On 8 March 2012 15:39, gabriel shen wrote:
> Hi,
>
> I noticed that, sequential indexing on 1 solr core is only using 40% of our
> 8 virtual core CPU power. Why isn't it use 100% of the power? Is there a
> way to increase CPU utilization rate?
[...]
This is an open-ended question which could be d
12 matches
Mail list logo
