We've seen around a 10-15% decrease in performance on average in a
virtualized environment as a first approximation, which doesn't explain
your results but might give you a place to start.
I'm pretty sure Solr isn't an issue, but my question is how much RAM is
on your underlying hardware? And how
Solr 1.4 is doing great with respect to Indexing on a dedicated physical server
(Windows Server 2008). For Indexing around 1 million full text documents
(around 4 GB size) it takes around 20 minutes with Heap Size = 512M - 1G 4GB
RAM.
However while using Solr on a VM, with 4 GB RAM it took 50
Solr 1.4 is doing great with respect to Indexing on a dedicated physical server
(Windows Server 2008). For Indexing around 1 million full text documents
(around 4 GB size) it takes around 20 minutes with Heap Size = 512M - 1G 4GB
RAM.
However while using Solr on a VM, with 4 GB RAM it took
From: Husain, Yavar yhus...@firstam.com
To: solr-user@lucene.apache.org solr-user@lucene.apache.org
Sent: Thursday, November 10, 2011 3:43 AM
Subject: Solr Indexing Time
However while using Solr on a VM, with 4 GB RAM it took 50 minutes to index at
the first time. Note that there is no Network
str name=Total Requests made to DataSource16276/str
...
so I am doing a delta import of around 500,000 rows at a
time.
http://wiki.apache.org/solr/DataImportHandlerDeltaQueryViaFullImport
solr-user@lucene.apache.org
Sent: Sun, 5 June, 2011 10:05:22 AM
Subject: Re: URGENT HELP: Improving Solr indexing time
Hi Rohit,
I am currently working on https://issues.apache.org/jira/browse/SOLR-2233
which fixes multithreading issues
How complex is your dataimport schema? SOLR-2233
My Solr server takes very long to update index. The table it hits to index is
huge with 10Million + records , but even in that case I feel this is very long
time to index. Below is the snapshot of the /dataimport page
str name=statusbusy/str
str name=importResponseA command is still
How long does the query against the DB take (outside of Solr)? If that's slow
then it's going to take a while to update the index. You might need to figure a
way to break things up a bit, maybe use a delta import instead of a full import.
Chris
On Jun 4, 2011, at 6:23 AM, Rohit Gupta wrote:
Rohit - you have double posted maybe - did Otis's answer not help with
your issue or at least need a response to clarify ?
On 4 June 2011 22:53, Chris Cowan chrisco...@plus3network.com wrote:
How long does the query against the DB take (outside of Solr)? If that's slow
then it's going to take
, 2011 4:59:44 AM
Subject: Re: URGENT HELP: Improving Solr indexing time
Rohit - you have double posted maybe - did Otis's answer not help with
your issue or at least need a response to clarify ?
On 4 June 2011 22:53, Chris Cowan chrisco...@plus3network.com wrote:
How long does the query against
: Improving Solr indexing time
Rohit - you have double posted maybe - did Otis's answer not help with
your issue or at least need a response to clarify ?
On 4 June 2011 22:53, Chris Cowan chrisco...@plus3network.com wrote:
How long does the query against the DB take (outside of Solr)? If
that's slow
11 matches
Mail list logo
