Hi,

we have a serious harddisk problem, and it's definitely related to a 
full-import from a relational
database into a solr index.

The first time it happened on our development server, where the raidcontroller 
crashed during a full-import
of ~ 8 Million documents. This happened 2 weeks ago, and in this period 2 of 
the harddisks where the solr
index files are located stopped working (we needed to replace them).

After the crash of the raid controller, we decided to move the development of 
solr/index related stuff to our
local development machines. 

Yesterday i was running another full-import of ~10 Million documents on my 
local development machine, 
and during the import, a harddisk failure occurred. Since this failure, my 
harddisk activity seems to 
be around 100% all the time, even if no solr server is running at all. 

I've been googling the last 2 days to find some info about solr related 
harddisk problems, but i didn't find anything
useful.

Are there any steps we need to take care of in respect to harddisk failures 
when doing a full-import? Right now,
our steps look like this:

1. Delete the current index
2. Restart solr, to load the updated schemas
3. Start the full import

Initially, the solr index and the relational database were located on the same 
harddisk. After the crash, we moved
the index to a separate harddisk, but nevertheless this harddisk crashed too.

I'd really appreciate any hints on what we might do wrong when importing data, 
as we can't release this
on our production servers when there's the risk of harddisk failures.


thanks.


-robert





Reply via email to