fatest way to rebuild Solr index

2013-02-14 Thread Mingfeng Yang
I have a few Solr indexes, each with 20-200 millions documents, which were indexed by querying multiple PostgreSQL databases. If I do rebuild the index by the same way, it would take a few months, because the PostgresSQL query is slow. Now, I need to do the following changes to all indexes. 1

Re: fatest way to rebuild Solr index

2013-02-14 Thread Shawn Heisey
On 2/14/2013 12:46 PM, Mingfeng Yang wrote: I have a few Solr indexes, each with 20-200 millions documents, which were indexed by querying multiple PostgreSQL databases. If I do rebuild the index by the same way, it would take a few months, because the PostgresSQL query is slow. Now, I need

Re: fatest way to rebuild Solr index

2013-02-14 Thread Mingfeng Yang
PostgreSQL databases. If I do rebuild the index by the same way, it would take a few months, because the PostgresSQL query is slow. Now, I need to do the following changes to all indexes. 1. delete a couple fields from the Solr index 2. add a couple new fields 3. change the type of one field

Re: Can I rebuild an index and remove some fields?

2012-02-16 Thread Robert Stewart
and indexed fields are not used in search at all.  In order to save memory and disk, I'd like to rebuild that index *without* those fields, but I don't have original documents to rebuild entire index with (don't have the full-text anymore, etc.).  Is there some way to rebuild

Re: Can I rebuild an index and remove some fields?

2012-02-15 Thread Robert Stewart
...@gmail.com wrote: Lets say I have a large index (100M docs, 1TB, split up between 10 indexes).  And a bunch of the stored and indexed fields are not used in search at all.  In order to save memory and disk, I'd like to rebuild that index *without* those fields, but I don't have

Re: Can I rebuild an index and remove some fields?

2012-02-15 Thread Li Li
: Lets say I have a large index (100M docs, 1TB, split up between 10 indexes). And a bunch of the stored and indexed fields are not used in search at all. In order to save memory and disk, I'd like to rebuild that index *without* those fields, but I don't have original documents

Re: Can I rebuild an index and remove some fields?

2012-02-14 Thread Robert Stewart
say I have a large index (100M docs, 1TB, split up between 10 indexes). And a bunch of the stored and indexed fields are not used in search at all. In order to save memory and disk, I'd like to rebuild that index *without* those fields, but I don't have original documents to rebuild entire

Re: Can I rebuild an index and remove some fields?

2012-02-14 Thread Li Li
a large index (100M docs, 1TB, split up between 10 indexes). And a bunch of the stored and indexed fields are not used in search at all. In order to save memory and disk, I'd like to rebuild that index *without* those fields, but I don't have original documents to rebuild entire index

Can I rebuild an index and remove some fields?

2012-02-13 Thread Robert Stewart
Lets say I have a large index (100M docs, 1TB, split up between 10 indexes). And a bunch of the stored and indexed fields are not used in search at all. In order to save memory and disk, I'd like to rebuild that index *without* those fields, but I don't have original documents to rebuild

Re: Can I rebuild an index and remove some fields?

2012-02-13 Thread Li Li
fields are not used in search at all. In order to save memory and disk, I'd like to rebuild that index *without* those fields, but I don't have original documents to rebuild entire index with (don't have the full-text anymore, etc.). Is there some way to rebuild or optimize an existing index

Re: Can I rebuild an index and remove some fields?

2012-02-13 Thread Li Li
. On Tue, Feb 14, 2012 at 6:29 AM, Robert Stewart bstewart...@gmail.comwrote: Lets say I have a large index (100M docs, 1TB, split up between 10 indexes). And a bunch of the stored and indexed fields are not used in search at all. In order to save memory and disk, I'd like to rebuild that index

Re: Rebuild an index

2010-05-29 Thread Chris Hostetter
: We use Drupal as the CMS and Solr for our search engine needs and are : planning to have Solr Master-Slave replication setup across the data : centers. I am in the process of testing my replication - what is the : best means to delete the index on the Solr slave and then replicate a : fresh

Rebuild an index

2010-05-28 Thread Sai . Thumuluri
Hi, We use Drupal as the CMS and Solr for our search engine needs and are planning to have Solr Master-Slave replication setup across the data centers. I am in the process of testing my replication - what is the best means to delete the index on the Solr slave and then replicate a fresh copy from