Using available mappers in MapReduceIndexerTool

2016-01-14 Thread Douglas Rapp
Hi, I am using Solr 4.10.4, SolrCloud mode (single instance), with the indexes residing in HDFS. I am currently testing performance and scalability of the indexing process on my Hadoop cluster using the MapReduceIndexerTool. Previously, I had been testing on a smaller cluster with 3 datanodes. Wh

Re: Problems using MapReduceIndexerTool with multiple reducers

2016-01-12 Thread Douglas Rapp
ossibilities, use the Collecitons API > every time. > > Best, > Erick > > On Tue, Jan 12, 2016 at 10:30 AM, Douglas Rapp > wrote: > > As an update, I went ahead and used the Collection API and deleted the > > existing one, and then recreated it (specifying the compo

Re: Problems using MapReduceIndexerTool with multiple reducers

2016-01-12 Thread Douglas Rapp
olders (containing "schema.xml" and "solrconfig.xml", etc) all in the Solr home location? Thanks, Doug On Tue, Jan 12, 2016 at 9:26 AM, Douglas Rapp wrote: > I'm actually not specifying any router, and assumed the "implicit" one was > the default. The only r

Re: Problems using MapReduceIndexerTool with multiple reducers

2016-01-12 Thread Douglas Rapp
gt; Other questions: > 1> Are you running MRIT over Solr indexes that are actually hosted on HDFS? > 2> Are you using the --go-live option? > > Actually, can you show us the entire command you use to invoke MRIT? > > Best, > Erick > > On Mon, Jan 11, 2016 at 4:18 PM,

Problems using MapReduceIndexerTool with multiple reducers

2016-01-11 Thread Douglas Rapp
Hello, I am using Solr 4.10.4 in SolrCloud mode, but so far with only a single instance (so just a single shard - not very cloud-like..). I have been experimenting using the MapReduceIndexerTool to handle batch indexing of CSV files in HDFS. I got it working on a weaker single-node Hadoop test sy