Re: Multicluster Communication

2009-06-19 Thread Harish Mallipeddi
On Fri, Jun 19, 2009 at 4:06 PM, Rakhi Khatwani rakhi.khatw...@gmail.comwrote: we want hadoop cluster 1 for collecting data n storing it in HDFS we want hadoop cluster 2 for using the stored data from HDFS and analysing it. Why do you want to do this in the first place? It seems like you

Re: Multicluster Communication

2009-06-19 Thread Rakhi Khatwani
Hi Harish, I want both of them 2 b compute clusters. but yea... how wud they hv a common storage area we basically want to seperate the collection from analysis. is it possible to dedicate a set of nodes in the hadoop cluster only for collections and another set of nodes in the same cluster only

Re: Multicluster Communication

2009-06-19 Thread Allen Wittenauer
On 6/19/09 3:49 AM, Harish Mallipeddi harish.mallipe...@gmail.com wrote: Why do you want to do this in the first place? It seems like you want cluster1 to be a plain HDFS cluster and cluster2 to be a mapred cluster. Doing something like that will be disastrous - Hadoop is all about sending

Re: Multicluster Communication

2009-06-19 Thread Harish Mallipeddi
On Fri, Jun 19, 2009 at 10:37 PM, Allen Wittenauer a...@yahoo-inc.com wrote: On 6/19/09 3:49 AM, Harish Mallipeddi harish.mallipe...@gmail.com wrote: Why do you want to do this in the first place? It seems like you want cluster1 to be a plain HDFS cluster and cluster2 to be a mapred