Re: Multiple separate Hadoop clusters on same physical machines

2015-02-02 Thread daemeon reiydelle
d Regards, > S.RagavendraGanesh > Hadoop Support Team > ViSolve Inc.|www.visolve.com > > > > *From:* Alexander Alten-Lorenz [mailto:wget.n...@gmail.com] > *Sent:* Monday, February 02, 2015 3:07 PM > *To:* user@hadoop.apache.org > *Cc:* Harun Rešit Zafer > > *Subject:* Re: Mu

RE: Multiple separate Hadoop clusters on same physical machines

2015-02-02 Thread Hadoop Support
PM To: user@hadoop.apache.org Cc: Harun Rešit Zafer Subject: Re: Multiple separate Hadoop clusters on same physical machines http://blog.sequenceiq.com/blog/2014/06/19/multinode-hadoop-cluster-on-docker/ Ambari based, but works quite well On 02 Feb 2015, at 10:33, Ashish Kumar9 mailto

Re: Multiple separate Hadoop clusters on same physical machines

2015-02-02 Thread Alexander Alten-Lorenz
erence material available to follow to test docker and > hadoop integration . > > > > > From: > To:"'Harun Reşit Zafer'" , > > Date: 02/02/2015 02:57 PM > Subject: RE: Multiple separate Hadoop clusters on same physi

RE: Multiple separate Hadoop clusters on same physical machines

2015-02-02 Thread Ashish Kumar9
Is there any good reference material available to follow to test docker and hadoop integration . From: To: "'Harun Reşit Zafer'" , Date: 02/02/2015 02:57 PM Subject: RE: Multiple separate Hadoop clusters on same physical machines Hello Harun, Y

RE: Multiple separate Hadoop clusters on same physical machines

2015-02-02 Thread hadoop.support
draGanesh Hadoop Support Team ViSolve Inc.| <http://www.visolve.com> www.visolve.com From: Alexander Pivovarov [mailto:apivova...@gmail.com] Sent: Monday, February 02, 2015 12:56 PM To: user@hadoop.apache.org Subject: Re: Multiple separate Hadoop clusters on same physical machin

Re: Multiple separate Hadoop clusters on same physical machines

2015-02-01 Thread Alexander Pivovarov
start several vms and install hadoop on each vm keywords: kvm, QEMU On Mon, Jan 26, 2015 at 1:18 AM, Harun Reşit Zafer < harun.za...@tubitak.gov.tr> wrote: > Hi everyone, > > We have set up and been playing with Hadoop 1.2.x and its friends (Hbase, > pig, hive etc.) on 7 physical servers. We want

Re: Multiple separate Hadoop clusters on same physical machines

2015-02-01 Thread Alexander Alten-Lorenz
I see no possibility how federation may help to have different Clusters on _same_ machines. On top, federation isn’t production ready, since the NN can have massively issues with GC on high loaded systems, which will be the case here. To have multiple, maybe single node, clusters the best way is

Re: Multiple separate Hadoop clusters on same physical machines

2015-02-01 Thread daemeon reiydelle
Make virtualization an option. Federation will NOT solve your problems. *...* *“Life should not be a journey to the grave with the intention of arriving safely in apretty and well preserved body, but rather to skid in broadside in a cloud of smoke,thoroughly used up, totally worn out,

Re: Multiple separate Hadoop clusters on same physical machines

2015-01-26 Thread Azuryy Yu
Hi, I think the best way is deploy HDFS federation with Hadoop 2.x. On Mon, Jan 26, 2015 at 5:18 PM, Harun Reşit Zafer < harun.za...@tubitak.gov.tr> wrote: > Hi everyone, > > We have set up and been playing with Hadoop 1.2.x and its friends (Hbase, > pig, hive etc.) on 7 physical servers. We wan

Multiple separate Hadoop clusters on same physical machines

2015-01-26 Thread Harun Reşit Zafer
Hi everyone, We have set up and been playing with Hadoop 1.2.x and its friends (Hbase, pig, hive etc.) on 7 physical servers. We want to test Hadoop (maybe different versions) and ecosystem on physical machines (virtualization is not an option) from different perspectives. As a bunch of deve