Re: Multiple DataNodes on a single machine

2014-05-29 Thread hadoop hive
: Multiple DataNodes on a single machine . Ist works fine 2 datanodes are up and running . So i have 2 conf Folders conf and conf2 in hadoop-home . If i have to set dfs.replication value to 3 - in which hdfs-site.xml should i set ? should it be hdfs-site.xml in conf or conf2 . what should

RE: Multiple DataNodes on a single machine

2014-05-27 Thread sindhu hosamane
Hello friends , i set up 2 datanodes on a single machine accordingly mentioned in the thread RE: Multiple DataNodes on a single machine . Ist works fine 2 datanodes are up and running . So i have 2 conf Folders conf and conf2 in hadoop-home . If i have to set dfs.replication value to 3

Re: Multiple DataNodes on a single machine

2010-09-16 Thread Ranjib Dey
to me, the notion of replication is to provide a failsafe mechanism in case some nodes go down, hence running two datanode on a single host does not serve this basic purpose. As already mentioned you can run two data nodes using two instanced of hadoop with different ports. In case you do not want

RE: Multiple DataNodes on a single machine

2010-09-16 Thread Arv Mistry
. Cheers Arv -Original Message- From: Matthew Foley [mailto:ma...@yahoo-inc.com] Sent: September 15, 2010 8:45 PM To: common-user@hadoop.apache.org Cc: Matthew Foley Subject: Re: Multiple DataNodes on a single machine Hello Arv, It is possible to run multiple datanodes on a single machine

Re: Multiple DataNodes on a single machine

2010-09-15 Thread Nan Zhu
Hi, Arv, Actually, several days ago, I deployed a system which is similar with your requirements In our cluster environment, since I have to run modified hadoop, we invoked two namenodes, two jobtrackers, two trackers on each node, and as you mentioned, two datanodes in single host, What you

Re: Multiple DataNodes on a single machine

2010-09-15 Thread David Rosenstrauch
On 09/15/2010 11:50 AM, Arv Mistry wrote: Hi, Is it possible to run multiple data nodes on a single machine? I currently have a machine with multiple disks and enough disk capacity for replication across them. I don't need redundancy at the machine level but would like to be able to handle a

Re: Multiple DataNodes on a single machine

2010-09-15 Thread Matthew Foley
Hello Arv, It is possible to run multiple datanodes on a single machine, and this can be useful for small-scale test scenarios. Also you mentioned in your previous message that you have a Hadoop implementation with only one physical datanode server and want to replicate within it, between