Re: Question regarding access to different hadoop 2.0 cluster

2013-11-06 Thread Bobby Evans
be able to talk to the new/updated HDFS. This includes Gateways, RM, Compute Nodes, Oozie Servers, etc. Again, this is not that big of a deal for a small setup, but for a large setup it can be painful. --Bobby On 11/5/13 4:57 PM, "Suresh Srinivas" wrote: >On Tue, Nov 5, 2013 at 6

Re: Question regarding access to different hadoop 2.0 cluster

2013-11-05 Thread Bobby Evans
But that does present a problem if you have to change the DNS address of one of the HA namenodes. It forces you to update the config on all other clusters that want to talk to it. If you only have a few clusters that is probably not a big deal, but it can be problematic if you have many different

Re: [Proposal] Pluggable Namespace

2013-10-07 Thread Bobby Evans
Putting all conspiracy theories aside :). Any way we decided to scale the name node is going to have limitations. Federation currently has the problem that we cannot easily move data between different name nodes. It is a static partitioning. It is not a blocker, but it can be annoying. We can f

Re: About debugging HDFS and MapReduce...

2013-10-07 Thread Bobby Evans
I am not sure what you mean by some portion of source code of Hadoop. Because you are running on a fully distributed environment you need to make sure that eclipse is attached to the correct process. If you are trying to debug the data upload pipeline then you need to be sure that eclipse is attac

Re: [VOTE] Release Apache Hadoop 2.2.0

2013-10-07 Thread Bobby Evans
I ran some basic sanity tests and it seems OK to me. +1 On 10/7/13 2:00 AM, "Arun C Murthy" wrote: >Folks, > >I've created a release candidate (rc0) for hadoop-2.2.0 that I would like >to get released - this release fixes a small number of bugs and some >protocol/api issues which should ensure

Re: [Proposal] Pluggable Namespace

2013-10-04 Thread Bobby Evans
I think it would be awesome to make this happen. I am +1 for the general direction. I am by no means an HDFS expert but I would like to see the patches you have made. If you could file a JIRA that points to the modifications on github or in patches and any design work you have explaining it (incl