Rahul, If a client can use HDFS RPC why is a Proxy required? Are the clients not allowed to reach data nodes directly?
WebHDFS + Apache Traffic server or HDFS RPC + SOCK Proxy should work. If you can share a use case, it would probably help. -rajive ----- Original Message ----- From: Rahul Shrivastava <rhshr...@gmail.com> To: hdfs-dev@hadoop.apache.org; Rajiv Chittajallu <raj...@yahoo-inc.com> Cc: Sent: Monday, February 9, 2015 2:58 PM Subject: Re: Proxy for HDFS Thanks Rajiv. I did look into HttpFs before but i wanted a build a proxy at HDFS layer. This is specific for clients which do not use HTTP ( i.e. HttpFs or webHDFS) to talk to the HDFS cluster. That includes clients which uses HDFS driver to talk to HDFS cluster. thanks Rahul On Mon, Feb 9, 2015 at 2:53 PM, Rajiv Chittajallu < raj...@yahoo-inc.com.invalid> wrote: > > https://github.com/apache/hadoop/tree/branch-2.6/hadoop-hdfs-project/hadoop-hdfs-httpfs > > > > > ----- Original Message ----- > From: Rahul Shrivastava <rhshr...@gmail.com> > To: hdfs-dev@hadoop.apache.org > Cc: > Sent: Monday, February 9, 2015 2:35 PM > Subject: Proxy for HDFS > > Hi, > > I have looking in HDFS code base ( 2.6.0) for the last couple of days for > any possible proxy that we could utilize to create a proxy for HDFS. > Is there any hook within HDFS to build a proxy around that. > > thanks > Rahul >