-inc.com.INVALID'
wrote:
read the documentation.
From: Rahul Shrivastava rhshr...@gmail.com
To: Rajiv Chittajallu raj...@yahoo-inc.com
Cc: hdfs-dev@hadoop.apache.org hdfs-dev@hadoop.apache.org
Sent: Monday, February 9, 2015 9:53 PM
Subject: Re: Proxy for HDFS
apply filter to the content at the proxy level.
Please guide me as to if this feasible in current Hadoop architecture. Will
an enhancement request to build a proxy hooks for HDFS so that we can apply
more policy decisions at the proxy level make sense?
thanks
Rahul
On Mon, Feb 9, 2015 at 4
read the documentation.
From: Rahul Shrivastava rhshr...@gmail.com
To: Rajiv Chittajallu raj...@yahoo-inc.com
Cc: hdfs-dev@hadoop.apache.org hdfs-dev@hadoop.apache.org
Sent: Monday, February 9, 2015 9:53 PM
Subject: Re: Proxy for HDFS
Hi Rajiv,
At runtime
/hadoop-hdfs/HdfsPermissionsGuide.html#ACLs_Access_Control_Lists
From: Rahul Shrivastava rhshr...@gmail.com
To: hdfs-dev@hadoop.apache.org; Rajiv Chittajallu raj...@yahoo-inc.com
Sent: Monday, February 9, 2015 3:24 PM
Subject: Re: Proxy for HDFS
Hi Rajiv,
Thanks
Hi,
I have looking in HDFS code base ( 2.6.0) for the last couple of days for
any possible proxy that we could utilize to create a proxy for HDFS.
Is there any hook within HDFS to build a proxy around that.
thanks
Rahul
https://github.com/apache/hadoop/tree/branch-2.6/hadoop-hdfs-project/hadoop-hdfs-httpfs
- Original Message -
From: Rahul Shrivastava rhshr...@gmail.com
To: hdfs-dev@hadoop.apache.org
Cc:
Sent: Monday, February 9, 2015 2:35 PM
Subject: Proxy for HDFS
Hi,
I have looking in HDFS code
Thanks Rajiv.
I did look into HttpFs before but i wanted a build a proxy at HDFS layer.
This is specific for clients which do not use HTTP ( i.e. HttpFs or
webHDFS) to talk to the HDFS cluster. That includes clients which uses HDFS
driver to talk to HDFS cluster.
thanks
Rahul
On Mon, Feb 9
Rahul,
If a client can use HDFS RPC why is a Proxy required? Are the clients not
allowed to reach data nodes directly?
WebHDFS + Apache Traffic server or HDFS RPC + SOCK Proxy should work.
If you can share a use case, it would probably help.
-rajive
- Original Message -
From: Rahul
Hi Rajiv,
Thanks again for quick reply.
The use case is as follows. Please let me know how can i use HDFS RPC+SOCKS
proxy to achieve below.
1. Client connect to HDFS proxy using HDFS driver ( not HTTPFs or
WebHDFS).Proxy that sits between client and HDFS server.
2. Client request to access
