Larry McCay created KNOX-2240:
---------------------------------
Summary: KnoxShell Custom Command for WEBHDFS Use
Key: KNOX-2240
URL: https://issues.apache.org/jira/browse/KNOX-2240
Project: Apache Knox
Issue Type: Improvement
Reporter: Larry McCay
Assignee: Larry McCay
I'd like to extend the KnoxShell environment to have a Custom Command for
interacting with Hadoop FileSystems that support the WebHDFS REST API. We will
wrap the use of the KnoxShell HDFS classes for posix like commands in the shell
environment.
In order to interact with multiple webhdfs filesystems we introduce the notion
of mounting a webhdfs service from a Knox topology URL. For instance, see the
following mount command to mount such a service to a mount point:
{code}
:fs mount https://knoxhost.example.com/cdp-retail-2-5-dataeng/cdp-proxy-api
retail
{code}
The above mounts a Hadoop filesystem to a mount point called "retail".
Given this mounted filesystem we are able to interact with it through the
mountpoint as the root.
{code}
:fs ls /retail/user/lmccay
{code}
The above will list the contents of my home directory from the mounted
filesystem as well as return the listing as a KnoxShellTable that can be
sorted, selected, filtered, etc as any other KnoxShellTable.
Additional commands
{code}
:fs mkdir /retail/user/lmccay/tmp 755
:fs cat /retail/user/lmccay/tmp/README
:fs put /retail/user/lmccay/tmp/README
:fs get /retail/user/lmccay/tmp/README /home/lmccay/README
:fs rename /retail/user/lmccay/tmp/README /retail/user/lmccay/tmp/README2
:fs rm /retail/user/lmccay/tmp/README
{code}
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
