Re: [DISCUSS] Scoping KnoxShell changes for 0.12.0

2017-01-30 Thread Pierre Regazzoni
Hi Larry, The basic premise would be to be able to open a knox shell within the notebook as follow: %knox Hdfs.rm(session).file(“/path/to/file”).now() knox host, port and credentials would need to be set in the plug-in configuration. This would allow directly client interaction with the clust

Re: [DISCUSS] Scoping KnoxShell changes for 0.12.0

2017-01-30 Thread larry mccay
Hi Pierre - Yes, Sumit has already implemented an interpreter to do that. I am more interested in what you see as the value-add or the reason that someone would want to use the Knox DSL instead of existing interpreters for largely the same access. >From a language perspective the DSL does have c

Re: [DISCUSS] Scoping KnoxShell changes for 0.12.0

2017-01-30 Thread Sumit Gupta
Thanks for the thoughts Larry and Sandeep. I agree on both ideas. I do think that it would be good to be able to get KnoxShell without having to install the gateway or having admin access. That being said the gateway will be running somewhere and I think it is a nice idea to be able to download it

Re: [DISCUSS] Scoping KnoxShell changes for 0.12.0

2017-01-30 Thread larry mccay
Hi Sandeep - Interesting thoughts on the download. Personally, I think that we need a separate download as well. * This is more easily turned into an RPM or docker image, etc * The Admin UI currently requires admin credentials. It is likely to need to be able to support non-admins as well someday

Re: [DISCUSS] Scoping KnoxShell changes for 0.12.0

2017-01-30 Thread Sandeep More
Thanks Sumit this is a great summary ! I have thoughts on #2 2. Do we need a release module for KnoxShell? How do we want to provide the download to users? SRM : Thinking out loud, I think it would be nice if KnoxShell has the same version as Knox and is packed in the same distribution as Knox.

Re: [DISCUSS] Scoping KnoxShell changes for 0.12.0

2017-01-30 Thread larry mccay
Hi Sumit - Thanks for the check point summary and DISCUSS thread. The summary actually sounds like we are really making some good progress - which I knew but hadn't seen it put all together like this! 1. What are the use cases driving the Zeppelin interpreter? How is that expected to be used and

[DISCUSS] Scoping KnoxShell changes for 0.12.0

2017-01-30 Thread sumit gupta
Hey everyone, The list of JIRAs for 0.12.0 have steadily increased over the last few weeks. We have also had a lot of great activity and contributions related to KIP-4 and KnoxShell improvements. I wanted to start a discuss thread to tie things up a little bit for a reasonable deliverable in this