Re: Shell interpreter in v0.11.1 is not installed
Hello Nils, Thank you for sharing your concerns and suggestions. I agree with you that we missed some information or instructions. I know it's an excuse but we were challenged with some security issues recently and we had to handle it with priority. I also hope it can be improved well. For the usage, thank you for letting me know your use cases. Shell interpreter looks like a mandatory component for you. We are discussing the Shell interpreter issue with the security team so I'll share how we can use it sooner than later. Best regards, Jongyoul Lee 2024년 4월 9일 (화) 오후 4:40, Nils Glueck 님이 작성: > Hello Jongyoul, > > thanks for your effort. > > The only thing that was a bit irritating to me is the fact that docs and > online pages do not really mention the removal as of now. Such as docs > for version 0.11.1.[1] Again, maybe missing something here. > > About the usage. We degraded Zeppelin from an interactive development > tool to a task runner that would run notebooks using Shell interpreter > when triggered from an external scheduler. So Zeppelin itself seems a > bit over-engineered for our purposes. > > Considering switching to good old Jenkins instead. > > Will keep an eye on any further releases from Zeppelin though. Good that > there seems to be still basic maintenance. :) Cheers > > Nils > > [1] > https://zeppelin.apache.org/docs/0.11.1/usage/interpreter/installation.html > -- Best regards, Jongyoul Lee
Re: Shell interpreter in v0.11.1 is not installed
Hello Jongyoul, thanks for your effort. The only thing that was a bit irritating to me is the fact that docs and online pages do not really mention the removal as of now. Such as docs for version 0.11.1.[1] Again, maybe missing something here. About the usage. We degraded Zeppelin from an interactive development tool to a task runner that would run notebooks using Shell interpreter when triggered from an external scheduler. So Zeppelin itself seems a bit over-engineered for our purposes. Considering switching to good old Jenkins instead. Will keep an eye on any further releases from Zeppelin though. Good that there seems to be still basic maintenance. :) Cheers Nils [1] https://zeppelin.apache.org/docs/0.11.1/usage/interpreter/installation.html
Re: Shell interpreter in v0.11.1 is not installed
Hello, Thank you for checking it. For 0.11.1, it was obliterated including deploying the 0.11.1 binary to the maven repository. Thus, installing it via install-interpreter.sh is impossible as well. Unfortunately, we don't plan to include it on official deployments until all shell interpreter security issues are resolved. For the commit, you are right it's the only commit in the master repository. However, we have one more commit as a hotfix in the branch-0.11. - https://github.com/apache/zeppelin/commit/9a51785a3a86d93888a0d959815b097ba41b35d5 I'm also preparing how to include it when you build it by yourself. Thank you for your interest. Moreover, I appreciate it if you shared your experience of how you are using shell interpreter. We can also consider for providing the feature natively, not using shell interpreter. Hope this helps you. Best regards, Jongyoul Lee 2024년 4월 9일 (화) 오전 7:20, Nils Glueck 님이 작성: > Hello, > > after switching from Zeppelin 0.11.0 to version 0.11.1, I noticed that > the Shell interpreter had disappeared from the config, while my Docker > file remained the same (using netinst binary). Also, I noted at least > one commit related to somewhat removal of Shell interpreter.[1] > > 1) Am I missing something, or has the Shell interpreter been removed > from the regular netinst binary build? > 2) I am using netinst Zeppelin 0.11.1 installation, followed by "RUN > ./bin/install-interpreter.sh --name shell", which confirms that Shell > interpreter has been installed. However, it does not show up when > checking the Interpreter config web page of Zeppelin. This can be > observed only after the recent switch from 0.11.0 to 0.11.1. I do see > Interpreters angukar, flink, flink-cmd, influxdb, jupyter, md, python, > r, spark, spark-submit, but no sh unfortunately. Can you reproduce? Is > that expected behavior? > > Thanks for comments or clearification. > > [1] > > https://github.com/apache/zeppelin/commit/194577f49aa77e9ff4117affdba65ed02a8bcc7c > > -- Best regards, Jongyoul Lee
Shell interpreter in v0.11.1 is not installed
Hello, after switching from Zeppelin 0.11.0 to version 0.11.1, I noticed that the Shell interpreter had disappeared from the config, while my Docker file remained the same (using netinst binary). Also, I noted at least one commit related to somewhat removal of Shell interpreter.[1] 1) Am I missing something, or has the Shell interpreter been removed from the regular netinst binary build? 2) I am using netinst Zeppelin 0.11.1 installation, followed by "RUN ./bin/install-interpreter.sh --name shell", which confirms that Shell interpreter has been installed. However, it does not show up when checking the Interpreter config web page of Zeppelin. This can be observed only after the recent switch from 0.11.0 to 0.11.1. I do see Interpreters angukar, flink, flink-cmd, influxdb, jupyter, md, python, r, spark, spark-submit, but no sh unfortunately. Can you reproduce? Is that expected behavior? Thanks for comments or clearification. [1] https://github.com/apache/zeppelin/commit/194577f49aa77e9ff4117affdba65ed02a8bcc7c