Re: Interpreter docker mode
I recall watching a youtube demo from Moon about running zeppelin in kubernetes. He showed a separate interpreter container got spawned to run each notebook. I have been thinking 0.9 is the release for it. I am looking forward to this feature. Thanks Denny > On Dec 11, 2019, at 8:32 PM, Jeff Zhang wrote: > > Hi Denny, > > I have created PR before (not merged yet), but don't have time to continue > to polish it. Feel free to pick it up if you would like to contribute to > Zeppelin. > > https://github.com/apache/zeppelin/pull/3380 > > > > 于2019年12月12日周四 上午2:48写道： > >> Hi All >> >> I recall there is a JIRA to create docker images for the interpreters, but >> i can’t find any info in the 0.9 zeppelin page. >> >> I have a requirement to run python interpreter (docker container) in a >> different machine than the zeppelin server (docker container). A python >> interpreter container is created for each user notebook (security). So one >> machine to run the zeppelin container alone, one or more machine to run all >> python interpreter containers. Is this doable in 0.9 or later release? >> >> Thanks >> Denny >> > > > -- > Best Regards > > Jeff Zhang
Re: Interpreter docker mode
Hi All I recall there is a JIRA to create docker images for the interpreters, but i can’t find any info in the 0.9 zeppelin page. I have a requirement to run python interpreter (docker container) in a different machine than the zeppelin server (docker container). A python interpreter container is created for each user notebook (security). So one machine to run the zeppelin container alone, one or more machine to run all python interpreter containers. Is this doable in 0.9 or later release? Thanks Denny
Re: [GitHub] [zeppelin] liuxunorg commented on a change in pull request #3383: [ZEPPELIN-4104] Zeppelin Interpreter On Docker
I have question about the behavior.
Suppose user uses the per note scope and his notebook consists of python, r,
and sql paragraphs. How many interpreter containers will be spawned when the
note is run?
Thanks
> On Jun 13, 2019, at 3:27 AM, GitBox wrote:
>
> liuxunorg commented on a change in pull request #3383: [ZEPPELIN-4104]
> Zeppelin Interpreter On Docker
> URL: https://github.com/apache/zeppelin/pull/3383#discussion_r293238678
>
>
>
> ##
> File path:
> zeppelin-plugins/launcher/docker/src/main/java/org/apache/zeppelin/interpreter/launcher/DockerInterpreterLauncher.java
> ##
> @@ -0,0 +1,79 @@
> +/*
> + * Licensed to the Apache Software Foundation (ASF) under one or more
> + * contributor license agreements. See the NOTICE file distributed with
> + * this work for additional information regarding copyright ownership.
> + * The ASF licenses this file to You under the Apache License, Version 2.0
> + * (the "License"); you may not use this file except in compliance with
> + * the License. You may obtain a copy of the License at
> + *
> + *http://www.apache.org/licenses/LICENSE-2.0
> + *
> + * Unless required by applicable law or agreed to in writing, software
> + * distributed under the License is distributed on an "AS IS" BASIS,
> + * WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
> + * See the License for the specific language governing permissions and
> + * limitations under the License.
> + */
> +package org.apache.zeppelin.interpreter.launcher;
> +
> +import org.apache.zeppelin.conf.ZeppelinConfiguration;
> +import org.apache.zeppelin.interpreter.recovery.RecoveryStorage;
> +import org.slf4j.Logger;
> +import org.slf4j.LoggerFactory;
> +
> +import java.io.IOException;
> +import java.util.Map;
> +
> +/**
> + * Interpreter Launcher which use shell script to launch the interpreter
> process.
> + */
> +public class DockerInterpreterLauncher extends InterpreterLauncher {
> + private static final Logger LOGGER =
> LoggerFactory.getLogger(DockerInterpreterLauncher.class);
> +
> + private InterpreterLaunchContext context;
> +
> + public DockerInterpreterLauncher(ZeppelinConfiguration zConf,
> RecoveryStorage recoveryStorage)
> + throws IOException {
> +super(zConf, recoveryStorage);
> + }
> +
> + @Override
> + public InterpreterClient launch(InterpreterLaunchContext context) throws
> IOException {
> +LOGGER.info("Launching Interpreter: " +
> context.getInterpreterSettingGroup());
> +this.context = context;
> +this.properties = context.getProperties();
> +int connectTimeout = getConnectTimeout();
> +if (connectTimeout < 20) {
>
> Review comment:
> This configuration item is already in `zeppelin-site.xml`,
> `zeppelin.interpreter.connect.timeout`
> ok, I am modifying the log message.
>
>
> This is an automated message from the Apache Git Service.
> To respond to the message, please log on to GitHub and use the
> URL above to go to the specific comment.
>
> For queries about this service, please contact Infrastructure at:
> us...@infra.apache.org
>
>
> With regards,
> Apache Git Services
Re: Angular version upgrade in Zeppelin
Hi What is the status of the ZEPPELIN-3981? Is this still committed? The bootstrap version used in 0.8 Zeppelin has many security issues. Please prioritize the frontend upgrade, because the security issues would prevent Zeppelin to be deployed in the cloud environment. Thanks Denny > On May 12, 2019, at 11:04 PM, Jeff Zhang wrote: > > There's some work going on, but it would require time as this is not a > trivial upgrade. The ETA would be next half of this year IMO. > > Denny 于2019年5月13日周一 上午11:00写道： > >> Hi >> >> Any update on this issue? When can we expect to see the angular and >> bootstrap upgrade to happen? The current versions are quite old and have >> security issues. Thanks >> >> https://issues.apache.org/jira/browse/ZEPPELIN-3981 >> >>> On Mar 7, 2019, at 8:46 PM, Xun Liu wrote: >>> >>> Now write the python algorithm in the note, The reaction has been slow. >>> Thank you very much, you can help upgrade the frontend. >>> >>> Thank! >>> 在 2019年3月8日，上午9:27，Jeff Zhang 写道： The old angular version do cause many issues in frontend, I am thinking >> of it for a long time to upgrade it to angular 7. If anyone is interested >> on it, I would be very appreciated. 于2019年3月8日周五 上午9:24写道： > That’s great! I assume bootstrap is part of the upgrade (it has >> security > issues). What is the timeframe this will be done? > > Thanks > Denny > >> On Mar 7, 2019, at 6:56 PM, Jongyoul Lee wrote: >> >> Hi, >> >> I've added the related issue to GSOC as well. Please check >> https://issues.apache.org/jira/browse/ZEPPELIN-3981 >> >>> On Fri, Mar 8, 2019 at 2:44 AM wrote: >>> >>> Hi All >>> >>> The current Angular 1.5 used in the latest Zeppelin has security >> issues >>> (XSS). I see there is an outstanding jira issue to address the >> version >>> upgrade (ZEPPELIN-2747), but it is not assigned to be worked on. Can > this >>> issue be addressed soon? >>> >>> Thanks >>> Denny >>> >> >> >> -- >> 이종열, Jongyoul Lee, 李宗烈 >> http://madeng.net > > -- Best Regards Jeff Zhang >>> >>> >> > > > -- > Best Regards > > Jeff Zhang
Re: [jira] [Created] (ZEPPELIN-4104) Zeppelin interpreter On Docker
Hi Question. Is this enhancement going to decouple the interpreters and Zeppelin server? In per note scoped mode, will one instance of interpreter docker be created per note? When will this enhancement be available? In what zeppelin version (0.8.2)? Can R interpreter be in docker as well? Thanks > On Apr 1, 2019, at 4:11 AM, Xun Liu (JIRA) wrote: > > Xun Liu created ZEPPELIN-4104: > - > > Summary: Zeppelin interpreter On Docker > Key: ZEPPELIN-4104 > URL: https://issues.apache.org/jira/browse/ZEPPELIN-4104 > Project: Zeppelin > Issue Type: Improvement >Reporter: Xun Liu >Assignee: Xun Liu > > > Python needs to install a lot of dependent libraries in the zeppelin > interpreter. > Different users may need to use different versions of the python library. > If you install the python library directly on the physical host, Not only > difficult to maintain, but also easy to cause python library conflicts. > In some lightweight user scenarios, They don't have kubernetes or YARN. > But installing a docker is very easy. > So, if zeppelin can create the interpreter in docker, Help for users can be > very large. > > > > -- > This message was sent by Atlassian JIRA > (v7.6.3#76005)
Re: Angular version upgrade in Zeppelin
That’s great! I assume bootstrap is part of the upgrade (it has security issues). What is the timeframe this will be done? Thanks Denny > On Mar 7, 2019, at 6:56 PM, Jongyoul Lee wrote: > > Hi, > > I've added the related issue to GSOC as well. Please check > https://issues.apache.org/jira/browse/ZEPPELIN-3981 > >> On Fri, Mar 8, 2019 at 2:44 AM wrote: >> >> Hi All >> >> The current Angular 1.5 used in the latest Zeppelin has security issues >> (XSS). I see there is an outstanding jira issue to address the version >> upgrade (ZEPPELIN-2747), but it is not assigned to be worked on. Can this >> issue be addressed soon? >> >> Thanks >> Denny >> > > > -- > 이종열, Jongyoul Lee, 李宗烈 > http://madeng.net
Re: Angular version upgrade in Zeppelin
Hi All The current Angular 1.5 used in the latest Zeppelin has security issues (XSS). I see there is an outstanding jira issue to address the version upgrade (ZEPPELIN-2747), but it is not assigned to be worked on. Can this issue be addressed soon? Thanks Denny
Re: ipython
Hi Can ipython server run inside its own docker container? How does ipython server run in Zeppelin container? Does it run inside the Zeppelin container? Thanks
Re: R docker container support
Hi Currently, we have zeppelin and python containers running separately, so we can scale them individually. For example, user can specify how much computer resources (cpu and memory) to assign to the python container depending on the python script compute requirement. We want to do the same for R language. I can see there are R docker images out there, so it shouldn’t be an issue running R in a container. However, it is not clear to me how R interpreter can send R scripts to the container for execution and get the result back for display. Do you have any suggestion? Thanks Denny > On Jan 28, 2019, at 8:37 PM, Jeff Zhang wrote: > > Zeppelin has R interpreter which you can use to evaluate r script. Could > you let us know why this R interpreter can not meet your requirement ? > > 于2019年1月29日周二 上午3:16写道： > >> Hi >> >> In zeppelin 0.8, there is a support for python container. I want to know >> if there is a plan to support R container? If not, any suggestion on 3rd >> library that behaves like py4j? We are evaluating how to have a R >> interpreter to send R script to a R container for execution and get the >> result back for display. >> >> Thanks >> Denny >> > > > -- > Best Regards > > Jeff Zhang
R docker container support
Hi In zeppelin 0.8, there is a support for python container. I want to know if there is a plan to support R container? If not, any suggestion on 3rd library that behaves like py4j? We are evaluating how to have a R interpreter to send R script to a R container for execution and get the result back for display. Thanks Denny
Does the pivot chart support mobile env?
Hi Does the pivot chart support mobile env? I can’t drag and drop an item (from available fields) to the keys/groups/values fields in mobile environment (phone). Thanks Denny
Re: R Container
I am interested in R interpreter docker support similar to Python docker support in 0.8. Is there any plan to enable R container support? Thanks Denny
Re: Zeppelin 0.8 ETA
Hi All Please let me know the release date of the apache zeppelin 0.8. P.S. The website shows it is still in development. Thanks Denny
