Re: [DISCUSS] Change some default settings for avoiding unintended usages

[Jeff Zhang]

+1 for running interpreter process in docker container.



Jongyoul Lee 于2017年12月1日周五 下午3:36写道：

> Yes, exactly, this is not only the shell interpreter problem, all can run
> any script through python and Scala. Shell is just an example.
>
> Using docker looks good but it cannot avoid unindented usage of resources
> like mining coin.
>
> On Fri, Dec 1, 2017 at 2:36 PM, Felix Cheung 
> wrote:
>
> > I don’t think that’s limited to the shell interpreter.
> >
> > You can run any arbitrary program or script from python or Scala (or
> java)
> > as well.
> >
> > _
> > From: Jeff Zhang 
> > Sent: Wednesday, November 29, 2017 4:00 PM
> > Subject: Re: [DISCUSS] Change some default settings for avoiding
> > unintended usages
> > To: 
> > Cc: users 
> >
> >
> >
> > Shell interpreter is a black hole for security, usually we don't
> recommend
> > or allow user to use shell.
> >
> > We may need to refactor the shell interpreter, running under zeppelin
> user
> > is too dangerous.
> >
> >
> >
> >
> >
> > Jongyoul Lee 于2017年11月29日周三 下午11:44写道：
> >
> > > Hi, users and dev,
> > >
> > > Recently, I've got an issue about the abnormal usage of some
> > interpreters.
> > > Zeppelin's users can access shell by shell and python interpreters. It
> > > means all users can run or execute what they want even if it harms the
> > > system. Thus I agree that we need to change some default settings to
> > > prevent this kind of abusing situation. Before we proceed to do it, I
> > want
> > > to listen to others' opinions.
> > >
> > > Feel free to reply this email
> > >
> > > Regards,
> > > Jongyoul
> > >
> > > --
> > > 이종열, Jongyoul Lee, 李宗烈
> > > http://madeng.net
> > >
> >
> >
> >
>
>
> --
> 이종열, Jongyoul Lee, 李宗烈
> http://madeng.net
>

Re: [DISCUSS] Change some default settings for avoiding unintended usages

[Jongyoul Lee]

Yes, exactly, this is not only the shell interpreter problem, all can run
any script through python and Scala. Shell is just an example.

Using docker looks good but it cannot avoid unindented usage of resources
like mining coin.

On Fri, Dec 1, 2017 at 2:36 PM, Felix Cheung 
wrote:

> I don’t think that’s limited to the shell interpreter.
>
> You can run any arbitrary program or script from python or Scala (or java)
> as well.
>
> _
> From: Jeff Zhang 
> Sent: Wednesday, November 29, 2017 4:00 PM
> Subject: Re: [DISCUSS] Change some default settings for avoiding
> unintended usages
> To: 
> Cc: users 
>
>
>
> Shell interpreter is a black hole for security, usually we don't recommend
> or allow user to use shell.
>
> We may need to refactor the shell interpreter, running under zeppelin user
> is too dangerous.
>
>
>
>
>
> Jongyoul Lee 于2017年11月29日周三 下午11:44写道：
>
> > Hi, users and dev,
> >
> > Recently, I've got an issue about the abnormal usage of some
> interpreters.
> > Zeppelin's users can access shell by shell and python interpreters. It
> > means all users can run or execute what they want even if it harms the
> > system. Thus I agree that we need to change some default settings to
> > prevent this kind of abusing situation. Before we proceed to do it, I
> want
> > to listen to others' opinions.
> >
> > Feel free to reply this email
> >
> > Regards,
> > Jongyoul
> >
> > --
> > 이종열, Jongyoul Lee, 李宗烈
> > http://madeng.net
> >
>
>
>


-- 
이종열, Jongyoul Lee, 李宗烈
http://madeng.net

Re: [DISCUSS] Change some default settings for avoiding unintended usages

[Felix Cheung]

I don’t think that’s limited to the shell interpreter.

You can run any arbitrary program or script from python or Scala (or java) as 
well.

_
From: Jeff Zhang 
Sent: Wednesday, November 29, 2017 4:00 PM
Subject: Re: [DISCUSS] Change some default settings for avoiding unintended 
usages
To: 
Cc: users 


Shell interpreter is a black hole for security, usually we don't recommend
or allow user to use shell.

We may need to refactor the shell interpreter, running under zeppelin user
is too dangerous.





Jongyoul Lee 于2017年11月29日周三 下午11:44写道：

> Hi, users and dev,
>
> Recently, I've got an issue about the abnormal usage of some interpreters.
> Zeppelin's users can access shell by shell and python interpreters. It
> means all users can run or execute what they want even if it harms the
> system. Thus I agree that we need to change some default settings to
> prevent this kind of abusing situation. Before we proceed to do it, I want
> to listen to others' opinions.
>
> Feel free to reply this email
>
> Regards,
> Jongyoul
>
> --
> 이종열, Jongyoul Lee, 李宗烈
> http://madeng.net
>

Re: Sequential processing disabled?

[Jianfeng (Jeff) Zhang]

It is per interpreter. You can create impala interperter based on jdbc 
template. and configure its zeppelin.jdbc.concurrent.use to false,


Best Regard,
Jeff Zhang


From: "Geiss, Chris" mailto:chris.ge...@citi.com>>
Reply-To: "users@zeppelin.apache.org" 
mailto:users@zeppelin.apache.org>>
Date: Thursday, November 30, 2017 at 10:10 PM
To: "users@zeppelin.apache.org" 
mailto:users@zeppelin.apache.org>>
Subject: RE: Sequential processing disabled?

Jeff,

OK makes sense. Is this a global setting? Can it be set per user, or per 
Notebook?

Chris


From: Jianfeng (Jeff) Zhang [mailto:jzh...@hortonworks.com]
Sent: Thursday, November 30, 2017 9:08 AM
To: users@zeppelin.apache.org
Subject: Re: Sequential processing disabled?


Right, when zeppelin.jdbc.concurrent.useis false, paragraphs will run as FIFO


Best Regard,
Jeff Zhang


From: "Geiss, Chris" mailto:chris.ge...@citi.com>>
Reply-To: "users@zeppelin.apache.org" 
mailto:users@zeppelin.apache.org>>
Date: Thursday, November 30, 2017 at 9:58 PM
To: "users@zeppelin.apache.org" 
mailto:users@zeppelin.apache.org>>
Subject: RE: Sequential processing disabled?

Hi Jeff,

Thank you for the reply. So that will result in Impala paragraphs running 
sequentially? Is that because Impala goes through JDBC?

Chris


From: Jianfeng (Jeff) Zhang [mailto:jzh...@hortonworks.com]
Sent: Wednesday, November 29, 2017 7:03 PM
To: users@zeppelin.apache.org
Subject: Re: Sequential processing disabled?


You can configure zeppelin.jdbc.concurrent.use as false to make jdbc 
interpreter run sequentially

Best Regard,
Jeff Zhang


From: "Geiss, Chris" mailto:chris.ge...@citi.com>>
Reply-To: "users@zeppelin.apache.org" 
mailto:users@zeppelin.apache.org>>
Date: Thursday, November 30, 2017 at 6:22 AM
To: "'users@zeppelin.apache.org'" 
mailto:users@zeppelin.apache.org>>
Subject: Sequential processing disabled?

I am using Zeppelin 0.8.0-SNAPSHOT with Impala. If I understand correctly, 
paragraphs that use the same interpreter should process sequentially. But some 
of the paragraphs seem to process in parallel. Am I wrong that they should be 
sequentially executed, or is there something different about Impala? Is there 
some configuration option I can check?

Chris

RE: Sequential processing disabled?

[Geiss, Chris]

Jeff,

OK makes sense. Is this a global setting? Can it be set per user, or per 
Notebook?

Chris


From: Jianfeng (Jeff) Zhang [mailto:jzh...@hortonworks.com]
Sent: Thursday, November 30, 2017 9:08 AM
To: users@zeppelin.apache.org
Subject: Re: Sequential processing disabled?


Right, when zeppelin.jdbc.concurrent.use is false, paragraphs will run as FIFO


Best Regard,
Jeff Zhang


From: "Geiss, Chris" mailto:chris.ge...@citi.com>>
Reply-To: "users@zeppelin.apache.org" 
mailto:users@zeppelin.apache.org>>
Date: Thursday, November 30, 2017 at 9:58 PM
To: "users@zeppelin.apache.org" 
mailto:users@zeppelin.apache.org>>
Subject: RE: Sequential processing disabled?

Hi Jeff,

Thank you for the reply. So that will result in Impala paragraphs running 
sequentially? Is that because Impala goes through JDBC?

Chris


From: Jianfeng (Jeff) Zhang [mailto:jzh...@hortonworks.com]
Sent: Wednesday, November 29, 2017 7:03 PM
To: users@zeppelin.apache.org
Subject: Re: Sequential processing disabled?


You can configure zeppelin.jdbc.concurrent.use as false to make jdbc 
interpreter run sequentially

Best Regard,
Jeff Zhang


From: "Geiss, Chris" mailto:chris.ge...@citi.com>>
Reply-To: "users@zeppelin.apache.org" 
mailto:users@zeppelin.apache.org>>
Date: Thursday, November 30, 2017 at 6:22 AM
To: "'users@zeppelin.apache.org'" 
mailto:users@zeppelin.apache.org>>
Subject: Sequential processing disabled?

I am using Zeppelin 0.8.0-SNAPSHOT with Impala. If I understand correctly, 
paragraphs that use the same interpreter should process sequentially. But some 
of the paragraphs seem to process in parallel. Am I wrong that they should be 
sequentially executed, or is there something different about Impala? Is there 
some configuration option I can check?

Chris

Re: Sequential processing disabled?

[Jianfeng (Jeff) Zhang]

Right, when zeppelin.jdbc.concurrent.use is false, paragraphs will run as FIFO


Best Regard,
Jeff Zhang


From: "Geiss, Chris" mailto:chris.ge...@citi.com>>
Reply-To: "users@zeppelin.apache.org" 
mailto:users@zeppelin.apache.org>>
Date: Thursday, November 30, 2017 at 9:58 PM
To: "users@zeppelin.apache.org" 
mailto:users@zeppelin.apache.org>>
Subject: RE: Sequential processing disabled?

Hi Jeff,

Thank you for the reply. So that will result in Impala paragraphs running 
sequentially? Is that because Impala goes through JDBC?

Chris


From: Jianfeng (Jeff) Zhang [mailto:jzh...@hortonworks.com]
Sent: Wednesday, November 29, 2017 7:03 PM
To: users@zeppelin.apache.org
Subject: Re: Sequential processing disabled?


You can configure zeppelin.jdbc.concurrent.use as false to make jdbc 
interpreter run sequentially

Best Regard,
Jeff Zhang


From: "Geiss, Chris" mailto:chris.ge...@citi.com>>
Reply-To: "users@zeppelin.apache.org" 
mailto:users@zeppelin.apache.org>>
Date: Thursday, November 30, 2017 at 6:22 AM
To: "'users@zeppelin.apache.org'" 
mailto:users@zeppelin.apache.org>>
Subject: Sequential processing disabled?

I am using Zeppelin 0.8.0-SNAPSHOT with Impala. If I understand correctly, 
paragraphs that use the same interpreter should process sequentially. But some 
of the paragraphs seem to process in parallel. Am I wrong that they should be 
sequentially executed, or is there something different about Impala? Is there 
some configuration option I can check?

Chris

RE: Sequential processing disabled?

[Geiss, Chris]

Hi Jeff,

Thank you for the reply. So that will result in Impala paragraphs running 
sequentially? Is that because Impala goes through JDBC?

Chris


From: Jianfeng (Jeff) Zhang [mailto:jzh...@hortonworks.com]
Sent: Wednesday, November 29, 2017 7:03 PM
To: users@zeppelin.apache.org
Subject: Re: Sequential processing disabled?


You can configure zeppelin.jdbc.concurrent.use as false to make jdbc 
interpreter run sequentially

Best Regard,
Jeff Zhang


From: "Geiss, Chris" mailto:chris.ge...@citi.com>>
Reply-To: "users@zeppelin.apache.org" 
mailto:users@zeppelin.apache.org>>
Date: Thursday, November 30, 2017 at 6:22 AM
To: "'users@zeppelin.apache.org'" 
mailto:users@zeppelin.apache.org>>
Subject: Sequential processing disabled?

I am using Zeppelin 0.8.0-SNAPSHOT with Impala. If I understand correctly, 
paragraphs that use the same interpreter should process sequentially. But some 
of the paragraphs seem to process in parallel. Am I wrong that they should be 
sequentially executed, or is there something different about Impala? Is there 
some configuration option I can check?

Chris