Re: Slack channel for Zeppelin community

[Khalid Huseynov]

Hi Jeff,

Sorry for the late reply, could you invite me also with kha...@apache.org ?

Thanks!

On Thu, Feb 11, 2021 at 12:17 AM Jeff Zhang  wrote:

> Hi Folks,
>
> We have an apache slack channel for Zeppelin, but we didn't make lots of
> discussion there,  but I think it is suitable for many kinds of discussion,
> specially we recently talked about regular community sync up meeting. So if
> you are interested, please leave your slack account in this thread, I will
> invite you to join it.
>
>
>
> --
> Best Regards
>
> Jeff Zhang
>

Re: [VOTE] Release Apache Zeppelin 0.9.0-preview1 (RC1)

[Khalid Huseynov]

+ 1

On Thu, Mar 26, 2020 at 4:19 PM Xun Liu  wrote:

> +1
>
> On Thu, Mar 26, 2020 at 5:33 AM moon soo Lee  wrote:
>
>> +1
>>
>> Tested
>>  - The binary package can run tutorial notebook out of the box
>>  - Can build docker image
>> - scripts/docker/zeppelin/bin/Dockerfile give me some error on R
>> dependency installation. But I think it's not a blocker. We can address it
>> on next RC.
>>  - Zeppelin on Kubernetes
>> - Everything but Spark-2.4.5 does not run out of the box. I think it
>> is
>> not a blocker. We can address it on next RC.
>>
>>
>>
>>
>> On Wed, Mar 25, 2020 at 11:21 AM Prabhjyot Singh <
>> prabhjyotsi...@apache.org>
>> wrote:
>>
>> > +1
>> >
>> > On Wed, 25 Mar 2020 at 21:12, Eric Pugh <
>> ep...@opensourceconnections.com>
>> > wrote:
>> >
>> > > Out of curiosity, is there a Docker version of 0.9.0 preview1
>> available?
>> > > I tend to run Zeppelin as a Docker image, and I know I had some
>> > challenges
>> > > with the 0.8.x line of Docker images from
>> > > https://hub.docker.com/r/apache/zeppelin.
>> > >
>> > > I did modify the ./scripts/docker/zeppelin/Dockerfile to load the
>> > > v0.0.0-preview1-rc1.bin.tgz distribution.
>> > >
>> > > Then I followed the steps in docs/setup/deployment/docker.md to try
>> out
>> > > Zeppelin and it all appears to work as a Docker image!
>> > >
>> > > One thing to note was that it didn’t auto upgrade my old .json files
>> into
>> > > the new .zpln files.  I had to manually upload them.  Is there any
>> auto
>> > > upgrade feature for existing notebook files?
>> > >
>> > > So non binding +1 ;-)
>> > >
>> > > Eric
>> > >
>> > >
>> > >
>> > > On Mar 25, 2020, at 1:54 AM, Jongyoul Lee  wrote:
>> > >
>> > > +1
>> > >
>> > > 2020년 3월 24일 (화) 오전 12:15, Jeff Zhang 님이 작성:
>> > >
>> > >> Hi folks,
>> > >>
>> > >> I propose the following RC to be released for the Apache Zeppelin
>> > >> 0.9.0-preview1 release.
>> > >>
>> > >>
>> > >> The commit id is a74365c0813b451db1bc78def7d1ad1279429224 :
>> > >>
>> > >>
>> >
>> https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=commit;h=a74365c0813b451db1bc78def7d1ad1279429224
>> > >>
>> > >> This corresponds to the tag: v0.9.0-preview1-rc1 :
>> > >>
>> > >>
>> >
>> https://gitbox.apache.org/repos/asf?p=zeppelin.git;a=shortlog;h=refs/tags/v0.9.0-preview1-rc1
>> > >>
>> > >> The release archives (tgz), signature, and checksums are here
>> > >>
>> > >>
>> >
>> https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.9.0-preview1-rc1/
>> > >>
>> > >> The release candidate consists of the following source distribution
>> > >> archive
>> > >> zeppelin-v0.9.0-preview1.tgz
>> > >>
>> > >> In addition, the following supplementary binary distributions are
>> > provided
>> > >> for user convenience at the same location
>> > >> zeppelin-0.9.0-preview1-bin-all.tgz
>> > >>
>> > >>
>> > >> The maven artifacts are here
>> > >>
>> > >>
>> >
>> https://repository.apache.org/content/repositories/orgapachezeppelin-1276/org/apache/zeppelin/
>> > >>
>> > >> You can find the KEYS file here:
>> > >> https://dist.apache.org/repos/dist/release/zeppelin/KEYS
>> > >>
>> > >> Release notes available at
>> > >>
>> > >>
>> >
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?version=12342692==12316221
>> > >>
>> > >> Vote will be open for next 72 hours (close at 7am 26/March PDT).
>> > >>
>> > >> [ ] +1 approve
>> > >> [ ] 0 no opinion
>> > >> [ ] -1 disapprove (and reason why)
>> > >>
>> > >>
>> > >> --
>> > >> Best Regards
>> > >>
>> > >> Jeff Zhang
>> > >>
>> > >
>> > >
>> > > --
>> > > 이종열, Jongyoul Lee, 李宗烈
>> > > http://madeng.net
>> > >
>> > >
>> > > ___
>> > > *Eric Pugh **| *Founder & CEO | OpenSource Connections, LLC |
>> > 434.466.1467
>> > > | http://www.opensourceconnections.com | My Free/Busy
>> > > 
>> > > Co-Author: Apache Solr Enterprise Search Server, 3rd Ed
>> > > <
>> >
>> https://www.packtpub.com/big-data-and-business-intelligence/apache-solr-enterprise-search-server-third-edition-raw
>> > >
>> > > This e-mail and all contents, including attachments, is considered to
>> be
>> > > Company Confidential unless explicitly stated otherwise, regardless
>> > > of whether attachments are marked as such.
>> > >
>> > >
>> >
>> > --
>> >
>> > Warm Regards,
>> >
>> > Prabhjyot Singh
>> >
>>
>

Re: OpenAM LDAP integration with Zeppelin

[Khalid Huseynov]

Hi,

Which shiro realm did you use for integration? have you tried LdapGroupReal
or ActiveDirectoryGroupReal?



On Sun, Oct 29, 2017 at 9:13 PM, Jongyoul Lee  wrote:

> Hi,
>
> I'm not an expert of LDAP and Shiro, AFAIK, currently, Shiro doesn't
> support group-related things on LDAP.
>
> I knew a reference to use LDAP in Zeppelin by setting all groups manually.
>
> Hope this help,
> Jongyoul Lee
>
> On Tue, Oct 17, 2017 at 5:13 PM, Suresh Ayyavoo 
> wrote:
>
>> Hi All,
>>
>> Who have integrated OpenAM LDAP with Zeppelin0.7.2?
>> The group are not honoured in zeppelin roles?Any idea?
>>
>> LoginRestApi.java[postLogin]:115) - {"status":"OK","message":"","b
>> ody":{"principal":"admin","ticket":"81e0db18-a10a-454f-a9b1-
>> c9fa41abc877","roles":"[]"}}
>>
>> --
>>
>> Suresh Ayyavoo
>>
>> Solution Architect / R Lead
>>
>> iAPPS Pte. Ltd.
>>
>> 3 Fusionopolis Way
>> ,
>> Symbiosis #13-25 S(138633)
>>
>> [O] 64631795   [F] 6778 5300 [M] 91540224
>>
>> Website: www.iappsasia.com
>>
>> Facebook: www.facebook.com/iappsasia
>>
>> Youtube: www.youtube.com/user/iAPPSasia
>>
>
>
>
> --
> 이종열, Jongyoul Lee, 李宗烈
> http://madeng.net
>

Re: Zeppelin notebook.repo.GitNotebookRepo

[Khalid Huseynov]

right, S3 doesn't support versioning at the moment. Thanks for opening the
issue to support remote git repo, I'll comment on issue for more details.

On Fri, Jul 21, 2017 at 6:55 AM, Richard Xin <richardxin...@yahoo.com>
wrote:

> ok, I don't think Zeppelin supports remote git repo, I have filed a Jira
> request to put to the wish list, hope it gets fixed soon ZEPPELIN-2802
> <https://issues.apache.org/jira/browse/ZEPPELIN-2802>.
>
>
> Thanks,
> -Richard
>
>
>
>
> On Thursday, July 20, 2017, 11:28:41 AM PDT, Richard Xin <
> richardxin...@yahoo.com> wrote:
>
>
> Khalid, thanks for the reply.
> the problem I am facing is we could use either local git or S3 without git
> support. Any idea how I could get version control on S3?
>
> if I change storage to S3, I can't use version control.
>
> -Richard
>
> On Thursday, July 20, 2017, 12:39:05 AM PDT, Khalid Huseynov <
> kha...@apache.org> wrote:
>
>
> Hi Richard,
>
> Actually that setting is only for local storage that allows git/revision
> related actions (e.g. commit, change revision). There's a separate setting
> for S3 though, you can find details in here
> <https://zeppelin.apache.org/docs/0.7.2/storage/storage.html#notebook-storage-in-s3>
> .
>
> On Thu, Jul 20, 2017 at 9:47 AM, Richard Xin <richardxin...@yahoo.com>
> wrote:
>
> for newly installed Zeppelin (0.7.2), I renamed zeppelin-site.xml.template
> to zeppelin-site.xml, and restart zeppelin, zeppelin-site.xml already have
> the following enabled:
>
> 
>   zeppelin.notebook. storage
>   org.apache.zeppelin. notebook.repo.GitNotebookRepo< /value>
>   versioned notebook persistence layer
> implementation
> 
>
> looks like local git repo is enabled, can this be point to remote git
> repo? such as github.com or even S3 will be great.
> Thanks,
> Richard
>
>
>

Re: [DISCUSS] Release 0.8.0

[Khalid Huseynov]

Thanks for starting discussion on 0.8.0 release. I also think that need to
concentrate on solving the issues blocking release and link the issues
community considers important for it under the umbrella issue you
mentioned.

Further regarding stable and latest release, here's one example how it
looks like in redis for instance https://redis.io/download



On Mon, Jul 17, 2017 at 3:11 AM, Park Hoon <1am...@gmail.com> wrote:

> Hi, @user and @dev.
>
> Recently, The last major release was about 5 months ago and many new
> features bug fixes have been implemented / applied for few months.
>
> Even though all features discussed in the thread before (“Roadmap for
> 0.8.0”[1]), some are available now.
>
> So I think we can release 0.8.0 as the latest one while keeping 0.7.2 as
> the most stable one as @moon suggested in the “Roadmap for 0.8.0” mailing
> thread.
>
> Shall we proceed to 0.8.0?
>
> Here is the umbrella issue for the release 0.8.0. If you have issues to be
> shared, Please add them to the ticket.
>
> - https://issues.apache.org/jira/browse/ZEPPELIN-2385
>
> [1]
> https://lists.apache.org/thread.html/f4be5635e6e72d2a9dc23771ceeaef
> 8a8e5933bfb14db7cab303bc22@%3Cdev.zeppelin.apache.org%3E
>
> Regard,
>

Re: Zeppelin notebook.repo.GitNotebookRepo

[Khalid Huseynov]

Hi Richard,

Actually that setting is only for local storage that allows git/revision
related actions (e.g. commit, change revision). There's a separate setting
for S3 though, you can find details in here

.

On Thu, Jul 20, 2017 at 9:47 AM, Richard Xin 
wrote:

> for newly installed Zeppelin (0.7.2), I renamed zeppelin-site.xml.template
> to zeppelin-site.xml, and restart zeppelin, zeppelin-site.xml already have
> the following enabled:
>
> 
>   zeppelin.notebook.storage
>   org.apache.zeppelin.notebook.repo.GitNotebookRepo
>   versioned notebook persistence layer
> implementation
> 
>
> looks like local git repo is enabled, can this be point to remote git
> repo? such as github.com or even S3 will be great.
> Thanks,
> Richard
>

Re: Zeppelin OAuth

[Khalid Huseynov]

Hi,

AFAIK there was PR for supporting openid with shiro through buji-pac4j
library in https://github.com/apache/zeppelin/pull/2373. This page
https://github.com/bujiio/buji-pac4j contains some config examples for
shiro, so possibly you could use it as a reference. For example the case of
"googleOidClient" would fit for your case I believe.

On Wed, Jul 12, 2017 at 4:07 AM, Ben Vogan  wrote:

> Hi all,
>
> Does anyone have instructions on how to configure Zeppelin for OAuth (I'm
> trying to use Google)?
>
> Failing that, I can put Zeppelin behind an OAuth proxy, but would then
> need a Shiro component that would take the user identity out of the request
> headers and log the user in.  Has anyone done something like this?
>
> Thanks,
> --
> *BENJAMIN VOGAN* | Data Platform Team Lead
>
> 
>  
>  
> 
>

Re: Are there any way a notebook to be black box?

[Khalid Huseynov]

Hello Ono,

Thanks for reporting your use case scenario and it's indeed valid that
users would like to share their notes across Zeppelin instances with their
original permissions. It definitely deserves an issue and should be handled
toward maturity of Zeppelin (e.g. in v. 0.9~1.0). Possible solutions could
be including permission info inside of note, or some hash identifying the
original creator. Also as you mentioned, some of scenarios possibly could
be handled in zepl.com.

On Wed, Jul 5, 2017 at 1:36 PM, Hyung Sung Shim  wrote:

> Thank you very much to describe in detail.
> I totally understand your question now.
> There is no way to solve your question for now but it's really interesting
> issue.
> so Could you make a Jira issue for this with your experience?
> Thanks!
>
> 2017-07-05 10:16 GMT+09:00 小野圭二 :
>
>> Thx for your reply, Hyung.
>>
>> Thank you for introducing some docs, but i knew them already.And my point
>> was each notebook execute but hide/invisible the code.
>> The zeppelin auth system manage every notebooks at once. That feature
>> effect in the case of all user share same zeppelin system, like cloud
>> computing.
>>
>> Against it, how about in the case of just sharing notebook?
>> For example i set strict roles  into my notebook, and share it with
>> someone who has their zeppelin. After they download and import my strict
>> auth notebook into their zeppelin, they can arrange my roles setting by
>> themselves. In this case, they can see my hided code on their zeppelin.
>>
>> I do not misunderstand about the zeppelin auth system, do i ?
>>
>> To prevent this issue, may need another authenticate/management feature
>> on Zeppelin, this is my point. :^)
>>
>> What for it, imagine such a case.
>> In the case of selling my big data analyze application through zeppelin
>> eco-system, i write and test my code on my zeppelin. Then export it and
>> upload to sharing site.
>> May someone see my sharing notebook on the site, then they download and
>> import it into their zeppelin, and execute it,
>>
>> Ok that is good, fantastic, viva Zeppelin, if i am a volunteer programmer.
>>
>> But i would like to get some revenue from my code if someone go down my
>> analyzing, hopefully.
>> In this case, i just want to provide the result of analyzing, not my
>> algorithm.
>> Even my client share my notebook on his zeppelin, my code is protected by
>> independent authentication, encryption and so on.
>>
>> This is my point. :-)
>> Sorry for getting longer.
>>
>> -Ono
>>
>>
>> 2017-07-04 23:35 GMT+09:00 Hyung Sung Shim :
>>
>>> Hello onokeiji.
>>>
>>> You can refer http://zeppelin.apache.org/docs/0.7.2/quickstart/explo
>>> rezeppelinui.html#note-toolbar if you want to hide code in the notebook.
>>> and http://zeppelin.apache.org/docs/0.7.2/security/notebook_
>>> authorization.html#authorization-setting is relate to lock code your
>>> note.
>>>
>>> Hope this helps.
>>>
>>>
>>> 2017-07-04 22:05 GMT+09:00 小野圭二 :
>>>
 Hey, how do you think about my idea of BLACKBOX-NOTEBOOK?

 -Ono.


 
  ウイルス
 フリー｡ www.avast.com
 
 <#m_7229949389285741499_m_-8962903669315512691_m_3961825290808015369_m_-7798815867934407536_DAB4FAD8-2DD7-40BB-A1B8-4E2AA1F9FDF2>

 2017-06-30 10:38 GMT+09:00 小野圭二 :

> Hi,
>
> I wonder if this mail title would be realize.
> I mean, when I do not want to be changed my notebook programing code,
> but just give a way to change the query of programing by dynamic forms.
>
> 1. are there way to hide all code in the notebook?
> 2. are there rock system to prevent changing the code in notebook?
>
> If No.1 would be available, it makes easy to provide commercial codes
> and/or secret codes to widely.
> In fact, from the view of code writers, especially in the case of
> commercial products, they do not want to provide any source code to their
> customers definitely. Another hand, it is costly to force R or Python
> programer to write Java or Scala program to change their naked codes to
> binary code.
>
> I have a image Script programers write and test their
> R/Python/Spark-Shell/SQL codes on notebooks and be it to
> BLACKBOX-NOTEBOOK, then upload it to github/svn where endusers who 
> want
> to use those notebooks could access by themselves. The endusers down load
> those BLACKBOX-NOTEBOOK and import into their Zeppelin and it works fine.
> Sound like happy the both.
>
> No.2 seems like easier than No.1, because the issue is depend on
> authorization. But it is incomplete, because the codes reveal to the
> endusers.
>
> I saw zepl.com as well.

Re: [DISCUSSION] Extending TableData API

[Khalid Huseynov]

Thanks for the questions guys!

@Jun Kim actually that feature was originally discussed and was put into
backlog since proposal was more about tables processed by interpreters and
their sharing. However having quick visualisation on the fly for not so
large data makes sense indeed, and possibly could be done by importing data
into some interpreter by default (Spark, python, etc). So I believe it can
be done once initial basics for resource sharing is completed.

@Andrea Santurbano there should be listing of tables with schema info, but
i'm not sure exactly what you mean by drop-down feature between tables in
the UI. Could you give little more details/example on that as well as
 enhancements on graph part you meant?


On Mon, Jun 12, 2017 at 4:01 PM, Andrea Santurbano 
wrote:

> Hi guys,
> this is great! I think this can also enable some drop-down feature between
> tables in the UI...
> Do you think this enhancements can also include the graph part?
>
> Andrea
>
> Il giorno lun 12 giu 2017 alle ore 05:47 Jun Kim  ha
> scritto:
>
>> All of the enhancements looks great to me!
>>
>> And I wish a feature which can upload a small CSV file (maybe about
>> 20MB..?) and play with it directly.
>> It would be great if I can drag a file to Zeppelin and register it as the
>> table.
>>
>> Thanks :)
>>
>> 2017년 6월 12일 (월) 오전 11:40, Park Hoon <1am...@gmail.com>님이 작성:
>>
>>> Hi All,
>>>
>>> Recently, ZEPPELIN-753
>>>  (Tabledata
>>> abstraction) and ZEPPELIN-2020
>>>  (Remote method
>>> invocation for resources) were resolved.
>>> Based on this work, we can improve Zeppelin with the following
>>> enhancements:
>>>
>>> * register the table result as a shared resource
>>> * list all available (registered) tables
>>> * preview tables including its meta information (e.g columns, types, ..)
>>> * download registered tables as CSV, and other formats.
>>> * pivoting/filtering in backend to transforming larger data
>>> * cross join tables in different interpreters (e.g Spark interpreter
>>> uses a table result generated from JDBC interpreter)
>>>
>>> You can find the full proposal in Extending Table Data API
>>> 
>>>  which
>>> is contributed by @1ambda, @khalidhuseynov, @Leemoonsoo.
>>>
>>> Any question, feedback or discussion will be welcomed.
>>>
>>>
>>> Thanks.
>>>
>> --
>> Taejun Kim
>>
>> Data Mining Lab.
>> School of Electrical and Computer Engineering
>> University of Seoul
>>
>

Re: Getting 401 With secure websockets on AWS

[Khalid Huseynov]

Hi Michael,

Which version of Zeppelin are you using?

On Sat, Apr 22, 2017 at 3:10 AM, Knapp, Michael <
michael.kn...@capitalone.com> wrote:

> Hi,
>
>
>
> I am getting a 401, unauthorized, with all secure (and non-secure)
> websocket calls while running on AWS.  I have configured the server
> properly to use a signed certificate, I have tested and all HTTPS calls are
> successful.  I also have LDAP working.  Still, the websocket calls are all
> failing.
>
>
>
> I have a security group setup, it allows inbound TCP traffic over port 443
> from all sources (0.0.0.0/0).  I believe that alone should have been
> adequate.
>
>
>
> I set JAVA_OPTS=’-Djavax.net.debug=all’ and watched the standard output.
> Every time the websockets attempt to connect, I see these printed to
> standard out:
>
>
>
> qtp1622006612-39, called closeInbound()
>
> qtp1622006612-39, fatal error: 80: Inbound closed before receiving peer's
> close_notify: possible truncation attack?
>
> javax.net.ssl.SSLException: Inbound closed before receiving peer's
> close_notify: possible truncation attack?
>
> %% Invalidated:  [Session-50, TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256]
>
> qtp1622006612-39, SEND TLSv1.2 ALERT:  fatal, description = internal_error
>
> qtp1622006612-39, WRITE: TLSv1.2 Alert, length = 2
>
>
>
> Nothing is written the the log file when these websocket requests fail.
>
>
>
> Can somebody please tell me why this is still not working?
>
>
>
> Michael Knapp
>
> --
>
> The information contained in this e-mail is confidential and/or
> proprietary to Capital One and/or its affiliates and may only be used
> solely in performance of work or services for Capital One. The information
> transmitted herewith is intended only for use by the individual or entity
> to which it is addressed. If the reader of this message is not the intended
> recipient, you are hereby notified that any review, retransmission,
> dissemination, distribution, copying or other use of, or taking of any
> action in reliance upon this information is strictly prohibited. If you
> have received this communication in error, please contact the sender and
> delete the material from your computer.
>

Re: [ANNOUNCE] Apache Zeppelin 0.7.0 released

[Khalid Huseynov]

Congratulations and thanks Mina and all community for effort!

On Mon, Feb 6, 2017 at 9:40 PM, DuyHai Doan  wrote:

> Congratulations for the team, great release!
>
> On Mon, Feb 6, 2017 at 1:34 PM, Vinay Shukla 
> wrote:
>
>> Congratulations Zeppelin users, contributors and committers.
>>
>> This is a great milestone.
>>
>> Before the dust settles on 0.7.0, let's put together our heads together
>> to define features for the next release.
>>
>>
>>
>> On Mon, Feb 6, 2017 at 7:00 AM, Hyung Sung Shim 
>> wrote:
>>
>>> Congratulations!
>>> and Thank you all Zeppelin users and devs!!
>>> 2017년 2월 6일 (월) 오후 8:48, Md. Rezaul Karim 님이 작성:
>>>
 Congratulations! Thanks for the great news. I appreciate your hard work
 for every release.

 On Feb 6, 2017 7:07 AM, Mina Lee  wrote:

 The Apache Zeppelin community is pleased to announce the availability of
 the 0.7.0 release.

 Zeppelin is a collaborative data analytics and visualization tool for
 distributed, general-purpose data processing system such as Apache
 Spark,
 Apache Flink, etc.

 The community put significant effort into improving Apache Zeppelin
 since
 the last release, focusing on multi-user support, pluggable
 visualization,
 better interpreter support. More than 100+ contributors provided 700+
 patches
 for new features, improvements and bug fixes. More than 480+ issues have
 been resolved.

 We encourage you to download the latest release from
 http://zeppelin.apache.org/download.html

 Release note is available at
 http://zeppelin.apache.org/releases/zeppelin-release-0.7.0.html

 We welcome your help and feedback. For more information on the project
 and
 how to get involved, visit our website at http://zeppelin.apache.org/

 Thank you all users and contributors who have helped to improve Apache
 Zeppelin.

 Regards,
 The Apache Zeppelin community



>>
>

Re: [VOTE] Release Apache Zeppelin 0.7.0 (RC4)

[Khalid Huseynov]

+1

On Thu, Feb 2, 2017 at 9:21 PM, DuyHai Doan  wrote:

> +1
>
> On Thu, Feb 2, 2017 at 9:56 AM, Mina Lee  wrote:
>
> > I propose the following RC to be released for the Apache Zeppelin 0.7.0
> > release.
> >
> > The commit id is df007f2284a09caa7c8b35f8b59d5f1993fe8b64 which is
> > corresponds to the tag v0.7.0-rc4:
> > *https://git-wip-us.apache.org/repos/asf?p=zeppelin.git;
> a=shortlog;h=refs/tags/v0.7.0-rc4
> >  a=shortlog;h=refs/tags/v0.7.0-rc4>*
> >
> > The release archives (tgz), signature, and checksums are here
> > https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.7.0-rc4/
> >
> > The release candidate consists of the following source distribution
> > archive
> > zeppelin-0.7.0.tgz
> >
> > In addition, the following supplementary binary distributions are
> provided
> > for user convenience at the same location
> > zeppelin-0.7.0-bin-all.tgz
> > zeppelin-0.7.0-bin-netinst.tgz
> >
> > The maven artifacts are here
> > https://repository.apache.org/content/repositories/
> orgapachezeppelin-1027
> >
> > You can find the KEYS file here:
> > https://dist.apache.org/repos/dist/release/zeppelin/KEYS
> >
> > Release notes available at
> > https://issues.apache.org/jira/secure/ReleaseNote.jspa?
> > version=12336544=12316221
> >
> > Vote will be open for next 72 hours (close at 01:00 5/Feb PST).
> >
> > [ ] +1 approve
> > [ ] 0 no opinion
> > [ ] -1 disapprove (and reason why)
> >
>

Re: [VOTE] Release Apache Zeppelin 0.7.0 (RC2)

[Khalid Huseynov]

I've just tried and was running fine when changing age field in report
mode. However didn't run on change of marital status neither in report nor
in default mode. Hopefully more people could verify it. Also as far as i
know mentioned log isn't related to run feature.

On Sun, Jan 22, 2017 at 1:46 PM, Vinay Shukla  wrote:

> Downloaded
> https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.7.0-rc2/
>
> Then ran Basic Feature tutorial successfully and went to *report* mode and
> it does not re-run the paragraph when the marital or age field value is
> changed (even after shift +  enter)
>
>
> INFO [2017-01-22 13:36:21,924] ({qtp1622006612-76}
> NotebookServer.java[sendNote]:704) - New operation from 0:0:0:0:0:0:0:1 :
> 62990 : anonymous : GET_NOTE : 2A94M5J1Z
>
>  WARN [2017-01-22 13:36:21,926] ({qtp1622006612-76}
> GitNotebookRepo.java[revisionHistory]:157) - No Head found for 2A94M5J1Z,
> No HEAD exists and no explicit starting revision was specified
>
>  INFO [2017-01-22 13:36:26,223] ({qtp1622006612-14}
> NotebookServer.java[sendNote]:704) - New operation from 0:0:0:0:0:0:0:1 :
> 62990 : anonymous : GET_NOTE : 2A94M5J1Z
>
>  WARN [2017-01-22 13:36:26,224] ({qtp1622006612-14}
> GitNotebookRepo.java[revisionHistory]:157) - No Head found for 2A94M5J1Z,
> No HEAD exists and no explicit starting revision was specified
>
> Did anyone else try this?
>
> On Sun, Jan 22, 2017 at 2:04 AM, Hyung Sung Shim 
> wrote:
>
> > +1
> > 2017년 1월 22일 (일) 오전 12:54, Ahyoung Ryu 님이 작성:
> >
> >> +1
> >>
> >> On Sun, Jan 22, 2017 at 5:52 PM, Jeff Zhang  wrote:
> >>
> >> > +1
> >> >
> >> >
> >> >
> >> > DuyHai Doan 于2017年1月22日周日 下午4:01写道：
> >> >
> >> >> +1
> >> >>
> >> >> On Sun, Jan 22, 2017 at 8:59 AM, Mina Lee 
> wrote:
> >> >>
> >> >> I propose the following RC to be released for the Apache Zeppelin
> 0.7.0
> >> >> release.
> >> >>
> >> >> The commit id is d0ddf8fdff75b4229543f7ebfd5eb001f685382d which is
> >> >> corresponds to the tag v0.7.0-rc2:
> >> >> *https://git-wip-us.apache.org/repos/asf?p=zeppelin.git;a=commit;h=
> >> d0ddf8fdff75b4229543f7ebfd5eb001f685382d
> >> >>  >> d0ddf8fdff75b4229543f7ebfd5eb001f685382d>*
> >> >>
> >> >> The release archives (tgz), signature, and checksums are here
> >> >> https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.7.0-rc2/
> >> >>
> >> >> The release candidate consists of the following source distribution
> >> >> archive
> >> >> zeppelin-0.7.0.tgz
> >> >>
> >> >> In addition, the following supplementary binary distributions are
> >> provided
> >> >> for user convenience at the same location
> >> >> zeppelin-0.7.0-bin-all.tgz
> >> >> zeppelin-0.7.0-bin-netinst.tgz
> >> >>
> >> >> The maven artifacts are here
> >> >> https://repository.apache.org/content/repositories/
> >> orgapachezeppelin-1023
> >> >>
> >> >> You can find the KEYS file here:
> >> >> https://dist.apache.org/repos/dist/release/zeppelin/KEYS
> >> >>
> >> >> Release notes available at
> >> >> https://issues.apache.org/jira/secure/ReleaseNote.jspa?
> >> >> version=12336544=12316221
> >> >>
> >> >> Vote will be open for next 72 hours (close at 23:59 24/Jan PST).
> >> >>
> >> >> [ ] +1 approve
> >> >> [ ] 0 no opinion
> >> >> [ ] -1 disapprove (and reason why)
> >> >>
> >> >>
> >> >>
> >>
> >
>

Re: 'File size limit Exceeded' when importing notes - even for small files

[Khalid Huseynov]

As far as I know there's environment variable
ZEPPELIN_WEBSOCKET_MAX_TEXT_MESSAGE_SIZE for
that, which by default set to 1024000 characters/bytes ~ 1MB. So I believe
it should be configurable, although default value could be increased.

On Tue, Jan 17, 2017 at 10:54 AM, Ruslan Dautkhanov 
wrote:

> 'File size limit Exceeded' when importing notes - even for small files
>
> This happens even for tiny files - a few Kb.
>
> Is this a known issue?
>
> Running Zeppelin 0.7.0 from a few weeks old snapshot.
>
> See attached screenshot.
>
>
> --
> Ruslan Dautkhanov
>

Re: 0.7 Shiro LDAP authentication changes? Unable to instantiate class [org.apache.zeppelin.server.LdapGroupRealm]

[Khalid Huseynov]

I think during refactoring LdapGroupRealm has moved into different package,
so could you try in your shiro config with:

ldapRealm = org.apache.zeppelin.realm.LdapGroupRealm

On Tue, Nov 29, 2016 at 2:33 AM, Ruslan Dautkhanov 
wrote:

> + dev list
>
> Could somebody please let me know if shiro-LDAP is known to be broken in
> master?
> So I will stop my attempts to work with 0.7.
>
> [org.apache.zeppelin.server.LdapGroupRealm] for object named
> 'ldapRealm'.  Please ensure you've specified the fully qualified class name
> correctly.
> at org.apache.shiro.config.ReflectionBuilder.createNewInstance(
> ReflectionBuilder.java:151)
> at org.apache.shiro.config.ReflectionBuilder.buildObjects(Refle
> ctionBuilder.java:119)
> at org.apache.shiro.config.IniSecurityManagerFactory.buildInsta
> nces(IniSecurityManagerFactory.java:161)
>
>
> Thanks,
> Ruslan
>
>
> On Mon, Nov 28, 2016 at 9:13 AM, Ruslan Dautkhanov 
> wrote:
>
>> Looking at 0.7 docs, Shiro LDAP authentication shiro.ini configuration
>> looks the same.
>> http://zeppelin.apache.org/docs/0.7.0-SNAPSHOT/security/shir
>> oauthentication.html
>>
>> Any ideas why this might be broken in the current snapshot?
>>
>> Exception in thread "main" org.apache.shiro.config.ConfigurationException:
>> Unable to instantiate class [org.apache.zeppelin.server.LdapGroupRealm]
>> for object named 'ldapRealm'.  Please ensure you've specified the fully
>> qualified class name correctly.
>> at org.apache.shiro.config.ReflectionBuilder.createNewInstance(
>> ReflectionBuilder.java:151)
>> at org.apache.shiro.config.ReflectionBuilder.buildObjects(Refle
>> ctionBuilder.java:119)
>> at org.apache.shiro.config.IniSecurityManagerFactory.buildInsta
>> nces(IniSecurityManagerFactory.java:161)
>>
>>
>>
>> --
>> Ruslan Dautkhanov
>>
>> On Mon, Nov 28, 2016 at 8:23 AM, Ruslan Dautkhanov 
>> wrote:
>>
>>> Zeppelin 0.7.0 built from yesterday's snapshot.
>>> Getting below error stack when trying to start Zeppelin 0.7.0.
>>> The same shiro config works fine in 0.6.2.
>>>
>>> We're using LDAP authentication configured in shiro.ini as
>>> ldapRealm = org.apache.zeppelin.server.LdapGroupRealm
>>> ldapRealm.contextFactory.environment[ldap.searchBase] = ...
>>> ldapRealm.contextFactory.url = ...
>>> ldapRealm.contextFactory.authenticationMechanism = SIMPLE
>>> ..
>>>
>>> This config works fine in 0.6.2.
>>> Is org.apache.zeppelin.server.LdapGroupRealm has to be changed in 0.7
>>> to something else?
>>> Or there are other significant changes in Shiro / LDAP authentication?
>>>
>>>
>>>
>>> [1]
>>>
>>> $ ./zeppelin.sh
>>> ...
>>> Exception in thread "main" org.apache.shiro.config.ConfigurationException:
>>> Unable to instantiate class [org.apache.zeppelin.server.LdapGroupRealm]
>>> for object named 'ldapRealm'.  Please ensure you've specified the fully
>>> qualified class name correctly.
>>> at org.apache.shiro.config.ReflectionBuilder.createNewInstance(
>>> ReflectionBuilder.java:151)
>>> at org.apache.shiro.config.ReflectionBuilder.buildObjects(Refle
>>> ctionBuilder.java:119)
>>> at org.apache.shiro.config.IniSecurityManagerFactory.buildInsta
>>> nces(IniSecurityManagerFactory.java:161)
>>> at org.apache.shiro.config.IniSecurityManagerFactory.createSecu
>>> rityManager(IniSecurityManagerFactory.java:124)
>>> at org.apache.shiro.config.IniSecurityManagerFactory.createSecu
>>> rityManager(IniSecurityManagerFactory.java:102)
>>> at org.apache.shiro.config.IniSecurityManagerFactory.createInst
>>> ance(IniSecurityManagerFactory.java:88)
>>> at org.apache.shiro.config.IniSecurityManagerFactory.createInst
>>> ance(IniSecurityManagerFactory.java:46)
>>> at org.apache.shiro.config.IniFactorySupport.createInstance(Ini
>>> FactorySupport.java:123)
>>> at org.apache.shiro.util.AbstractFactory.getInstance(AbstractFa
>>> ctory.java:47)
>>> at org.apache.zeppelin.utils.SecurityUtils.initSecurityManager(
>>> SecurityUtils.java:56)
>>> at org.apache.zeppelin.server.ZeppelinServer.setupRestApiContex
>>> tHandler(ZeppelinServer.java:268)
>>> at org.apache.zeppelin.server.ZeppelinServer.main(ZeppelinServe
>>> r.java:137)
>>> Caused by: org.apache.shiro.util.UnknownClassException: Unable to load
>>> class named [org.apache.zeppelin.server.LdapGroupRealm] from the thread
>>> context, current, or system/application ClassLoaders.  All heuristics have
>>> been exhausted.  Class could not be found.
>>> at org.apache.shiro.util.ClassUtils.forName(ClassUtils.java:148)
>>> at org.apache.shiro.util.ClassUtils.newInstance(ClassUtils.java
>>> :164)
>>> at org.apache.shiro.config.ReflectionBuilder.createNewInstance(
>>> ReflectionBuilder.java:144)
>>> ... 11 more
>>>
>>>
>>
>

Re: Authenticate 1 user per notebook

[Khalid Huseynov]

Regarding the latter message on invalid token. That stacktrace possible
when someone logs out from Zeppelin but keeps the window open in browser.
Then it keeps sending websocket ping messages with invalid ticket which
errors in Zeppelin.

On Thu, Sep 8, 2016 at 11:06 AM, Polina Marasanova <
polina.marasan...@quantium.com.au> wrote:

> One more thing. In Zeppelin logs there are many messages like this:
>
> 16/09/08 02:03:46 DEBUG NotebookServer: RECEIVE << PING
> 16/09/08 02:03:46 DEBUG NotebookServer: RECEIVE PRINCIPAL <<
> 16/09/08 02:03:46 DEBUG NotebookServer: RECEIVE TICKET <<
> 16/09/08 02:03:46 DEBUG NotebookServer: RECEIVE ROLES <<
> 16/09/08 02:03:46 ERROR NotebookServer: Can't handle message
> java.lang.Exception: Invalid ticket  != f2810e7a-de64-4e41-b615-
> f31cd5bf7d68
> at org.apache.zeppelin.socket.NotebookServer.onMessage(
> NotebookServer.java:117)
> at org.apache.zeppelin.socket.NotebookSocket.onWebSocketText(
> NotebookSocket.java:56)
> at org.eclipse.jetty.websocket.common.events.
> JettyListenerEventDriver.onTextMessage(JettyListenerEventDriver.java:128)
> at org.eclipse.jetty.websocket.common.message.SimpleTextMessage.
> messageComplete(SimpleTextMessage.java:69)
> at org.eclipse.jetty.websocket.common.events.AbstractEventDriver.
> appendMessage(AbstractEventDriver.java:65)
> at org.eclipse.jetty.websocket.common.events.
> JettyListenerEventDriver.onTextFrame(JettyListenerEventDriver.java:122)
> at org.eclipse.jetty.websocket.common.events.AbstractEventDriver.
> incomingFrame(AbstractEventDriver.java:161)
> at org.eclipse.jetty.websocket.common.WebSocketSession.
> incomingFrame(WebSocketSession.java:309)
> at org.eclipse.jetty.websocket.common.extensions.
> ExtensionStack.incomingFrame(ExtensionStack.java:214)
> at org.eclipse.jetty.websocket.common.Parser.notifyFrame(
> Parser.java:220)
> at org.eclipse.jetty.websocket.common.Parser.parse(Parser.
> java:258)
> at org.eclipse.jetty.websocket.common.io.
> AbstractWebSocketConnection.readParse(AbstractWebSocketConnection.
> java:632)
> at org.eclipse.jetty.websocket.common.io.
> AbstractWebSocketConnection.onFillable(AbstractWebSocketConnection.
> java:480)
> at org.eclipse.jetty.io.AbstractConnection$2.run(
> AbstractConnection.java:544)
> at org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(
> QueuedThreadPool.java:635)
>
> Looks like it's related to auth process.
> 
> From: Polina Marasanova [polina.marasan...@quantium.com.au]
> Sent: Wednesday, 17 August 2016 10:48 AM
> To: users@zeppelin.apache.org
> Subject: Authenticate 1 user per notebook
>
> Hi everyone,
>
> I'm back with my authentication questions. Here is my shiro.ini config
> file. The problem is that it lets in all users from search base
> "OU=Users,DC=companyname,DC=local"
> How can I restrict the access to only one user who owns a notebook? The
> process zeppelin-daemon.sh is running by this user
>
> [main]
> activeDirectoryRealm = org.apache.zeppelin.server.
> ActiveDirectoryGroupRealm
> activeDirectoryRealm.systemUsername = userNameA
> activeDirectoryRealm.systemPassword = passwordA
> activeDirectoryRealm.searchBase = "OU=Users,DC=companyname,DC=local"
> activeDirectoryRealm.principalSuffix = @companyname.local
> activeDirectoryRealm.url = ldap://ldapserver.companyname.local:389
> activeDirectoryRealm.groupRolesMap = "OU=Users,DC=companyname,DC=
> local":"admin"
> activeDirectoryRealm.authorizationCachingEnabled = false
> securityManager.realms = $activeDirectoryRealm
>
> sessionManager = org.apache.shiro.web.session.mgt.DefaultWebSessionManager
>
> securityManager.sessionManager = $sessionManager
> securityManager.sessionManager.globalSessionTimeout = 8640
> shiro.loginUrl = /api/login
>
> [roles]
> admin = *
>
> [urls]
> /** = authc
>
>
> Thanks
> Cheers
> Polina
>

Re: integrate authorization

[Khalid Huseynov]

As i checked once again, you can just implement your own class that extends
AuthorizingRealm of Shiro.

doGetAuthenticationInfo - for authentication
doGetAuthorizationInfo - for authorization

you can use https://github.com/apache/zeppelin/pull/1173 as an example

Best,
Khalid.

On Thu, Jul 21, 2016 at 3:15 PM, Abhisar Mohapatra <
abhisar.mohapa...@inmobi.com> wrote:

> Yes it can be done. Using shiro not only allows you for basic
> authentication but along with ldap also it works.If u can create a ldap
> wrapper then I think you can integrate authentication system.
>
> On Thu, Jul 21, 2016 at 10:42 AM, Khalid Huseynov <khalid...@nflabs.com>
> wrote:
>
>> Yes, I believe main point of #1173
>> <https://github.com/apache/zeppelin/pull/1173> is to have authentication
>> using remote web server. It can be basically generalized to support what
>> you're talking about. You may review that PR as well for more details.
>>
>> On Wed, Jul 20, 2016 at 10:37 PM, Corneau Damien <cornead...@gmail.com>
>> wrote:
>>
>>> Hi,
>>>
>>> I know this PR https://github.com/apache/zeppelin/pull/1173 is
>>> implementing something a bit similar.
>>> Maybe that will give you some leads
>>>
>>> On Wed, Jul 20, 2016 at 9:18 PM, Hyung Sung Shim <hss...@nflabs.com>
>>> wrote:
>>>
>>>> Hi.
>>>> Unfortunetely There is no way to solve your problem on zeppelin level
>>>> but it seems like interesting feature so could you create issue for this?
>>>>
>>>> 2016년 7월 20일 수요일, 仓库快满了<nulibamanc...@qq.com>님이 작성한 메시지:
>>>>
>>>> Hi,
>>>>> I have a question.
>>>>> Can I pass the authorization from one web system to this zeppelin web
>>>>> system?
>>>>> I have a web system,and it has its own authorization.I want to
>>>>> integrate it with zeppelin.
>>>>> For example,when I logged in my web system as user1, and I click a
>>>>> link and jump to zeppelin system,I want it is also logged as user1.
>>>>> As I know,the Shiro or nginx is recommended,but their users and roles
>>>>> are written in a config file.My web system's users and roles are stored in
>>>>> Mysql database and I want the zeppelin to use the same users and roles.
>>>>> Can you give me some advise or examples?
>>>>>
>>>>>
>>>>> Thanks.
>>>>
>>>>
>>>
>>
>
> _
> The information contained in this communication is intended solely for the
> use of the individual or entity to whom it is addressed and others
> authorized to receive it. It may contain confidential or legally privileged
> information. If you are not the intended recipient you are hereby notified
> that any disclosure, copying, distribution or taking any action in reliance
> on the contents of this information is strictly prohibited and may be
> unlawful. If you have received this communication in error, please notify
> us immediately by responding to this email and then delete it from your
> system. The firm is neither liable for the proper and complete transmission
> of the information contained in this communication nor for any delay in its
> receipt.

Re: Notebook copy per session/socket

[Khalid Huseynov]

Thanks for the question Ashish,

Actually it's a good feedback, and one of the reasons
https://github.com/apache/zeppelin/pull/1105 was proposed is to facilitate
the case of using note as a dashboard without intervening with storage and
other notebooks. I'll consider this feedback in the PR then and possibly
you can go ahead and try it and leave more feedback there.

Best,
Khalid.

On Wed, Jul 6, 2016 at 4:06 AM, ashish rawat  wrote:

> Thanks Moon and Mohit.
>
> Moon,
>
> It's not clear to me if offline mode would allow changing input controls
> (dropdowns/input box etc) and view the new result. Our requirement is for a
> dashboard mode, where multiple users can play with the data using the input
> controls but don't interfere with each other's work. This is a very basic
> requirement for making Dashboards using Zeppelin.
>
> I think isolating a notebook copy in a web socket/user session (in
> Dashboard mode), can achieve the desired results.
>
> Mohit,
>
> I am avoiding creating multiple physical copies, since it looks difficult
> to maintain for an ever increasing set of notebooks and users.
>
> Regards,
> Ashish
>
>
> On Tue, Jul 5, 2016 at 11:16 PM, Mohit Jaggi  wrote:
>
>> What if you make a physical copy of the notebook? Then the socket list
>> will have only one destination. Perhaps you can define a “notebook
>> template” as follows:
>>
>> Z -> Menu -> Create notebook template -> [ define your notebook template
>> here ]
>> Z -> Menu -> Create notebook from template -> [ choose the above template
>> ] -> make a physical copy of the template
>>
>> If the template changes, the notebook is based on a previous version but
>> I think that is fine for many use cases.
>>
>>
>> On Jul 4, 2016, at 10:14 PM, ashish rawat  wrote:
>>
>> + user list, hoping someone can help here!
>>
>> On Mon, Jul 4, 2016 at 10:48 PM, ashish rawat 
>> wrote:
>>
>>> Hi everyone,
>>>
>>> I am trying to implement a functionality in Zeppelin, where a notebook
>>> copy can be kept with each websocket associated with that notebook. This
>>> way the notebook would be opened in read-only mode and changes made by one
>>> connection would not be visible to the other connections over the same
>>> notebook. I would additionally disable the note.persist in this case.
>>>
>>> I explored the code a little and found that NotebookServer is keeping a
>>> map of notebookIds to list of sockets. Further, it seems that any message
>>> to a specific notebook gets broadcasted to the complete list of sockets
>>> associated with that list.
>>>
>>> My initial idea was to just maintain a notebook copy for each websocket,
>>> but now this is looking a little complex, since it seems that for every
>>> job, I would also need to maintain the websocket which triggered it,
>>> resulting in changes across the codebase.
>>>
>>> Can someone help me out in how to approach this change in the cleanest
>>> and fastest way.
>>>
>>> Regards,
>>> Ashish
>>>
>>> PS: The motivation for making this change is mentioned in one of my
>>> earlier questions "Zeppelin multi-user dashboards" on the users list.
>>>
>>
>>
>>
>