Re: Where are the interpreter settings stored ?

2017-05-30 Thread Ahyoung Ryu
Hi Sudev,

The setting information is stored in conf/interpreter.json

Hope it helps,
Ahyoung

On Tue, May 30, 2017 at 9:18 AM, Sudev A C  wrote:

> Hi,
>
>
> Can anyone help in understanding where the interpreter settings are
> stored?
>
> I'm trying to run Zeppelin in Docker, my issue is that I have to do all
> the configuration during every run of the docker. If the settings are being
> stored, read and populated to Zeppelin from a file then I can pre-load the
> same file to its location during docker build.
>
> Has anyone worked around this issue?
>
>
>
> Thanks
> Sudev
>
> ::DISCLAIMER::
>
> 
> 
> 
>
>
> This message is intended only for the use of the addressee and may contain
> information that is privileged, confidential and exempt from disclosure
> under applicable law. If the reader of this message is not the intended
> recipient, or the employee or agent responsible for delivering the message
> to the intended recipient, you are hereby notified that any dissemination,
> distribution or copying of this communication is strictly prohibited. If
> you have received this e-mail in error, please notify us immediately by
> return e-mail and delete this e-mail and all attachments from your system.
>


Re: Could not resolve dependencies for project org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT

2017-04-20 Thread Ahyoung Ryu
Hi Minwoo,

Have you tried to run "ZEPPELIN_HOME/dev/change_scala_version.sh 2.11"
before run your build command?
The script file will update all pom.xml files to scala 2.11.

Please refer to
https://zeppelin.apache.org/docs/latest/install/build.html#2-build-source

Ahyoung

On Thu, Apr 20, 2017 at 9:49 PM, Kang Minwoo 
wrote:

> - OS version
> macOS Sierra 10.12.4
>
> - JDK, scala version
> java version "1.8.0_121"
> Java(TM) SE Runtime Environment (build 1.8.0_121-b13)
> Java HotSpot(TM) 64-Bit Server VM (build 25.121-b13, mixed mode)
>
> scala -version
> Scala code runner version 2.12.2 -- Copyright 2002-2017, LAMP/EPFL and
> Lightbend, Inc.
>
> - build command
> mvn clean package -DskipTests -Phadoop-2.7 -Pscala-2.11 -X
>
> Best regards,
> Minwoo Kang
>
> 
> 보낸 사람: Park Hoon <1am...@gmail.com>
> 보낸 날짜: 2017년 4월 20일 목요일 오후 9:43:25
> 받는 사람: users@zeppelin.apache.org
> 제목: Re: Could not resolve dependencies for project
> org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
>
> Hi, minwoo.
>
> Could you describe your env including build command?
>
> - OS version
> - JDK, scala version
> - build command
>
> thanks!
>
>
>
>
>
> On Thu, 20 Apr 2017 at 21:39 Kang Minwoo  minwoo.k...@outlook.com>> wrote:
> Hello,
>
> I got fail to build zeppelin in my local computer.
> Revision is 652911abe457d48a540be4a3de2dad824691dfb1
>
> There is maven log.
>
> [ERROR] Failed to execute goal on project zeppelin-spark_2.10: Could not
> resolve dependencies for project 
> org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT:
> Failure to find org.apache.zeppelin:zeppelin-display_2.11:jar:0.8.0-SNAPSHOT
> in http://repository.apache.org/snapshots was cached in the local
> repository, resolution will not be reattempted until the update interval of
> apache.snapshots has elapsed or updates are forced -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal on project zeppelin-spark_2.10: Could not resolve dependencies for
> project org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT:
> Failure to find org.apache.zeppelin:zeppelin-display_2.11:jar:0.8.0-SNAPSHOT
> in http://repository.apache.org/snapshots was cached in the local
> repository, resolution will not be reattempted until the update interval of
> apache.snapshots has elapsed or updates are forced
> at org.apache.maven.lifecycle.internal.
> LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.
> java:221)
> at org.apache.maven.lifecycle.internal.
> LifecycleDependencyResolver.resolveProjectDependencies(
> LifecycleDependencyResolver.java:127)
> at org.apache.maven.lifecycle.internal.MojoExecutor.
> ensureDependenciesAreResolved(MojoExecutor.java:245)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:199)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:153)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:145)
> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> buildProject(LifecycleModuleBuilder.java:116)
> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> buildProject(LifecycleModuleBuilder.java:80)
> at org.apache.maven.lifecycle.internal.builder.singlethreaded.
> SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> at org.apache.maven.lifecycle.internal.LifecycleStarter.
> execute(LifecycleStarter.java:128)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:498)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> launchEnhanced(Launcher.java:289)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> launch(Launcher.java:229)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> mainWithExitCode(Launcher.java:415)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> main(Launcher.java:356)
> Caused by: org.apache.maven.project.DependencyResolutionException: Could
> not resolve dependencies for project 
> org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT:
> Failure to find org.apache.zeppelin:zeppelin-display_2.11:jar:0.8.0-SNAPSHOT
> in http://repository.apache.org/snapshots was cached 

Re: Pyspark failing in 0.7.0

2017-03-21 Thread Ahyoung Ryu
Hi Anand,

Can you share your log files in here?
You can find them under ZEPPELIN_HOME/logs/

Thanks
Ahyoung

On Tue, Mar 21, 2017 at 6:35 AM, Anandha L Ranganathan <
analog.s...@gmail.com> wrote:

>
>
> zeppelin : 0.7.0
> Spark : 1.6.0 (HDP 2.4)
>
>
> *Command in the notebook*
>
> %pyspark
> 2+2
>
>
> *Error*
> Traceback (most recent call last):
> File "/tmp/zeppelin_pyspark-5483459839514814481.py", line 22, in 
> from pyspark.conf import SparkConf
> ImportError: No module named pyspark.conf
> Traceback (most recent call last):
> File "/tmp/zeppelin_pyspark-5483459839514814481.py", line 22, in 
> from pyspark.conf import SparkConf
> ImportError: No module named pyspark.conf
>
>
> I opened up the /tmp/zeppelin_pyspark-5483459839514814481.py and here is
> the Line # 22 says.
> 22 from pyspark.conf import SparkConf
>
>
> Here is my zeppelin-env.sh configuration
>
> export SPARK_HOME=/usr/hdp/current/spark-client/
>
>
>
> When I submit the job using spark or spark-sql, I have no problem in
> running the job. Please help me what configuration am I missing for
> pyspark.
>
>
>
> Thanks
> Anand
>
>


Re: Is it possible to return javascript to frontend and run it in frontend

2017-02-28 Thread Ahyoung Ryu
I see. Then have you read these pages?

https://zeppelin.apache.org/docs/latest/displaysystem/front-end-angular.html
https://zeppelin.apache.org/docs/latest/displaysystem/back-end-angular.html

On Wed, Mar 1, 2017 at 12:53 PM, canan chen  wrote:

>
> Thanks Ahyoung,  Is there any workaround like using %angular or %html to
> achieve that ? Developing a new type of Helium package might be too
> complicated for me.
>
>
> On Tue, Feb 28, 2017 at 5:17 PM Ahyoung Ryu  wrote:
>
>> Hi Canan,
>>
>> I think you can do it by writing your own "SPELL" type of Helium package.
>> You can get more information about it in https://zeppelin.apache.org/
>> docs/0.8.0-SNAPSHOT/development/writingzeppelinspell.html.
>> Note that currently it's only available in development version. To test
>> this, you need to build Zeppelin from source in master branch.
>> Hope this helps.
>>
>> Thanks,
>> Ahyoung
>>
>> On Mon, Feb 27, 2017 at 12:20 PM, canan chen  wrote:
>>
>> Hi,
>>
>> I'd like to return a piece of javascript code from my interpreter and run
>> it in frontend, is it possible and how can I do it ? Thanks
>>
>>
>>


Re: Is it possible to return javascript to frontend and run it in frontend

2017-02-28 Thread Ahyoung Ryu
Hi Canan,

I think you can do it by writing your own "SPELL" type of Helium package.
You can get more information about it in
https://zeppelin.apache.org/docs/0.8.0-SNAPSHOT/development/writingzeppelinspell.html
.
Note that currently it's only available in development version. To test
this, you need to build Zeppelin from source in master branch.
Hope this helps.

Thanks,
Ahyoung

On Mon, Feb 27, 2017 at 12:20 PM, canan chen  wrote:

> Hi,
>
> I'd like to return a piece of javascript code from my interpreter and run
> it in frontend, is it possible and how can I do it ? Thanks
>


Re: Helium and Default Port

2017-02-09 Thread Ahyoung Ryu
Hi Richard,

Thanks for sharing your issue.
If you don't mind, could you create a Jira ticket[1] for this?

[1] https://issues.apache.org/jira/issues/?jql=project%20%3D%20ZEPPELIN

Best,
Ahyoung

On Thu, Feb 9, 2017 at 10:51 PM, RICHARD WILLIAMS <
richard.willi...@elabsolutions.com> wrote:

> Changing the default port for Zeppelin http in the zeppelin-env.sh file
> prevents Helium from presenting new visualizations in paragraphs. Nothing
> appears out of the ordinary in the logs, and the Helium components register
> as documented, but the new icons do not show up. Restoring port to 8080
> corrects the problem.
>
>
>
>
>
> Thanks
>
>
>
> Richard Williams
>
>
>


Re: [ANNOUNCE] Apache Zeppelin 0.7.0 released

2017-02-05 Thread Ahyoung Ryu
Congrats ALL the Apache Zeppelin community!
Thanks for your effort Mina :D

On Mon, Feb 6, 2017 at 4:11 PM, Jun Kim  wrote:

> Col!!!
>
> 2017년 2월 6일 (월) 오후 4:10, Anthony Corbacho 님이
> 작성:
>
>> Awesome
>>
>> On Mon, Feb 6, 2017 at 4:07 PM, Mina Lee  wrote:
>>
>> The Apache Zeppelin community is pleased to announce the availability of
>> the 0.7.0 release.
>>
>> Zeppelin is a collaborative data analytics and visualization tool for
>> distributed, general-purpose data processing system such as Apache Spark,
>> Apache Flink, etc.
>>
>> The community put significant effort into improving Apache Zeppelin since
>> the last release, focusing on multi-user support, pluggable visualization,
>> better interpreter support. More than 100+ contributors provided 700+
>> patches
>> for new features, improvements and bug fixes. More than 480+ issues have
>> been resolved.
>>
>> We encourage you to download the latest release from
>> http://zeppelin.apache.org/download.html
>>
>> Release note is available at
>> http://zeppelin.apache.org/releases/zeppelin-release-0.7.0.html
>>
>> We welcome your help and feedback. For more information on the project and
>> how to get involved, visit our website at http://zeppelin.apache.org/
>>
>> Thank you all users and contributors who have helped to improve Apache
>> Zeppelin.
>>
>> Regards,
>> The Apache Zeppelin community
>>
>>
>> --
> Taejun Kim
>
> Data Mining Lab.
> School of Electrical and Computer Engineering
> University of Seoul
>


Re: [VOTE] Release Apache Zeppelin 0.7.0 (RC4)

2017-02-02 Thread Ahyoung Ryu
+1

On Thu, Feb 2, 2017 at 10:07 PM, Jun Kim  wrote:

> +1
> 2017년 2월 2일 (목) 오후 9:49, Sora Lee 님이 작성:
>
>> +1
>>
>> On Thu, Feb 2, 2017 at 9:40 PM Khalid Huseynov 
>> wrote:
>>
>> > +1
>> >
>> > On Thu, Feb 2, 2017 at 9:21 PM, DuyHai Doan 
>> wrote:
>> >
>> > +1
>> >
>> > On Thu, Feb 2, 2017 at 9:56 AM, Mina Lee  wrote:
>> >
>> > > I propose the following RC to be released for the Apache Zeppelin
>> 0.7.0
>> > > release.
>> > >
>> > > The commit id is df007f2284a09caa7c8b35f8b59d5f1993fe8b64 which is
>> > > corresponds to the tag v0.7.0-rc4:
>> > > *
>> > https://git-wip-us.apache.org/repos/asf?p=zeppelin.git;a=
>> shortlog;h=refs/tags/v0.7.0-rc4
>> > > <
>> > https://git-wip-us.apache.org/repos/asf?p=zeppelin.git;a=
>> shortlog;h=refs/tags/v0.7.0-rc4
>> > >*
>> > >
>> > > The release archives (tgz), signature, and checksums are here
>> > > https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.7.0-rc4/
>> > >
>> > > The release candidate consists of the following source distribution
>> > > archive
>> > > zeppelin-0.7.0.tgz
>> > >
>> > > In addition, the following supplementary binary distributions are
>> > provided
>> > > for user convenience at the same location
>> > > zeppelin-0.7.0-bin-all.tgz
>> > > zeppelin-0.7.0-bin-netinst.tgz
>> > >
>> > > The maven artifacts are here
>> > >
>> > https://repository.apache.org/content/repositories/
>> orgapachezeppelin-1027
>> > >
>> > > You can find the KEYS file here:
>> > > https://dist.apache.org/repos/dist/release/zeppelin/KEYS
>> > >
>> > > Release notes available at
>> > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?
>> > > version=12336544&projectId=12316221
>> > >
>> > > Vote will be open for next 72 hours (close at 01:00 5/Feb PST).
>> > >
>> > > [ ] +1 approve
>> > > [ ] 0 no opinion
>> > > [ ] -1 disapprove (and reason why)
>> > >
>> >
>> >
>> >
>>
> --
> Taejun Kim
>
> Data Mining Lab.
> School of Electrical and Computer Engineering
> University of Seoul
>


Re: [VOTE] Release Apache Zeppelin 0.7.0 (RC3)

2017-01-24 Thread Ahyoung Ryu
+1

On Tue, Jan 24, 2017 at 8:19 PM, Hyung Sung Shim  wrote:

> +1
> 2017년 1월 24일 (화) 오전 1:36, Windy Qin 님이 작성:
>
>>
>> +1
>> On 2017-01-24 17:13 (+0800), Sora Lee  wrote:
>> > +1
>> >
>> > On Tue, Jan 24, 2017 at 3:09 PM Jongyoul Lee 
>> wrote:
>> >
>> > > +1 (binding)
>> > >
>> > > On Tue, Jan 24, 2017 at 2:43 PM, Mina Lee  wrote:
>> > >
>> > > I propose the following RC to be released for the Apache Zeppelin
>> 0.7.0
>> > > release.
>> > >
>> > > The commit id is 48ad70e8c62975bdb00779bed5919eaca98c5b5d which is
>> > > corresponds to the tag v0.7.0-rc3:
>> > > *https://git-wip-us.apache.org/repos/asf?p=zeppelin.git;a=commit;h=
>> 48ad70e8c62975bdb00779bed5919eaca98c5b5d
>> > > > 48ad70e8c62975bdb00779bed5919eaca98c5b5d>*
>> > >
>> > > The release archives (tgz), signature, and checksums are here
>> > > https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.7.0-rc3/
>> > >
>> > > The release candidate consists of the following source distribution
>> > > archive
>> > > zeppelin-0.7.0.tgz
>> > >
>> > > In addition, the following supplementary binary distributions are
>> provided
>> > > for user convenience at the same location
>> > > zeppelin-0.7.0-bin-all.tgz
>> > > zeppelin-0.7.0-bin-netinst.tgz
>> > >
>> > > The maven artifacts are here
>> > > https://repository.apache.org/content/repositories/
>> orgapachezeppelin-1024
>> > >
>> > > You can find the KEYS file here:
>> > > https://dist.apache.org/repos/dist/release/zeppelin/KEYS
>> > >
>> > > Release notes available at
>> > >
>> > > https://issues.apache.org/jira/secure/ReleaseNote.jspa?
>> version=12336544&projectId=12316221
>> > >
>> > > Vote will be open for next 72 hours (close at 22:00 26/Jan PST).
>> > >
>> > > [ ] +1 approve
>> > > [ ] 0 no opinion
>> > > [ ] -1 disapprove (and reason why)
>> > >
>> > >
>> > >
>> > >
>> > > --
>> > > 이종열, Jongyoul Lee, 李宗烈
>> > > http://madeng.net
>> > >
>> >
>>
>


Re: [VOTE] Release Apache Zeppelin 0.7.0 (RC2)

2017-01-22 Thread Ahyoung Ryu
+1

On Sun, Jan 22, 2017 at 5:52 PM, Jeff Zhang  wrote:

> +1
>
>
>
> DuyHai Doan 于2017年1月22日周日 下午4:01写道:
>
>> +1
>>
>> On Sun, Jan 22, 2017 at 8:59 AM, Mina Lee  wrote:
>>
>> I propose the following RC to be released for the Apache Zeppelin 0.7.0
>> release.
>>
>> The commit id is d0ddf8fdff75b4229543f7ebfd5eb001f685382d which is
>> corresponds to the tag v0.7.0-rc2:
>> *https://git-wip-us.apache.org/repos/asf?p=zeppelin.git;a=commit;h=d0ddf8fdff75b4229543f7ebfd5eb001f685382d
>> *
>>
>> The release archives (tgz), signature, and checksums are here
>> https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.7.0-rc2/
>>
>> The release candidate consists of the following source distribution
>> archive
>> zeppelin-0.7.0.tgz
>>
>> In addition, the following supplementary binary distributions are provided
>> for user convenience at the same location
>> zeppelin-0.7.0-bin-all.tgz
>> zeppelin-0.7.0-bin-netinst.tgz
>>
>> The maven artifacts are here
>> https://repository.apache.org/content/repositories/orgapachezeppelin-1023
>>
>> You can find the KEYS file here:
>> https://dist.apache.org/repos/dist/release/zeppelin/KEYS
>>
>> Release notes available at
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?
>> version=12336544&projectId=12316221
>>
>> Vote will be open for next 72 hours (close at 23:59 24/Jan PST).
>>
>> [ ] +1 approve
>> [ ] 0 no opinion
>> [ ] -1 disapprove (and reason why)
>>
>>
>>


Re: [VOTE] Release Apache Zeppelin 0.7.0 (RC1)

2017-01-21 Thread Ahyoung Ryu
+1

On Sun, Jan 22, 2017 at 2:54 AM, Hyung Sung Shim  wrote:

> +1
> 2017년 1월 21일 (토) 오전 4:55, Jeff Zhang 님이 작성:
>
>> -1,  Can we include ZEPPELIN-1985
>>  ? This issue cause
>> only user1 can see the pig tutorial note which is a very bad user
>> experience.
>>
>>
>>
>> Prabhjyot Singh 于2017年1月21日周六 下午7:25写道:
>>
>> +1
>>
>> On Jan 21, 2017 4:52 PM, "Jun Kim"  wrote:
>>
>> +1
>> 2017년 1월 21일 (토) 오후 8:21, CloverHearts 님이 작성:
>>
>> +1
>>
>>
>>
>> The Zeppelin 0.7 release includes some amazing features.
>>
>> In particular, a major bug fix for the remote interpreter.
>>
>> I am actively in favor of this release.
>>
>>
>>
>>
>>
>> *출발**: *Mina Lee 
>> *회신* *대상**:* 
>> *날짜**: *2017년 1월 21일 토요일 오전 3:17
>> *받는* *사람**: *, 
>> *주제**: *[VOTE] Release Apache Zeppelin 0.7.0 (RC1)
>>
>>
>>
>> Hi folks,
>>
>> I propose the following RC to be released for the Apache Zeppelin 0.7.0
>> release.
>>
>> The commit id is bcbe0855175f55eddd10b918303806eb5e5db091 which is
>> corresponds to the tag v0.7.0-rc1:
>>
>> https://git-wip-us.apache.org/repos/asf?p=zeppelin.git;a=commit;h=
>> bcbe0855175f55eddd10b918303806eb5e5db091
>>
>> The release archives (tgz), signature, and checksums are here
>> https://dist.apache.org/repos/dist/dev/zeppelin/zeppelin-0.7.0-rc1/
>>
>> The release candidate consists of the following source distribution
>> archive
>>
>> zeppelin-0.7.0.tgz
>>
>> In addition, the following supplementary binary distributions are provided
>> for user convenience at the same location
>>
>> zeppelin-0.7.0-bin-all.tgz
>> zeppelin-0.7.0-bin-netinst.tgz
>>
>>
>> The maven artifacts are here
>> https://repository.apache.org/content/repositories/orgapachezeppelin-1022
>>
>> You can find the KEYS file here:
>> https://dist.apache.org/repos/dist/release/zeppelin/KEYS
>>
>> Release notes available at
>> https://issues.apache.org/jira/secure/ReleaseNote.jspa?
>> version=12336544&projectId=12316221
>>
>> Vote will be open for next 72 hours (close at 3:30 am 24/Jan PST).
>>
>> [ ] +1 approve
>> [ ] 0 no opinion
>> [ ] -1 disapprove (and reason why)
>>
>> --
>> Taejun Kim
>>
>> Data Mining Lab.
>> School of Electrical and Computer Engineering
>> University of Seoul
>>
>>


Re: [DISCUSS] Release package size

2017-01-17 Thread Ahyoung Ryu
Thanks Mina always!
+1 for releasing only netinst package.

On Wed, Jan 18, 2017 at 12:29 PM, Prabhjyot Singh  wrote:

> +1
>
> I don't think it's a problem now, but if it keeps increasing then in the
> subsequent releases we can ship Zeppelin with few interpreters, and mark
> others as plugins that can be downloaded later with instructions with how
> to configure.
>
> On Jan 18, 2017 8:54 AM, "Jun Kim"  wrote:
>
>> +1
>>
>> I think it won't be a problem if we notice it clear.
>> Maybe we can do that next to the download button here (
>> http://zeppelin.apache.org/download.html)
>> A message may be "NOTE: only spark interpreter included since 0.7.0. If
>> you want other interpreters, please see interpreter installation guide"
>>
>> 2017년 1월 18일 (수) 오후 12:14, Jeff Zhang 님이 작성:
>>
>>>
>>> +1, we should also mention it in release note and in the 0.7 doc
>>>
>>>
>>>
>>> Mina Lee 于2017年1月18日周三 上午11:12写道:
>>>
>>> Hi all,
>>>
>>> Zeppelin is about to start 0.7.0 release process, I would like to
>>> discuss about binary package distribution.
>>>
>>> Every time we distribute new binary package, size of the
>>> zeppelin-0.x.x-bin-all.tgz package is getting bigger:
>>>- zeppelin-0.6.0-bin-all.tgz: 506M
>>>- zeppelin-0.6.1-bin-all.tgz: 517M
>>>- zeppelin-0.6.2-bin-all.tgz: 547M
>>>- zeppelin-0.7.0-bin-all.tgz: 720M (Expected)
>>>
>>> Mostly it is because the number of interpreters supported by zeppelin
>>> keeps growing,
>>> and there is high chance that we support more interpreters in the near
>>> future.
>>> So instead of asking apache infra team to increase limit,
>>> I would like to suggest to have only zeppelin-0.7.0-bin-netinst.tgz,
>>> which only includes spark interpreter from 0.7.0 release.
>>> One concern is that users need one more step to install the interpreters
>>> they use,
>>> but I believe it can be done easily with single line of command [1].
>>>
>>> FYI, attaching the link of similar discussion [2] we had last June in
>>> mailing list.
>>>
>>> Regards,
>>> Mina
>>>
>>> [1] http://zeppelin.apache.org/docs/0.6.2/manual/interpreter
>>> installation.html#install-specific-interpreters
>>> 
>>> [2] https://lists.apache.org/thread.html/4b54c034cf8d691655156e0
>>> cb647243180c57a6829d97aa3c085b63c@%3Cusers.zeppelin.apache.org%3E
>>>
>>> --
>> Taejun Kim
>>
>> Data Mining Lab.
>> School of Electrical and Computer Engineering
>> University of Seoul
>>
>


Re: Vizualize bash result

2017-01-15 Thread Ahyoung Ryu
FYI
https://zeppelin.apache.org/docs/latest/displaysystem/basicdisplaysystem.html#table
provides
some basic examples how you can draw table :)

Best,
Ahyoung

On Sun, Jan 15, 2017 at 1:20 AM, Jongyoul Lee  wrote:

> Basically, you can draw everything if your output starts with '%table' and
> data format is tsv. For example, you can echo '%table ...' to draw table in
> sh.
>
> Hope this help,
> Jongyoul
>
> On Sat, Jan 14, 2017 at 9:02 PM, Markovich  wrote:
>
>> Hi,
>> Is it possible to visualize bash result in Zeppelin?
>>
>> For example I'd like to see a chart from this command: hdfs dfs -du -s -h
>> '/*'
>>
>> Also I'm interested in passing bash output to variable.
>>
>> Regards,
>> Andrey
>>
>
>
>
> --
> 이종열, Jongyoul Lee, 李宗烈
> http://madeng.net
>


Re: REST API for updating interpreter settings

2017-01-11 Thread Ahyoung Ryu
Hi Deenar,

The below sample input is just example. So you need to modify at lease
"propname", "dependencies"  and their values as well.

{ "name": "Markdown setting name", "group": "md", "properties": {
"propname": "Otherpropvalue" }, "interpreterGroup": [ { "class":
"org.apache.zeppelin.markdown.Markdown", "name": "md" } ], "dependencies":
[ { "groupArtifactVersion": "groupId:artifactId:version", "exclusions": [
"groupId:artifactId" ] } ] }


Thanks,
Ahyoung

On Tue, Jan 10, 2017 at 8:45 PM, Deenar Toraskar 
wrote:

> Hi
>
> I am trying to call the REST API endpoint to update an interpreter setting
> viz. https://zeppelin.apache.org/docs/latest/rest-api/rest-
> interpreter.html#update-an-interpreter-setting, but am unable to get this
> working. All the other Interpreter REST endpoints seem to work fine. Any
> ideas as to what I am doing wrong and how do I get this to work.
>
> http://myHost:8080/api/interpreter/setting/2C8M66DU1
>
> I tried with the example and with other interpreters too with no avail.
>
> {
>   "name": "Markdown setting name",
>   "group": "md",
>   "properties": {
> "propname": "Otherpropvalue"
>   },
>   "interpreterGroup": [
> {
>   "class": "org.apache.zeppelin.markdown.Markdown",
>   "name": "md"
> }
>   ],
>   "dependencies": [
> {
>   "groupArtifactVersion": "groupId:artifactId:version",
>   "exclusions": [
> "groupId:artifactId"
>   ]
> }
>   ]
> }
>
> The error I am getting is as follows
>
> 
> 
> 
> Error 500 Server Error
> 
> 
> HTTP ERROR 500
> Problem accessing /api/interpreter/setting/2C8M66DU1. Reason:
>
> Server Error
> 
> Caused by:
> javax.servlet.ServletException: Filtered request failed.
>   at 
> org.apache.shiro.web.servlet.AbstractShiroFilter.doFilterInternal(AbstractShiroFilter.java:384)
>   at 
> org.apache.shiro.web.servlet.OncePerRequestFilter.doFilter(OncePerRequestFilter.java:125)
>   at 
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
>   at org.apache.zeppelin.server.CorsFilter.doFilter(CorsFilter.java:72)
>   at 
> org.eclipse.jetty.servlet.ServletHandler$CachedChain.doFilter(ServletHandler.java:1652)
>   at 
> org.eclipse.jetty.servlet.ServletHandler.doHandle(ServletHandler.java:585)
>   at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:143)
>   at 
> org.eclipse.jetty.security.SecurityHandler.handle(SecurityHandler.java:577)
>   at 
> org.eclipse.jetty.server.session.SessionHandler.doHandle(SessionHandler.java:223)
>   at 
> org.eclipse.jetty.server.handler.ContextHandler.doHandle(ContextHandler.java:1127)
>   at 
> org.eclipse.jetty.servlet.ServletHandler.doScope(ServletHandler.java:515)
>   at 
> org.eclipse.jetty.server.session.SessionHandler.doScope(SessionHandler.java:185)
>   at 
> org.eclipse.jetty.server.handler.ContextHandler.doScope(ContextHandler.java:1061)
>   at 
> org.eclipse.jetty.server.handler.ScopedHandler.handle(ScopedHandler.java:141)
>   at 
> org.eclipse.jetty.server.handler.ContextHandlerCollection.handle(ContextHandlerCollection.java:215)
>   at 
> org.eclipse.jetty.server.handler.HandlerWrapper.handle(HandlerWrapper.java:97)
>   at org.eclipse.jetty.server.Server.handle(Server.java:499)
>   at org.eclipse.jetty.server.HttpChannel.handle(HttpChannel.java:311)
>   at 
> org.eclipse.jetty.server.HttpConnection.onFillable(HttpConnection.java:257)
>   at 
> org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
>   at 
> org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
>   at 
> org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
>   at java.lang.Thread.run(Thread.java:745)
> Caused by: java.lang.AbstractMethodError: 
> javax.ws.rs.core.Response.getStatusInfo()Ljavax/ws/rs/core/Response$StatusType;
>   at 
> javax.ws.rs.WebApplicationException.validate(WebApplicationException.java:186)
>   at 
> javax.ws.rs.ClientErrorException.(ClientErrorException.java:88)
>   at 
> org.apache.cxf.jaxrs.utils.JAXRSUtils.findTargetMethod(JAXRSUtils.java:503)
>   at 
> org.apache.cxf.jaxrs.interceptor.JAXRSInInterceptor.processRequest(JAXRSInInterceptor.java:207)
>   at 
> org.apache.cxf.jaxrs.interceptor.JAXRSInInterceptor.handleMessage(JAXRSInInterceptor.java:103)
>   at 
> org.apache.cxf.phase.PhaseInterceptorChain.doIntercept(PhaseInterceptorChain.java:272)
>   at 
> org.apache.cxf.transport.ChainInitiationObserver.onMessage(ChainInitiationObserver.java:121)
>   at 
> org.apache.cxf.transport.http.AbstractHTTPDestination.invoke(AbstractHTTPDestination.java:239)
>   at 
> org.apache.cxf.transport.servlet.ServletController.invokeDestination(ServletController.java:248)
>   at 
> org.apache.cxf.transport.servlet.ServletController.invoke

Re: R interpreter build fails

2016-11-28 Thread Ahyoung Ryu
Hi Ruslan,

Can you share your build command in here?

Thanks,
Ahyoung

On Mon, Nov 28, 2016 at 11:51 PM, Ruslan Dautkhanov 
wrote:

> The same problem in 0.6.2 and 0.7.0-snapshot.
> R interpreter build fails with below error stack.
>
> R is installed locally through yum.
> Is there any special requirements for R interpreter build?
>
>
> [INFO] Zeppelin: Packaging distribution ... SUCCESS [
>  6.250 s]
> [INFO] Zeppelin: R Interpreter  FAILURE [
> 24.092 s]
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time: 10:54 min
> [INFO] Finished at: 2016-11-28T07:44:51-07:00
> [INFO] Final Memory: 221M/3106M
> [INFO] 
> 
> [ERROR] Failed to execute goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec
> (default) on project zeppelin-zrinterpreter_2.10: Command execution failed.
> Process exited with an error: 1 (Exit value: 1) -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal org.codehaus.mojo:exec-maven-plugin:1.2.1:exec (default) on project
> zeppelin-zrinterpreter_2.10: Command execution failed.
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:212)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:153)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:145)
> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> buildProject(LifecycleModuleBuilder.java:116)
> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> buildProject(LifecycleModuleBuilder.java:80)
> at org.apache.maven.lifecycle.internal.builder.singlethreaded.
> SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> at org.apache.maven.lifecycle.internal.LifecycleStarter.
> execute(LifecycleStarter.java:128)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:57)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
> at java.lang.reflect.Method.invoke(Method.java:606)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> launchEnhanced(Launcher.java:289)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> launch(Launcher.java:229)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> mainWithExitCode(Launcher.java:415)
> at org.codehaus.plexus.classworlds.launcher.Launcher.
> main(Launcher.java:356)
> Caused by: org.apache.maven.plugin.MojoExecutionException: Command
> execution failed.
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:362)
> at org.apache.maven.plugin.DefaultBuildPluginManager.executeMojo(
> DefaultBuildPluginManager.java:134)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:207)
> ... 20 more
> Caused by: org.apache.commons.exec.ExecuteException: Process exited with
> an error: 1 (Exit value: 1)
> at org.apache.commons.exec.DefaultExecutor.executeInternal(
> DefaultExecutor.java:377)
> at org.apache.commons.exec.DefaultExecutor.execute(
> DefaultExecutor.java:160)
> at org.codehaus.mojo.exec.ExecMojo.executeCommandLine(
> ExecMojo.java:610)
> at org.codehaus.mojo.exec.ExecMojo.execute(ExecMojo.java:352)
> ... 22 more
> [ERROR]
> [ERROR] Re-run Maven using the -X switch to enable full debug logging.
> [ERROR]
> [ERROR] For more information about the errors and possible solutions,
> please read the following articles:
> [ERROR] [Help 1] http://cwiki.apache.org/confluence/display/MAVEN/
> MojoExecutionException
> [ERROR]
> [ERROR] After correcting the problems, you can resume the build with the
> command
> [ERROR]   mvn  -rf :zeppelin-zrinterpreter_2.10
>
>
> --
> Ruslan Dautkhanov
>


Re: Zeppelin process died [FAILED]

2016-11-18 Thread Ahyoung Ryu
> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
> at org.eclipse.jetty.server.ServerConnector.open(
> ServerConnector.java:321)
> at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(
> AbstractNetworkConnector.java:80)
> at org.eclipse.jetty.server.ServerConnector.doStart(
> ServerConnector.java:236)
> at org.eclipse.jetty.util.component.AbstractLifeCycle.
> start(AbstractLifeCycle.java:68)
> at org.eclipse.jetty.server.Server.doStart(Server.java:366)
> at org.eclipse.jetty.util.component.AbstractLifeCycle.
> start(AbstractLifeCycle.java:68)
> at org.apache.zeppelin.server.ZeppelinServer.main(
> ZeppelinServer.java:116)
> ERROR [2016-11-18 20:10:08,949] ({main} ZeppelinServer.java[main]:118) -
> Error while running jettyServer
> java.net.BindException: Address already in use
> at sun.nio.ch.Net.bind0(Native Method)
> at sun.nio.ch.Net.bind(Net.java:433)
> at sun.nio.ch.Net.bind(Net.java:425)
> at sun.nio.ch.ServerSocketChannelImpl.bind(
> ServerSocketChannelImpl.java:223)
> at sun.nio.ch.ServerSocketAdaptor.bind(ServerSocketAdaptor.java:74)
> at org.eclipse.jetty.server.ServerConnector.open(
> ServerConnector.java:321)
> at org.eclipse.jetty.server.AbstractNetworkConnector.doStart(
> AbstractNetworkConnector.java:80)
> at org.eclipse.jetty.server.ServerConnector.doStart(
> ServerConnector.java:236)
> at org.eclipse.jetty.util.component.AbstractLifeCycle.
> start(AbstractLifeCycle.java:68)
> at org.eclipse.jetty.server.Server.doStart(Server.java:366)
> at org.eclipse.jetty.util.component.AbstractLifeCycle.
> start(AbstractLifeCycle.java:68)
> at org.apache.zeppelin.server.ZeppelinServer.main(
> ZeppelinServer.java:116)
>
>
>
> Thanks and Regards,
> *Md. Rezaul Karim*
>
>
> On Friday, November 18, 2016 10:57 PM, Ahyoung Ryu 
> wrote:
>
>
> Hi Md. Rezaul,
>
> There could be many reasons to die Zeppelin server process before it
> started.
> Can you check ZEPPELIN_HOME/logs/*.log files?
> It would be helpful to investigate what the reason was.
>
> Best regards,
> Ahyoung
>
> On Fri, Nov 18, 2016 at 9:16 PM, Muhammad Rezaul Karim <
> reza_cse...@yahoo.com> wrote:
>
> Dear All,
>
> I am trying to start Zeppelin on my Machine using *$
> bin/zeppelin-daemon.sh start *command*. *Upon issuing this command
> Zeppelin starts successfully. However, the process dies immediately,
> without providing any error messages or details. Here is the message that I
> am receiving:
>
> rezkar@appsrv01:~/zeppelin-0. 6.2-bin-all$ bin/zeppelin-daemon.sh start
> Zeppelin start  [  OK  ]
> Zeppelin process died  [FAILED]
> rezkar@appsrv01:~/zeppelin-0. 6.2-bin-all$
>
>
> The configuration of the machine is 64GB of RAM, Core i7 processor with
> Ubuntu 14.04 LTS (64-bit installed). Please help me out.
>
>
>
> Thanks and Regards,
> *Md. Rezaul Karim*
>
>
>
>
>


Re: Zeppelin process died [FAILED]

2016-11-18 Thread Ahyoung Ryu
Hi Md. Rezaul,

There could be many reasons to die Zeppelin server process before it
started.
Can you check ZEPPELIN_HOME/logs/*.log files?
It would be helpful to investigate what the reason was.

Best regards,
Ahyoung

On Fri, Nov 18, 2016 at 9:16 PM, Muhammad Rezaul Karim <
reza_cse...@yahoo.com> wrote:

> Dear All,
>
> I am trying to start Zeppelin on my Machine using *$
> bin/zeppelin-daemon.sh start *command*. *Upon issuing this command
> Zeppelin starts successfully. However, the process dies immediately,
> without providing any error messages or details. Here is the message that I
> am receiving:
>
> rezkar@appsrv01:~/zeppelin-0.6.2-bin-all$ bin/zeppelin-daemon.sh start
> Zeppelin start [  OK  ]
> Zeppelin process died [FAILED]
> rezkar@appsrv01:~/zeppelin-0.6.2-bin-all$
>
>
> The configuration of the machine is 64GB of RAM, Core i7 processor with
> Ubuntu 14.04 LTS (64-bit installed). Please help me out.
>
>
>
> Thanks and Regards,
> *Md. Rezaul Karim*
>


Re: Regarding Zeppelin upgrade

2016-10-18 Thread Ahyoung Ryu
Hi Dipesh,

It would be better if you can provide more information to us.
Which version of Zeppelin did you install on your cluster? How did you
install Zeppelin? From source? Or prebuild binary package?

Thanks,
Ahyoung

On Sat, Oct 15, 2016 at 8:43 PM, Dipesh Vora 
wrote:

> Hi All,
>
>
>
> I have installed zeppelin as a script action on my HDInsights cluster on
> Azure. The current installation doesn’t has R integration.
>
> Kindly guide me how to integrate the zeppelin with R on Azure HDInsights.
>
>
>
> Thanks and regards,
>
> Dipesh Vora.
>
> --
>
> The contents of this e-mail and any attachment(s) may contain confidential
> or privileged information for the intended recipient(s). Unintended
> recipients are prohibited from taking action on the basis of information in
> this e-mail and using or disseminating the information, and must notify the
> sender and delete it from their system. L&T Infotech will not accept
> responsibility or liability for the accuracy or completeness of, or the
> presence of any virus or disabling code in this e-mail"
>


Re: Livy with 0.6.0

2016-10-04 Thread Ahyoung Ryu
Hi Herman,

Thanks for sharing your issue :)
Actually I have no idea how we can get REPL output with Livy interpreter,
but the *printREPLOutput* property is implemented only for Spark
interpreter[1] in the Zeppelin side. So it won't be available in Livy
interpreter.

[1]
https://github.com/apache/zeppelin/blob/master/spark/src/main/java/org/apache/zeppelin/spark/SparkInterpreter.java#L536

Thanks,
Ahyoung

On Mon, Oct 3, 2016 at 11:48 PM, Herman Yu  wrote:

> Hi everyone,
>
> Is there a way to enable the REPL output for Livy interpreter with
> zeppelin 0.6 and spark 1.6? set  zeppelin.livy.spark.printREPLOutput  to
> true doesn’t work with Livy interpreter.
>
> Thanks
> Herman.
>
>
>


Re: Import notebook

2016-09-25 Thread Ahyoung Ryu
Hi Herman,

As Damien said, there is a PR(but not merged) related with your issue.
Regarding the "Unable to fetch URL", when I tried again with my notebook
URL I saw an error message "XMLHttpRequest cannot load
https://raw.githubusercontent.com/AhyoungRyu/spark-notebook-example/master/zeppelin-notebook/2B3QSZTKR/note.json.
A wildcard '*' cannot be used in the 'Access-Control-Allow-Origin' header
when the credentials flag is true. Origin 'http://localhost:8080' is
therefore not allowed access. The credentials mode of an XMLHttpRequest is
controlled by the withCredentials attribute."  in the chrome/ FF/ Safari
console windows. I'll figure out what the root cause is. Thanks anyway :)

Best,
Ahyoung

2016년 9월 26일 (월) 오전 10:32, Corneau Damien 님이 작성:

> Hi Herman,
>
> I think this PR: https://github.com/apache/zeppelin/pull/1430 is trying
> to give us a better input on file size issue
>
> On Mon, Sep 26, 2016 at 5:51 AM, Herman Yu 
> wrote:
>
>>
>> Thanks Mark and Ahyoung.
>>
>> It turns out that the notebook json I was trying to import was too large,
>> this is the error message: 
>> org.eclipse.jetty.websocket.api.MessageTooLargeException:
>> Text message size [1173911] exceeds maximum size [1024000]. I had a large
>> output embedded in the json file.
>>
>> In terms of different browsers, I get mixed results. I tried with the URL
>> Ahyoung provided below with chrome on MacBook Pro, got same error (unable
>> to fetch url), then I downloaded the json file to local drive, imported as
>> json file, succeed. Then I tried to import from URL again, it worked.
>> Tried with firefox, import from URL failed with "Unable to fetch from URL”
>> error, import as json worked.
>>
>> anyway, a more user friendly error message/status will help.
>>
>> Thanks
>> Herman.
>>
>>
>> On Sep 25, 2016, at 07:48, Flayranalytics 
>> wrote:
>>
>> Hi Herman,
>>
>> I experienced this issue as well with google chrome. I tried on safari
>> and was able to upload as button was there. If you haven't already try
>> safari or Firefox?
>>
>> Best,
>> Mark
>>
>> Sent from my iPhone
>>
>> On 23 Sep 2016, at 19:30, Herman Yu  wrote:
>>
>> I am having issues importing a notebook. If I chose to upload a file,
>> after select the json file from my local drive, nothing happens, there is
>> no button to next step; if I chose to ‘add by url’ and provide a url to a
>> valid json file (http://myserver/notebook.json), I get an error saying
>> “unable to fetch url”. I tried both 0.6 and 0.6.1, same error.
>>
>> zeppelin document doesn’t seem to have a page for this function. Anybody
>> can share some lights here?
>>
>> Thanks
>> Herman.
>>
>>
>>
>>
>


Re: Import notebook

2016-09-25 Thread Ahyoung Ryu
Hi Herman,

Thanks for sharing your issue.
I tried to reproduce it both in 0.6.0 & 0.6.1 version, but wasn't able to.
I can import my notebook file(I attached it in this mail) in both version.
If the notebook is imported with no problems, the dialog will be closed
automatically. No need any next buttons. "add by url" was same. I can
import my notebook using URL. Here is a notebook url link[1] that I tested.
Could you try this link in your Zeppelin?
One possible reason is "Invalid json format" i think. Compare your notebook
json file format with mine. Or check the error log files generated when you
try to import a notebook.  They are under ZEPPELIN_HOME/logs/*.logs.out or
*logs.log.

Regarding "Zeppelin documentation for this feature", here is related
section[2] in "Explore Apache Zeppelin UI" docs page. But sadly there is
not much information to resolve your issue.

[1]
https://raw.githubusercontent.com/AhyoungRyu/spark-notebook-example/master/zeppelin-notebook/2B3QSZTKR/note.json
[2]
http://zeppelin.apache.org/docs/0.6.1/quickstart/explorezeppelinui.html#main-home

Hope this helps.

Best regards,
Ahyoung

2016년 9월 24일 (토) 오전 3:31, Herman Yu 님이 작성:

> I am having issues importing a notebook. If I chose to upload a file,
> after select the json file from my local drive, nothing happens, there is
> no button to next step; if I chose to ‘add by url’ and provide a url to a
> valid json file (http://myserver/notebook.json), I get an error saying
> “unable to fetch url”. I tried both 0.6 and 0.6.1, same error.
>
> zeppelin document doesn’t seem to have a page for this function. Anybody
> can share some lights here?
>
> Thanks
> Herman.
>
>
>


note.json
Description: application/json


Re: [ANNOUNCE] Apache Zeppelin 0.6.1 released

2016-08-16 Thread Ahyoung Ryu
Congratulations, the Apache Zeppelin team & all community members! [image:
]



> Congratulations !!!
>
> Great turn around with required spark 2.0 support and fix for SparkR with
> Spark2.0.
>
> Regards,
> Sourav
>
> On Tue, Aug 16, 2016 at 2:02 AM, Hyung Sung Shim 
> wrote:
>
>> Congratulations for 0.6.1 release!
>> Thank you for everyone especially mina.
>>
>> 2016-08-16 16:57 GMT+09:00 Mina Lee :
>>
>>> The Apache Zeppelin community is pleased to announce the availability of
>>> the 0.6.1 release.
>>>
>>> Zeppelin is a collaborative data analytics and visualization tool for
>>> distributed, general-purpose data processing system such as Apache Spark,
>>> Apache Flink, etc.
>>>
>>> The community put significant effort into improving Apache Zeppelin since
>>> the last release, focusing on supporting Scala 2.11 and Spark 2.0.
>>> 22 contributors provided 80+ patches for new features, improvements
>>> and bug fixes. More than 60+ issues have been resolved.
>>>
>>> We encourage download the latest release from
>>> http://zeppelin.apache.org/download.html
>>>
>>> Release note is available at
>>> http://zeppelin.apache.org/releases/zeppelin-release-0.6.1.html
>>>
>>> We welcome your help and feedback. For more information on the project
>>> and
>>> how to get involved, visit our website at http://zeppelin.apache.org/
>>>
>>> Thanks to all users and contributors who have helped to improve Apache
>>> Zeppelin.
>>>
>>> Regards,
>>> The Apache Zeppelin community
>>>
>>
>>
>


Re: Zeppelin graph off the page to the right (or truncated)

2016-07-28 Thread Ahyoung Ryu
Hi Carmella,

It would be better to provide some gif or png image files if possible. Then
other users can understand your situation and help you more quickly :)

Thanks,
Ahyoung


2016년 7월 28일 (목) 오전 6:57, Carmella Smith 님이
작성:

> Hello Users Group,
>
> I have asked Zeppelin to draw a line graph on data from  3/1/2016 to
> 7/1/2016.  I see 3/1/2016 at the bottom far left, and a lovely graph with
> labels left to right across the bottom at 3/6, 3/11, 3/16, 3/21, 3/26,
> 3/31, 4/6 and 4/11, and then we run out of screen.  I expected a slider to
> move to the right to see the rest, but I am not finding any way to slide
> right.  The small triangle at the bottom right seems to be only for up and
> down, not right and left.
>
> Is it truncated and thus it will be impossible to see it?
> Is it off to the right and I need to learn how to get there?
> Is there a way to squeeze the accordion in the left-right axis to scoot
> each data point closer together and thus fit more in the same amount of
> space?
> Do I have too many data points?  This example has 3,240.
> Something else?
>
> Thanks so much for your help,
> Carmella Smith
>
>
>


Re: Where can I find error logs?

2016-07-21 Thread Ahyoung Ryu
Hi James,

You can find all of log files under logs/ directory.
Hope it helps :)

Thanks,
Ahyoung

2016년 7월 22일 (금) 오후 3:33, James Adams 님이 작성:

> I attempted to run the zeppelin-daemon process but it failed very quickly
> after it started. The only output I saw in the bash terminal is below:
>
> Zeppelin start [  OK  ]
> Zeppelin process died  [FAILED]
>
> Where can I look for clues as to what went wrong, i.e. where are Zeppelin
> errors logged?
>
> Thanks in advance for your help.
>
> --James
>


Re: Change default interpreter to pyspark

2016-07-18 Thread Ahyoung Ryu
Hi Jayant,

I tested as you said, and can't change the default interpreter as well. So
I created issue for this in ZEPPELIN-1209
.
Thanks for reporting the issue.

Best regards,
Ahyoung

2016년 7월 19일 (화) 오전 6:54, Jayant Raj 님이 작성:

> Zeppelin has the Scala interpreter assigned as the default for Spark
> notebooks. This default setting creates an additional step if you are to
> write code using PySpark. You will need to insert a %pyspark at the
> beginning of each row of the notebook, for Zeppelin to understand that this
> is PySpark code.
>
> I modified the 'zeppelin.interpreters' property in zeppelin-site.xml and
> restarted the Zeppelin process. However, I do not see the default
> interpreter change. Am I missing something?
>
> Thanks for any help​
>
> .
>


Re: Cannot import a note

2016-06-17 Thread Ahyoung Ryu
Hi Sang-Min,

Regarding JIRA issue creation button, did you login with your account?
Once you login to JIRA, then you can easily find *Create *red button at the
middle of top.

Thanks,
Ahyoung

2016년 6월 17일 (금) 오전 1:10, Sang-Min Yoon 님이 작성:

> Import fails with following exception
>
>
>
>> com.google.gson.JsonSyntaxException: 2016-06-16T04:39:11+
>> at
>> com.google.gson.internal.bind.DateTypeAdapter.deserializeToDate(DateTypeAdapter.java:81)
>> at
>> com.google.gson.internal.bind.DateTypeAdapter.read(DateTypeAdapter.java:66)
>> at
>> com.google.gson.internal.bind.DateTypeAdapter.read(DateTypeAdapter.java:41)
>> at
>> com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
>> at
>> com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
>> at
>> com.google.gson.internal.bind.TypeAdapterRuntimeTypeWrapper.read(TypeAdapterRuntimeTypeWrapper.java:40)
>> at
>> com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:81)
>> at
>> com.google.gson.internal.bind.CollectionTypeAdapterFactory$Adapter.read(CollectionTypeAdapterFactory.java:60)
>> at
>> com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$1.read(ReflectiveTypeAdapterFactory.java:93)
>> at
>> com.google.gson.internal.bind.ReflectiveTypeAdapterFactory$Adapter.read(ReflectiveTypeAdapterFactory.java:172)
>> at com.google.gson.Gson.fromJson(Gson.java:791)
>> at
>> org.apache.zeppelin.notebook.Notebook.importNote(Notebook.java:199)
>> at
>> org.apache.zeppelin.socket.NotebookServer.importNote(NotebookServer.java:650)
>> Caused by: java.text.ParseException: Unparseable date:
>> "2016-06-16T04:39:11+"
>> at java.text.DateFormat.parse(DateFormat.java:366)
>> at
>> com.google.gson.internal.bind.DateTypeAdapter.deserializeToDate(DateTypeAdapter.java:79)
>>
>>
> It seems date format is the cause.
>
> Dates in exported json from release version are like "Apr 19, 2016
> 12:04:58 PM",
> but dates in exported json from snapshot version are like
> "2016-06-15T14:39:04+".
>
> I found a similar issue (
> https://issues.apache.org/jira/browse/ZEPPELIN-905 ) and PR (
> https://github.com/apache/zeppelin/pull/933 ),
> but it seems its focus is different.
>
>
> PS)
> I try to open an issue for this problem, but I cannot find an issue
> creation button. Is it a problem of Apache JIRA or me?
>


Re: Shiro Hides Interpreter Settings

2016-06-10 Thread Ahyoung Ryu
Hi Tom,

Yeah it really makes sense i think. Not only you but many other people want
to do that.
So I tested this case and created a issue in Jira
 and created a patch
 for this.
It would be appreciate if you check this out :)

Best,
Ahyoung



2016년 6월 10일 (금) 오전 7:22, Tom Norden 님이 작성:

> I think i answered my own question.  I had to block the calls to the api
> to make it work.
>
> [users]
> admin = admin123, admin
> user = user123
>
> [urls]
> /api/version = anon
> /api/interpreter/** = authc, roles[admin]
> /api/configurations/** = authc, roles[admin]
> /api/credential/** = authc, roles[admin]
> /** = authc
>
>
> On Fri, Jun 10, 2016 at 8:08 AM, Tom Norden  wrote:
>
>> I have been trying to figure out how to get shiro to hide the Interpreter
>> settings page for certain users but can't seem to figure it out.  I have
>> tried using roles and have my shiro.ini looking something like this.
>>
>> [users]
>> admin = admin123, admin
>> user = user123
>>
>> [urls]
>> /api/version = anon
>> /interpreter = authc, roles[admin]
>> /** = authc
>>
>> I would expect this to allow "user" to see every thing but /interpreter,
>> however both "admin" and "user" can see the interpreter settings.  My goal
>> here is hide the Interpreter settings from some users as it contains some
>> credentials I don't want to most users to see.
>>
>> Thanks,
>> Tom
>>
>
>


Re: homepage ng-hide Zeppelin 0.5.6

2016-06-06 Thread Ahyoung Ryu
Hi Moonssang,

It seems you downloaded Zeppelin-0.5.6 binary version, but you were looking
for 0.6.0 version docs.
AFAIK, there is no authentication feature in 0.5.6 version. If you want to
configure authentication with nginx reverse proxy setting, you have to
build from source. Please check this out :
https://github.com/apache/incubator-zeppelin/blob/master/README.md

Hope this helps :)

Thanks,
Ahyoung

2016년 5월 31일 (화) 오후 11:27, yupeng 님이 작성:

> Hi,All:
>
>
> I download the release zeppelin-0.5.6-incubating-bin-all and run
> successful in localhost ,but when i set nginx reverse proxy like
> https://zeppelin.incubator.apache.org/docs/0.6.0-incubating-SNAPSHOT/security/authentication.html
>  .it
> cannot show main part of homepage. the part of html is
>
> ```
>
> div ng-show=“home.staticHome" class="box width-full home ng-hide”
>
> ```
>
>  which normal is not "ng-hide”. js code is
>
> ```
>
> [ng\:cloak], [ng-cloak], [data-ng-cloak], [x-ng-cloak], .ng-cloak,
> .x-ng-cloak, .ng-hide:not(.ng-hide-animate) {
>
> /* display: none !important; */
>
> }
>
> ```
>
> and I turn on this line "display: none !important;” ,the main part of
> homepage appears, but create note doesn’t work.
>
>
> Can anyone tell me what's wrong?
>
>
> Regards,
>
> Moonssang
>


Re: The Apache Software Foundation Announces Apache(R) Zeppelin™ as a Top-Level Project

2016-05-25 Thread Ahyoung Ryu
Congratulate all Zeppelin folks! Surely deserved it 👍

On Thursday, 26 May 2016, Dafeng Wang  wrote:

> Congratulations!
>
>
>
> *From:* moon soo Lee [mailto:m...@apache.org
> ]
> *Sent:* Wednesday, May 25, 2016 9:56 PM
> *To:* us...@zeppelin.incubator.apache.org
> ;
> d...@zeppelin.incubator.apache.org
> 
> *Subject:* The Apache Software Foundation Announces Apache(R) Zeppelin™
> as a Top-Level Project
>
>
>
> Congratulations and thank you everyone who made it possible!
>
>
>
> -- Forwarded message -
> From: Sally Khudairi  >
> Date: Wed, May 25, 2016 at 3:04 AM
> Subject: The Apache Software Foundation Announces Apache® Zeppelin™ as a
> Top-Level Project
> To: Apache Announce List  >
>
>
>
>  >> this announcement is available online at https://s.apache.org/YqqP
> 
>
> Open Source Big Data analytics and visualization tool for distributed,
> interactive, and collaborative systems using Apache Flink, Apache Hadoop,
> Apache Spark, and more.
>
> Forest Hill, MD –25 May 2016– The Apache Software Foundation (ASF), the
> all-volunteer developers, stewards, and incubators of more than 350 Open
> Source projects and initiatives, announced today that Apache® Zeppelin™ has
> graduated from the Apache Incubator to become a Top-Level Project (TLP),
> signifying that the project's community and products have been
> well-governed under the ASF's meritocratic process and principles.
>
> Apache Zeppelin is a modern, web-based notebook that enables interactive
> data analytics. Notebooks help developers, data scientists, and related
> users to handle data efficiently without worrying about command lines and
> cluster details.
>
> "The Zeppelin community is pleased to graduate from the Apache Incubator,"
> said Lee Moon Soo, Vice President of Apache Zeppelin. "With 118 worldwide
> contributors and widespread adoption in numerous commercial products, we
> are proud to officially be a part of the Apache Big Data ecosystem."
>
> Zeppelin's collaborative data analytics and visualization capabilities
> makes data exploration, visualization, sharing, and collaboration easy over
> distributed, general-purpose data processing systems that use Apache Flink,
> Apache Hadoop, and Apache Spark, among other Big Data platforms.
>
> Apache Zeppelin is:
>  - Multi-purpose --features data ingestion, exploration, analysis,
> visualization, and collaboration;
>  - Robust --supports 20+ more backend systems, including Apache Spark,
> Apache Flink, Apache Hive, Python, R, and any JDBC (Java Database
> Connectivity);
>  - Easy to deploy --built on top of modern Web technologies (provides
> built-in Apache Spark integration, eliminating the need to build a separate
> module, plugin, or library);
>  - Easy to use --with built-in visualizations and dynamic forms;
>  - Flexible --allows users to mix different languages, exchange data
> between backends, adjust the layout;
>  - Extensible --with pluggable architecture for interpreters, notebook
> storages, authentication, and visualizations (in progress); and
>  - Advanced --allows interaction between custom visualizations and cluster
> resources
>
> "With Apache Zeppelin, a wide range of users can make beautiful
> data-driven, interactive, and collaborative documents with SQL, Scala, and
> more," added Soo.
>
> Apache Zeppelin is in use at an array of organizations and solutions,
> including Amazon Web Services, Hortonworks, JuJu, and Twitter, among others.
>
> "Congratulations to Apache Zeppelin community on graduation," said Tim
> Hall, Vice President of Product Management at Hortonworks. "Several members
> of our team have been working over the past year in the Zeppelin community
> to make it enterprise ready. We are excited to be associated with this
> community and look forward to helping our customers get the best insights
> out of their data with Apache Zeppelin."
>
> "Apache Zeppelin is becoming an important tool at Twitter for creating and
> sharing interactive data analytics and visualizations," said Prasad Wagle,
> Technical Lead in the Data Platform team at Twitter. "Since it integrates
> seamlessly with all the popular data analytics engines, it is very easy to
> create and share reports and dashboards. With its extensible architecture
> and a vibrant Open Source community, I am looking forward to Apache
> Zeppelin advancing the state of the art in data analytics and
> visualization."
>
> "Apache Zeppelin is the major user-facing piece of Memcore’s in-memory
> data processing Cloud offering. Building a technology stack might be quite
> exciting engineering challenge, however, if users can’t visualize and work
> with the data conveniently, it is as good as not having the data at all.
> Apache Zeppelin enables