Re: Weird problem with notebook permissions, can change them eve if I'm not owner

[Raffaele S]

Hello, if this is the case, can you please open a JIRA issue?

Raffaele

2017-09-08 18:18 GMT+02:00 Luis Angel Vicente Sanchez <
zeppelin-us...@bigcente.ch>:

> Ok... problem found, zeppelin.anonymous.enabled was not set to false. I
> would say that the message saying that it's ignoring the owner of a
> notebook because the anonymous access is enabled should be an INFO level
> message and not a DEBUG one.
> --
>   Luis Angel Vicente Sanchez
>   zeppelin-us...@bigcente.ch
>
> On Fri, 8 Sep 2017, at 16:00, Luis Angel Vicente Sanchez wrote:
> > I found that the "Cannot change permissions is always printed even if
> > you have the rights to change the permissions. But anyway, I can change
> > permissions even if I only have read access. Check the following log
> > messages:
> >
> >  INFO [2017-09-08 14:28:41,045] ({qtp1753447031-3709}
> >  NotebookRestApi.java[ownerPermissionError]:109) - Cannot change
> >  permissions. Connection owners [client2]. Allowed owners [client1]
> >  INFO [2017-09-08 14:28:41,045] ({qtp1753447031-3709}
> >  NotebookRestApi.java[putNotePermissions]:207) - Set permissions
> >  2CRXM67WA client2 [client1 ] [client2 ] [client1 ]
> >
> > client1 and client2 have different roles (one is analyst the other is
> > user) so... I shouldn't be allowed to change the permissions.
> >
> > This is on Zeppelin 0.7.1
> >
> > --
> >   Luis Angel Vicente Sanchez
> >   zeppelin-us...@bigcente.ch
> >
> > On Fri, 8 Sep 2017, at 14:57, Luis Angel Vicente Sanchez wrote:
> > > Hi,
> > >
> > > I found that I can change permission of notebooks even if I only have
> > > read access using the UI or sending calls to the REST API. I have
> tested
> > > this against Zeppelin 0.7.1
> > >
> > > If I check the logs I can see lots of line like these ones:
> > >
> > >  INFO [2017-09-08 13:52:33,140] ({qtp1753447031-2786}
> > >  NotebookRestApi.java[ownerPermissionError]:109) - Cannot change
> > >  permissions. Connection owners [admin]. Allowed owners [admin,
> analyst]
> > >  INFO [2017-09-08 13:52:33,140] ({qtp1753447031-2786}
> > >  NotebookRestApi.java[putNotePermissions]:207) - Set permissions
> > >  2CGGE4ETT admin [admin, analyst] [admin, analyst] [admin, analyst]
> > >
> > > I get those errors in the logs even if I'm the owner.
> > >
> > > Regards,
> > >
> > > Luis Angel Vicente Sanchez
> > > zeppelin-us...@bigcente.ch
>

Re: [DISCUSS] Release 0.8.0

[Raffaele S]

I still think this is the best course, we should proceed in that direction.

Raffaele

2017-07-20 17:52 GMT+02:00 Khalid Huseynov :

> Thanks for starting discussion on 0.8.0 release. I also think that need to
> concentrate on solving the issues blocking release and link the issues
> community considers important for it under the umbrella issue you
> mentioned.
>
> Further regarding stable and latest release, here's one example how it
> looks like in redis for instance https://redis.io/download
>
>
>
> On Mon, Jul 17, 2017 at 3:11 AM, Park Hoon <1am...@gmail.com> wrote:
>
>> Hi, @user and @dev.
>>
>> Recently, The last major release was about 5 months ago and many new
>> features bug fixes have been implemented / applied for few months.
>>
>> Even though all features discussed in the thread before (“Roadmap for
>> 0.8.0”[1]), some are available now.
>>
>> So I think we can release 0.8.0 as the latest one while keeping 0.7.2 as
>> the most stable one as @moon suggested in the “Roadmap for 0.8.0” mailing
>> thread.
>>
>> Shall we proceed to 0.8.0?
>>
>> Here is the umbrella issue for the release 0.8.0. If you have issues to be
>> shared, Please add them to the ticket.
>>
>> - https://issues.apache.org/jira/browse/ZEPPELIN-2385
>>
>> [1]
>> https://lists.apache.org/thread.html/f4be5635e6e72d2a9dc2377
>> 1ceeaef8a8e5933bfb14db7cab303bc22@%3Cdev.zeppelin.apache.org%3E
>>
>> Regard,
>>
>
>

Re: Use Bokeh in Apache Zeppelin

[Raffaele S]

This is something I was looking for, thanks!

2017-07-02 1:39 GMT+02:00 moon soo Lee :

> Cool. Thanks for sharing!
>
> On Sun, 2 Jul 2017 at 8:00 AM Jeff Zhang  wrote:
>
>>
>> I write a tutorial on using bokeh in apache zeppelin. If you are
>> interested in data visualization in zeppelin notebook, bokeh would be a
>> very good library for you. And you can take a look at the tutorial here.
>>
>> https://community.hortonworks.com/articles/109837/use-bokeh-
>> in-apache-zeppelin.html
>>
>>
>>

Plot over a million points

[Raffaele S]

Hello,

I am currently working  on time series using a Spark infrastructure and I
am trying to display multiple time series (millions of points) using
Zeppelin.

The first thing I tried is to increase *zeppelin.spark.maxResult* value but
this leads to high memory usage, lag and crashes.

Is there a way to display these points interactively using Zeppelin?


Thanks.

Raffaele

Re: Recent Improvements Apache Zeppelin Livy Integration

[Raffaele S]

Also, any news about Toree?

2017-05-05 7:38 GMT+02:00 Ruslan Dautkhanov :

> Thanks for sharing this Jeff!
>
> Once Zeppelin supports yarn-cluster, what would be main benefits of using
> Livy Spark interpreters, instead of just the Spark interpreters?
>
>
>
> --
> Ruslan Dautkhanov
>
> On Thu, May 4, 2017 at 10:51 PM, Jeff Zhang  wrote:
>
>> For anyone that is using or interested in livy interpreter
>>
>> https://hortonworks.com/blog/recent-improvements-apache-zepp
>> elin-livy-integration/
>>
>>
>>
>

Re: Zeppelin build from source

[Raffaele S]

This might be a bug with the latest master on git, could you try building
Zeppelin stable (0.7.1)?

2017-04-21 17:59 GMT+02:00 Swapnil Shinde :

> Hello Everyone
>  I am new to zeppelin world and trying to build zeppelin source code
> for the first time. I am building it in *windows* platform. Below are the
> steps I followed to build and difficuties/workaround I faced-
>
> *1. Update pom.xml to use scala 2.11. (Successful)*
>
> ./dev/change_scala_version.sh 2.11
>
>
> *2. Build (Error)*
>
> mvn clean package -DskipTests -Pmapr51 -Pspark-2.0 -Dspark.version=2.0.1
> -Phadoop-2.7 -Pscala-2.11 -Pr -Pexamples
>
> Above command was running until zepplin-web build. zeppelin-web was
> stuck at log "*npm clean run*" at "*yarn run build*" for very long time.
> I tried to build it using cygwin just in case but no luck.
>
> *Workaround* - Then I followed instructions in readme.md to build it step
> by step -
>
>
> # install required depepdencies and bower packages (only once)
> $ npm install -g yarn
> $ yarn install
>
> # build zeppelin-web for production
> $ yarn run build
>
>
> Above commands run fine but "mvn clean package" under zeppelin-web is
> still hanging.
>
> Therefore, I build zepplin-web with step by step commands and then removed
> zeppling web as module from parent pom. If I run "mvn clean package
> -DskipTests" on parent pom (entire zeppeling project) it throws error while
> building zeppelin-server.
>
>
> *Error message - *
>
>
> INFO] Reactor Summary:
> [INFO]
> [INFO] Zeppelin .. SUCCESS [
>  3.193 s]
> [INFO] Zeppelin: Interpreter . SUCCESS [
>  4.445 s]
> [INFO] Zeppelin: Zengine . SUCCESS [
>  3.456 s]
> [INFO] Zeppelin: Display system apis . SUCCESS [
>  0.772 s]
> [INFO] Zeppelin: Spark dependencies .. SUCCESS [
> 47.962 s]
> [INFO] Zeppelin: Groovy interpreter .. SUCCESS [
>  0.349 s]
> [INFO] Zeppelin: Spark ... SUCCESS [
>  4.724 s]
> [INFO] Zeppelin: Markdown interpreter  SUCCESS [
>  0.503 s]
> [INFO] Zeppelin: Angular interpreter . SUCCESS [
>  0.341 s]
> [INFO] Zeppelin: Shell interpreter ... SUCCESS [
>  0.345 s]
> [INFO] Zeppelin: Livy interpreter  SUCCESS [
>  4.095 s]
> [INFO] Zeppelin: HBase interpreter ... SUCCESS [
>  1.838 s]
> [INFO] Zeppelin: Apache Pig Interpreter .. SUCCESS [
>  1.681 s]
> [INFO] Zeppelin: JDBC interpreter  SUCCESS [
>  0.678 s]
> [INFO] Zeppelin: File System Interpreters  SUCCESS [
>  0.602 s]
> [INFO] Zeppelin: Flink ... SUCCESS [
>  1.255 s]
> [INFO] Zeppelin: Apache Ignite interpreter ... SUCCESS [
>  0.427 s]
> [INFO] Zeppelin: Kylin interpreter ... SUCCESS [
>  0.312 s]
> [INFO] Zeppelin: Python interpreter .. SUCCESS [
>  1.918 s]
> [INFO] Zeppelin: Lens interpreter  SUCCESS [
>  1.325 s]
> [INFO] Zeppelin: Apache Cassandra interpreter  SUCCESS [
>  5.904 s]
> [INFO] Zeppelin: Elasticsearch interpreter ... SUCCESS [
>  1.269 s]
> [INFO] Zeppelin: BigQuery interpreter  SUCCESS [
>  0.457 s]
> [INFO] Zeppelin: Alluxio interpreter . SUCCESS [
>  1.118 s]
> [INFO] Zeppelin: Scio  SUCCESS [
> 17.768 s]
> [INFO] Zeppelin: Server .. FAILURE [
>  1.681 s]
> [INFO] Zeppelin: Packaging distribution .. SKIPPED
> [INFO] 
> 
> [INFO] BUILD FAILURE
> [INFO] 
> 
> [INFO] Total time: 01:48 min
> [INFO] Finished at: 2017-04-21T10:43:26-05:00
> [INFO] Final Memory: 106M/1708M
> [INFO] 
> 
> *[ERROR] Failed to execute goal
> org.apache.maven.plugins:maven-enforcer-plugin:1.3.1:enforce (enforce) on
> project zeppelin-server:
> org.apache.maven.plugins.enforcer.DependencyConvergence failed with
> message:*
> *[ERROR] Failed while enforcing releasability the error(s) are [*
> *[ERROR] Dependency convergence error for
> org.scala-lang.modules:scala-xml_2.11:1.0.4 paths to dependency are:*
> *[ERROR] +-org.apache.zeppelin:zeppelin-server:0.8.0-SNAPSHOT*
> *[ERROR] +-org.scala-lang:scala-compiler:2.11.7*
> *[ERROR] +-org.scala-lang.modules:scala-xml_2.11:1.0.4*
> *[ERROR] and*
> *[ERROR] +-org.apache.zeppelin:zeppelin-server:0.8.0-SNAPSHOT*
> *[ERROR] +-org.scalatest:scalatest_2.11:2.2.4*
> *[ERROR] +-org.scala-lang.modules:scala-xml_2.11:1.0.2*
> *[ERROR] ]*
> [ERROR] -> [Help 1]
>
>
> I am not sure how to fix this enforcer plugin 

Re: Could not resolve dependencies for project org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT

[Raffaele S]

If the script is not sufficient, please downgrade your scala version to
2.11.
Scala 2.12 is not officially supported.

Raffaele

2017-04-21 3:54 GMT+02:00 Kang Minwoo :

> Thanks, I will try that.
>
> Best regards,
> Minwoo Kang
>
> 
> 보낸 사람: Ahyoung Ryu 
> 보낸 날짜: 2017년 4월 21일 금요일 오전 12:14:26
> 받는 사람: users@zeppelin.apache.org
> 제목: Re: Could not resolve dependencies for project
> org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
>
> Hi Minwoo,
>
> Have you tried to run "ZEPPELIN_HOME/dev/change_scala_version.sh 2.11"
> before run your build command?
> The script file will update all pom.xml files to scala 2.11.
>
> Please refer to https://zeppelin.apache.org/docs/latest/install/build.
> html#2-build-source
>
> Ahyoung
>
> On Thu, Apr 20, 2017 at 9:49 PM, Kang Minwoo  mailto:minwoo.k...@outlook.com>> wrote:
> - OS version
> macOS Sierra 10.12.4
>
> - JDK, scala version
> java version "1.8.0_121"
> Java(TM) SE Runtime Environment (build 1.8.0_121-b13)
> Java HotSpot(TM) 64-Bit Server VM (build 25.121-b13, mixed mode)
>
> scala -version
> Scala code runner version 2.12.2 -- Copyright 2002-2017, LAMP/EPFL and
> Lightbend, Inc.
>
> - build command
> mvn clean package -DskipTests -Phadoop-2.7 -Pscala-2.11 -X
>
> Best regards,
> Minwoo Kang
>
> 
> 보낸 사람: Park Hoon <1am...@gmail.com>
> 보낸 날짜: 2017년 4월 20일 목요일 오후 9:43:25
> 받는 사람: users@zeppelin.apache.org
> 제목: Re: Could not resolve dependencies for project
> org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT
>
> Hi, minwoo.
>
> Could you describe your env including build command?
>
> - OS version
> - JDK, scala version
> - build command
>
> thanks!
>
>
>
>
>
> On Thu, 20 Apr 2017 at 21:39 Kang Minwoo >> wrote:
> Hello,
>
> I got fail to build zeppelin in my local computer.
> Revision is 652911abe457d48a540be4a3de2dad824691dfb1
>
> There is maven log.
>
> [ERROR] Failed to execute goal on project zeppelin-spark_2.10: Could not
> resolve dependencies for project 
> org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT:
> Failure to find org.apache.zeppelin:zeppelin-display_2.11:jar:0.8.0-SNAPSHOT
> in http://repository.apache.org/snapshots was cached in the local
> repository, resolution will not be reattempted until the update interval of
> apache.snapshots has elapsed or updates are forced -> [Help 1]
> org.apache.maven.lifecycle.LifecycleExecutionException: Failed to execute
> goal on project zeppelin-spark_2.10: Could not resolve dependencies for
> project org.apache.zeppelin:zeppelin-spark_2.10:jar:0.8.0-SNAPSHOT:
> Failure to find org.apache.zeppelin:zeppelin-display_2.11:jar:0.8.0-SNAPSHOT
> in http://repository.apache.org/snapshots was cached in the local
> repository, resolution will not be reattempted until the update interval of
> apache.snapshots has elapsed or updates are forced
> at org.apache.maven.lifecycle.internal.
> LifecycleDependencyResolver.getDependencies(LifecycleDependencyResolver.
> java:221)
> at org.apache.maven.lifecycle.internal.
> LifecycleDependencyResolver.resolveProjectDependencies(
> LifecycleDependencyResolver.java:127)
> at org.apache.maven.lifecycle.internal.MojoExecutor.
> ensureDependenciesAreResolved(MojoExecutor.java:245)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:199)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:153)
> at org.apache.maven.lifecycle.internal.MojoExecutor.execute(
> MojoExecutor.java:145)
> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> buildProject(LifecycleModuleBuilder.java:116)
> at org.apache.maven.lifecycle.internal.LifecycleModuleBuilder.
> buildProject(LifecycleModuleBuilder.java:80)
> at org.apache.maven.lifecycle.internal.builder.singlethreaded.
> SingleThreadedBuilder.build(SingleThreadedBuilder.java:51)
> at org.apache.maven.lifecycle.internal.LifecycleStarter.
> execute(LifecycleStarter.java:128)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:307)
> at org.apache.maven.DefaultMaven.doExecute(DefaultMaven.java:193)
> at org.apache.maven.DefaultMaven.execute(DefaultMaven.java:106)
> at org.apache.maven.cli.MavenCli.execute(MavenCli.java:863)
> at org.apache.maven.cli.MavenCli.doMain(MavenCli.java:288)
> at org.apache.maven.cli.MavenCli.main(MavenCli.java:199)
> at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
> at sun.reflect.NativeMethodAccessorImpl.invoke(
> NativeMethodAccessorImpl.java:62)
> at sun.reflect.DelegatingMethodAccessorImpl.invoke(
> DelegatingMethodAccessorImpl.java:43)
>   

Re: no interpreters

[Raffaele S]

Hello,

NPMs are optional so there is no need to download them.

Can you please post a full log (*.log, *out)?

Raffaele


2017-04-03 23:54 GMT+02:00 Knapp, Michael :

> Zeppelin Developers,
>
>
>
> I am struggling to get Zeppelin to work.  I am running version 0.7.1 on an
> amazon linux EC2 instance.  I used the binary package with all
> interpreters.  I am running this as the anonymous user.  Please keep in
> mind two things:
>
> 1.   We are using proxies, so if the app must download NPM, then I
> will at least need to configure it to use a proxy.  I saw no documentation
> on that on your website.
>
> 2.   Depending on the amazon instance’s security groups, I may not be
> able to download npm packages anyways.  This is why I upgraded to 0.7.1, so
> I will not be required to do that.
>
>
>
> When I start Zeppelin, it appears to be empty.  If I click the “Notebook”
> drop down menu, no notebooks seem to exist, while the logs state that six
> of them were created for the tutorial.  I see these lines in my logs:
>
>
>
>  INFO [2017-04-03 21:35:34,675] ({main} Folder.java[addNote]:184) - Add
> note 2BWJFTXKJ to folder Zeppelin Tutorial
>
>  INFO [2017-04-03 21:35:34,690] ({main} Folder.java[addNote]:184) - Add
> note 2C57UKYWR to folder Zeppelin Tutorial
>
>  INFO [2017-04-03 21:35:34,783] ({main} Folder.java[addNote]:184) - Add
> note 2C35YU814 to folder Zeppelin Tutorial
>
>  INFO [2017-04-03 21:35:34,799] ({main} Folder.java[addNote]:184) - Add
> note 2A94M5J1Z to folder Zeppelin Tutorial
>
>  INFO [2017-04-03 21:35:34,814] ({main} Folder.java[addNote]:184) - Add
> note 2C2AUG798 to folder Zeppelin Tutorial
>
>  INFO [2017-04-03 21:35:34,831] ({main} Folder.java[addNote]:184) - Add
> note 2BYEZ5EVK to folder Zeppelin Tutorial
>
>  INFO [2017-04-03 21:35:34,832] ({main} Notebook.java[]:127) -
> Notebook indexing started...
>
>  INFO [2017-04-03 21:35:35,100] ({main} LuceneSearch.java[addIndexDocs]:305)
> - Indexing 6 notebooks took 268ms
>
>  INFO [2017-04-03 21:35:35,106] ({main} Notebook.java[]:129) -
> Notebook indexing finished: 6 indexed in 0s
>
>
>
> If I try to create a new note, I click the “Default Interpreter” menu, and
> the only option is a check mark.  Looking through the logs, I see that many
> interpreters were registered.  I see 22 interpreters in my zeppelin
> interpreters directory.  I don’t know why none of them are options when I
> try to create a new note.
>
>
>
> Lastly, I tried creating a new note, but it seems like nothing happens.  I
> give my note a name, and click Create Note, the form disappears, but I see
> no new lines in my logs, and from the UI “Notebook” menu, the new note is
> not shown.
>
>
>
> Please help, I have no idea why this is simply not working.
>
>
>
> Michael Knapp
>
> --
>
> The information contained in this e-mail is confidential and/or
> proprietary to Capital One and/or its affiliates and may only be used
> solely in performance of work or services for Capital One. The information
> transmitted herewith is intended only for use by the individual or entity
> to which it is addressed. If the reader of this message is not the intended
> recipient, you are hereby notified that any review, retransmission,
> dissemination, distribution, copying or other use of, or taking of any
> action in reliance upon this information is strictly prohibited. If you
> have received this communication in error, please contact the sender and
> delete the material from your computer.
>

Re: Zeppelin hangs in air-gapped environments

[Raffaele S]

Should I create an Issue on JIRA for this?

2017-03-26 9:47 GMT+02:00 Eric Charles <e...@apache.org>:

> Running off-line (or in closed data centers) is now super-slow start since
> HeliumBundleFactory connects to npms.org web site on startup.
>
> If dependent website are not reachable, we should simply fast skip that
> step. What about adding a check for this?
>
> On 24/03/17 15:16, Raffaele S wrote:
>
>> Hello,
>>
>> while starting Zeppelin in an air-gapped environment, it hangs for a few
>> minutes (up to 10) on:
>>
>> WARN [2017-03-24 13:57:49,777] ({main} Helium.java[loadConf]:101) -
>> /zeppelin-server/conf/helium.json does not exists
>> ERROR [2017-03-24 14:01:27,909] ({main}
>> ZeppelinServer.java[]:131) - Running 'npm install
>> --registry=http://registry.npmjs.org/ <http://registry.npmjs.org/>'
>> in /zeppelin-server/local-repo/vis
>>
>>
>> Please note that I downloaded npm and nodejs files manually.
>>
>>
>> Is there a known solution to this problem?
>>
>>
>> Raffaele
>>
>

Zeppelin hangs in air-gapped environments

[Raffaele S]

Hello,

while starting Zeppelin in an air-gapped environment, it hangs for a few
minutes (up to 10) on:

WARN [2017-03-24 13:57:49,777] ({main} Helium.java[loadConf]:101) -
/zeppelin-server/conf/helium.json does not exists
ERROR [2017-03-24 14:01:27,909] ({main} ZeppelinServer.java[]:131) -
Running 'npm install --registry=http://registry.npmjs.org/' in
/zeppelin-server/local-repo/vis


Please note that I downloaded npm and nodejs files manually.


Is there a known solution to this problem?


Raffaele