Re: [DISCUSS] Update Roadmap

@Vinayak, @Eran, @Benjamin, @Guilherme, @Sourav, @Rick Now I can see a lot of demands around enterprise level job scheduling. Either external or built-in, I completely agree having enterprise level job scheduling support on the roadmap. ZEPPELIN-137

Re: [DISCUSS] Update Roadmap

Hi, For one, I know that there is rudimentary scheduling built into Zeppelin already (at least I fixed a bug in the test for a scheduling feature a few months ago). But another point is, that Zeppelin should also focus on quality, reproduceability and portability. Although this doesn't offer

Re: OOM error when run all paragraphs

Hi Im also hitting this issue of OOM for couple of notebooks with about 6 to 7 paragraphs running Hive queries and caching 1000 records of output. Regards, Skanda On Mon, Feb 29, 2016 at 10:42 PM, moon soo Lee wrote: > Thanks for creating an issue. > Let me look into it more.

Math formula on %md model

Hi, I found both Jupyter and Gitbook(use katex or mathjax) support math formula on markdown model, so how about zeppelin? The $$ math formula $$ is not work in zeppelin. BR mufeng

Re: [DISCUSS] Update Roadmap

I do agree with Vinayak. It need not be coupled with Oozie. Rather one should be able to call it from any scheduler typically used in enterprise level. May be support for BPML. I believe the existing ability to call/execute a Zeppelin Notebook or a specific paragraph within a notebook using REST

Re: [DISCUSS] Update Roadmap

@Eran Witkon, Thanks for the suggestion Eran. I concur with your thought. If Zepplin can be integrated with oozie, that would be wonderful. Users will also be able to leverage their Oozie skills. This would be promising for now. However, in the future Hadoop might not necessarily be installed in

Re: [DISCUSS] Update Roadmap

I agree. Jobs schedulling should be a core feature. Em 29 de fev de 2016 12:15, "Benjamin Kim" escreveu: > I concur with this suggestion. In the enterprise, management would like to > see scheduled runs to be tracked, monitored, and given SLA constraints for > the mission

Re: OOM error when run all paragraphs

Thanks for creating an issue. Let me look into it more. Best, moon On Sun, Feb 28, 2016 at 10:14 PM Dafeng Wang wrote: > Thanks Moon for your effort to repro this bug, I had create a Jira > https://issues.apache.org/jira/browse/ZEPPELIN-706 for it, please let me > know

RE: problem with start H2OContent

Can you try running it from just a Spark shell to confirm it works that way (no other conflict)? bin/spark-shell --master local[*] --packages ai.h2o:sparkling-water-core_2.10:1.5.10 Also, are you able to run the Spark interpreter without the h2o package? Thanks, Silvio From: Aleksandr

Re: problem with start H2OContent

I use Spark 1.5 The problem with the external Spark with internal Spark I can not launch h2oContent :) The error is: "ERROR [2016-02-29 19:28:16,609] ({pool-1-thread-3} NotebookServer.java[afterStatusChange]:766) - Error org.apache.zeppelin.interpreter.InterpreterException:

RE: problem with start H2OContent

In your zeppelin-env you set SPARK_HOME and SPARK_SUBMIT_OPTIONS ? Anything in the logs? Looks like the interpreter failed to start. Also, Sparkling Water currently supports up to 1.5 only, last I checked. Thanks, Silvio From: Aleksandr Modestov Sent:

Re: [DISCUSS] Update Roadmap

This is a great list. In the enterprise ready section, what do you think about adding "High Availability and Disaster Recovery"? We can start with updating the documentation with best practices and scripts for a cold standby solution and work towards active-active

Re: problem with start H2OContent

When I use external Spark I get exeption: java.net.ConnectException: Connection refused at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.AbstractPlainSocketImpl.doConnect(AbstractPlainSocketImpl.java:339) at

Re: [DISCUSS] Update Roadmap

I concur with this suggestion. In the enterprise, management would like to see scheduled runs to be tracked, monitored, and given SLA constraints for the mission critical. Alerts and notifications are crucial for DevOps to respond with error clarification within it. If the Zeppelin notebooks

Re: problem with start H2OContent

It doesn’t seem to be loading transitive dependencies properly. When I was helping someone else set this up recently, I had to use SPARK_SUBMIT_OPTIONS=“--packages ai.h2o:sparkling-water-core_2.10:1.5.10” with an external Spark installation (vs using bundled Spark in Zeppelin). From: Aleksandr

Re: problem with start H2OContent

In a conf-file I wrote package but it doesn't work and I use ' z.load("...")'. On Mon, Feb 29, 2016 at 5:25 PM, vincent gromakowski < vincent.gromakow...@gmail.com> wrote: > your H2O jar is not loaded in spark classpath. Maybe retry to load with > z.load("...") or add spark.jars parameter in

Re: problem with start H2OContent

your H2O jar is not loaded in spark classpath. Maybe retry to load with z.load("...") or add spark.jars parameter in spark interpreter configuration 2016-02-29 15:23 GMT+01:00 Aleksandr Modestov : > I did import "import org.apache.spark.h2o._" > What do you mean "

Re: problem with start H2OContent

I did import "import org.apache.spark.h2o._" What do you mean " it's probably a problem with your classpath."? On Mon, Feb 29, 2016 at 5:19 PM, vincent gromakowski < vincent.gromakow...@gmail.com> wrote: > Don't forget to do the import. If done it's probably a problem with your > classpath... >

Re: problem with start H2OContent

Don't forget to do the import. If done it's probably a problem with your classpath... 2016-02-29 15:03 GMT+01:00 Aleksandr Modestov : > Hello all, > There is a problem when I start to initialize H2OContent. > Does anybody know the answer? > >

Re: h2o from zeppelin notebook

Thank you! On Mon, Feb 29, 2016 at 4:17 PM, vincent gromakowski < vincent.gromakow...@gmail.com> wrote: > if you want to auto load, go in zeppelin UI to settings, edit spark > interpreter config and ad a line in dependencies artifact... > > 2016-02-29 14:16 GMT+01:00 Aleksandr Modestov

Re: h2o from zeppelin notebook

if you want to auto load, go in zeppelin UI to settings, edit spark interpreter config and ad a line in dependencies artifact... 2016-02-29 14:16 GMT+01:00 Aleksandr Modestov : > Thank you! > It does work! > "%dep > z.load("ai.h2o:sparkling-water-core_2.10:1.3.7")" >

Re: h2o from zeppelin notebook

Thank you! It does work! "%dep z.load("ai.h2o:sparkling-water-core_2.10:1.3.7")" On Mon, Feb 29, 2016 at 3:43 PM, vincent gromakowski < vincent.gromakow...@gmail.com> wrote: > Try to use the dependency loader in Spark interpreter configuration page. > I have encountered strange behaviors with

Re: h2o from zeppelin notebook

Try to use the dependency loader in Spark interpreter configuration page. I have encountered strange behaviors with spark.jars options... 2016-02-29 13:35 GMT+01:00 Aleksandr Modestov : > Hello! > Excuse me, but it doesn't work... > I open an interpreter window and

Re: h2o from zeppelin notebook

Hello! Excuse me, but it doesn't work... I open an interpreter window and create several additional lines. spark.jars .../sparkling-water-assembly-1.5.10-all.jar spark.jars.packages ai.h2o:sparkling-water-core_2.10 Inside the notebook I try to add a h2o-lib: import org.apache.spark.h2o._ But I

AW: AW: -Dspark.jars is ignored when running in yarn-client mode, also when adding the jar with sc.addJars

Once the library is ready for release, I am going to put it on our company-internal Nexus server, but as of now, it is still work in progress. Von: Felipe Almeida [mailto:falmeida1...@gmail.com] Gesendet: Sonntag, 28. Februar 2016 00:23 An: users@zeppelin.incubator.apache.org Betreff: Re: AW:

Re: NoClassDefFoundError: Lorg/apache/zeppelin/spark/ZeppelinContext

Sorry guys, I have made a mistake in zeppelin configuration that removed zeppelin-spark.jar from the classpath... 2016-02-29 12:07 GMT+01:00 vincent gromakowski < vincent.gromakow...@gmail.com>: > Hi all, > I am getting this strange error > > java.lang.NoClassDefFoundError:

NoClassDefFoundError: Lorg/apache/zeppelin/spark/ZeppelinContext

Hi all, I am getting this strange error java.lang.NoClassDefFoundError: Lorg/apache/zeppelin/spark/ZeppelinContext; at java.lang.Class.getDeclaredFields0(Native Method) at java.lang.Class.privateGetDeclaredFields(Class.java:2583) at

Re: [DISCUSS] Update Roadmap

@Vinayak Agrawal I would suggest adding the ability to connect zeppelin to existing scheduling tools\workflow tools such as https://oozie.apache.org/. this requires betters hooks and status reporting but doesn't make zeppeling and ETL\scheduler tool by itself/ On Mon, Feb 29, 2016 at 10:21 AM

Re: sharing angular variable to scala interpreter in zepelin

Thanks.. It helped Regards Bala On 24-Feb-2016 10:19 pm, "moon soo Lee" wrote: > Hi, > > Once an AngularObject is created, updated value from front-end side > (angular interpreter) automatically propagated to the back-end side. So > SparkInterpreter can read it using

Re: [DISCUSS] Update Roadmap

Moon, The new roadmap looks very promising. I am very happy to see security in the list. I have some suggestions regarding Enterprise Ready features: 1. Job Scheduler - Can this be improved? Currently the scheduler can be used with Cron expression or a pre-set time. But in an enterprise solution,