Re: Interpreter behavior

2018-11-08 Thread Jeff Zhang
There's no standard way to calculate the memory requirement for driver. It depends on your app, e.g if you want to fetch large data into driver, then you'd better to set a large value for driver memory. Regarding running paragraphs simultaneously, for scala/python/r code, the execution in one

Re: Interpreter behavior

2018-11-08 Thread Ajay Viswanathan
I use version 0.7.3. I have been trying to investigate the reasons for the timeouts. I was trying to tune the number of cores available. Now that you've mentioned the driver memory issue, I'll try it out again and let you know if that solves the problem. What would be a back-of-the-envelope

Re: Interpreter behavior

2018-11-08 Thread Ajay Viswanathan
This is an issue even I am facing in my project currently. By running the spark interpreter in Scoped + Per Note mode, I do manage to execute paragraphs in parallel, but it becomes very resource intensive and times out if I run more than 3-4 jobs in parallel on a 4-core cloud instance. Typically a

[jira] [Created] (ZEPPELIN-3857) Spark 2.4.0 and Scala 2.12

2018-11-08 Thread antonkulaga (JIRA)
antonkulaga created ZEPPELIN-3857: - Summary: Spark 2.4.0 and Scala 2.12 Key: ZEPPELIN-3857 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3857 Project: Zeppelin Issue Type: Improvement

[GitHub] zeppelin issue #3113: [ZEPPELIN-3616] fix editor sections auto-collapse

2018-11-08 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue: https://github.com/apache/zeppelin/pull/3113 Will merge this, if no more discussion. ---

[GitHub] zeppelin issue #3206: [ZEPPELIN-3810] Support Spark 2.4

2018-11-08 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3206 Thanks for everyone, the only remaining thing is to update `.travis.yml` to make sure the test pass again spark 2.4 ---

Re: Interpreter behavior

2018-11-08 Thread Jeff Zhang
Which version do you use ? This seems a bug. Each note should have its own scheduler in scoped per note mode. 于2018年11月9日周五 上午1:56写道: > Hi > > We use zeppelin in multi-user environment, the interpreter scope mode > seems to allow notebook execution in serial only. If multiple users are > running

[jira] [Created] (ZEPPELIN-3856) Zeppelin add Hadoop Submarine(machine learning) interpreter

2018-11-08 Thread Xun Liu (JIRA)
Xun Liu created ZEPPELIN-3856: - Summary: Zeppelin add Hadoop Submarine(machine learning) interpreter Key: ZEPPELIN-3856 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3856 Project: Zeppelin

[GitHub] zeppelin issue #3113: [ZEPPELIN-3616] fix editor sections auto-collapse

2018-11-08 Thread Savalek
Github user Savalek commented on the issue: https://github.com/apache/zeppelin/pull/3113 What about merge? ---

[GitHub] zeppelin issue #3215: [ZEPPELIN-3167]

2018-11-08 Thread zjffdu
Github user zjffdu commented on the issue: https://github.com/apache/zeppelin/pull/3215 The unit test in `SparkRInterpreterTest` did cover the error case. We need to add this kind of unit test. ---

Re: Zeppelin add hadoop submarine(machine learning) interpreter

2018-11-08 Thread liuxun
hi, community I updated the design documentation, https://docs.google.com/document/d/16YN8Kjmxt1Ym3clx5pDnGNXGajUT36hzQxjaik1cP4A/edit# added the interactive development of machine learning algorithms and

[GitHub] zeppelin issue #3113: [ZEPPELIN-3616] fix editor sections auto-collapse

2018-11-08 Thread Tagar
Github user Tagar commented on the issue: https://github.com/apache/zeppelin/pull/3113 cc @zjffdu @Leemoonsoo @prabhjyotsingh can you please merge this? Thank you. ---

[GitHub] zeppelin issue #3206: [ZEPPELIN-3810] Support Spark 2.4

2018-11-08 Thread dongjoon-hyun
Github user dongjoon-hyun commented on the issue: https://github.com/apache/zeppelin/pull/3206 Hi, All. It's announced finally. http://spark.apache.org/news/spark-2-4-0-released.html ---

[GitHub] zeppelin issue #3206: [ZEPPELIN-3810] Support Spark 2.4

2018-11-08 Thread HyukjinKwon
Github user HyukjinKwon commented on the issue: https://github.com/apache/zeppelin/pull/3206 Hey all ~ could this get in by any change maybe? ---