1. Zeppelin-3563 force FAIR scheduling and just allow to specify the pool
2. scheduler can not to figure out the dependencies between paragraphs.
That's why SparkInterpreter use FIFOScheduler.
If you use per user scoped mode. SparkContext is shared between users but
SparkInterpreter is not shared.
Thanks for the quick feedback Jeff.
Re:1 - I did see Zeppelin-3563 but we are not on .8 yet and also we may
want to force FAIR execution instead of letting user control it.
Re:2 - Is there an architecture issue here or we just need better thread
safety? Ideally scheduler should be able to figure
GitHub user zjffdu opened a pull request:
https://github.com/apache/zeppelin/pull/3095
ZEPPELIN-3652. Remove reflection in SparkInterpreter
### What is this PR for?
A few sentences describing the overall goals of the pull request's commits.
First time? Check out the
Regarding 1. ZEPPELIN-3563 should be helpful. See
https://github.com/apache/zeppelin/blob/master/docs/interpreter/spark.md#running-spark-sql-concurrently
for more details.
https://issues.apache.org/jira/browse/ZEPPELIN-3563
Regarding 2. If you use ParallelScheduler for SparkInterpreter, you may
Forgot to mention this is for shared scoped mode, so same Spark application and
context for all users on a single Zeppelin instance.
Thanks
Ankit
> On Jul 24, 2018, at 4:12 PM, Ankit Jain wrote:
>
> Hi,
> I am playing around with execution policy of Spark jobs(and all Zeppelin
> paragraphs
Hi,
I am playing around with execution policy of Spark jobs(and all Zeppelin
paragraphs actually).
Looks like there are couple of control points-
1) Spark scheduling - FIFO vs Fair as documented in
https://spark.apache.org/docs/2.1.1/job-scheduling.html#fair-scheduler-pools
.
Since we are still
Alex Byrd created ZEPPELIN-3659:
---
Summary: 'Using Pig for querying data' tutorial is outdated
Key: ZEPPELIN-3659
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3659
Project: Zeppelin
Alex Byrd created ZEPPELIN-3658:
---
Summary: Website 'External Resourced' URLs are not pointing
anywhere
Key: ZEPPELIN-3658
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3658
Project: Zeppelin
Alex Byrd created ZEPPELIN-3657:
---
Summary: 'Using Mahout' Tutorial is outdated
Key: ZEPPELIN-3657
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3657
Project: Zeppelin
Issue Type: Bug
Github user egorklimov commented on the issue:
https://github.com/apache/zeppelin/pull/3066
@jongyoul
CI is green
https://travis-ci.org/TinkoffCreditSystems/zeppelin/builds/407590408
---
Github user egorklimov closed the pull request at:
https://github.com/apache/zeppelin/pull/3078
---
GitHub user egorklimov reopened a pull request:
https://github.com/apache/zeppelin/pull/3078
[ZEPPELIN-3628] HTML anchor links on paragraph don't work in Google Chrome
### What is this PR for?
Links like [1] work well in Firefox, but don't work in Chrome.
1.
Github user egorklimov commented on the issue:
https://github.com/apache/zeppelin/pull/3078
@jongyoul
CI is green
https://travis-ci.org/TinkoffCreditSystems/zeppelin/builds/407589455
---
Github user zjffdu commented on the issue:
https://github.com/apache/zeppelin/pull/3094
Please add unit test
---
GitHub user alexjbush opened a pull request:
https://github.com/apache/zeppelin/pull/3094
[ZEPPELIN-3656] Fix for completion with Livy interpreter
### What is this PR for?
Fix for NullPointerException when using code completion in the Livy
Interpreter when Shared Interpreter is
Alex Bush created ZEPPELIN-3656:
---
Summary: Livy Code Completion does not work when using Shared
Interpreter
Key: ZEPPELIN-3656
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3656
Project: Zeppelin
Github user oxygen311 commented on the issue:
https://github.com/apache/zeppelin/pull/3093
It's don't easy to check this bug with a unit test. Even in Paragraph is
not running because of "user has no permission for interpreter" response in
rest api would be "OK"
---
Github user zjffdu commented on the issue:
https://github.com/apache/zeppelin/pull/3093
Can you add unit test ?
---
Alexey Zabelkin created ZEPPELIN-3655:
-
Summary: Fix running a paragraph through the REST API with a
restricted access interpreter
Key: ZEPPELIN-3655
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3655
Vincenzo Selvaggio created ZEPPELIN-3654:
Summary: New Hazelcast Jet interpreter
Key: ZEPPELIN-3654
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3654
Project: Zeppelin
Issue
GitHub user selvinsource opened a pull request:
https://github.com/apache/zeppelin/pull/3092
Java interpreter
### What is this PR for?
**New Java interpreter**
There are several Java libraries that could be used to leverage the Data
Visualization & Collaboration features of
Vincenzo Selvaggio created ZEPPELIN-3653:
Summary: New Java interpreter
Key: ZEPPELIN-3653
URL: https://issues.apache.org/jira/browse/ZEPPELIN-3653
Project: Zeppelin
Issue Type: New
Thank you.
I fully agree with you that we need a framework to support distributed
version. IMHO, we cannot afford to develop our own. I'll dig into atomix as
well.
On Tue, Jul 24, 2018 at 1:57 PM, liuxun wrote:
> @Jongyoul Leeļ¼
> Thank you for your attention.
>
> Indeed, as you said, the
Github user oxygen311 commented on the issue:
https://github.com/apache/zeppelin/pull/3090
@felixcheung
I have added property `zeppelin.python.useLsp` which is disabled by
default. It does not seem unsecured for me now. We also can specify host and
port by ourselves with
Github user oxygen311 commented on the issue:
https://github.com/apache/zeppelin/pull/3090
@zjffdu
Sorry, correct line is `pip install python-language-server`, i will fix it.
---
25 matches
Mail list logo
