[GitHub] zeppelin issue #2752: [ZEPPELIN-3195] Remove the limit on the number of run ...

2018-01-30 Thread mebelousov
Github user mebelousov commented on the issue:

https://github.com/apache/zeppelin/pull/2752
  
It's not easy to understand that "ZEPPELIN_INTERPRETER_MAX_POOL_SIZE" 
affects the number of paragraphs executed at cron. I would be glad if nobody 
will meet this bug and no need to change zeppelin-site.xml to fix note 
scheduling.

@zjffdu which number will be more appropriate? =)


---


[GitHub] zeppelin issue #2753: ZEPPELIN-3138. checkstyle for zeppelin-interpreter

2018-01-30 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/2753
  
Assuming all of the styling/reformating is done by Idea, looks good.


---


[GitHub] zeppelin pull request #2740: [ZEPPELIN-3185] Add profiles for adding depende...

2018-01-30 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2740


---


[jira] [Created] (ZEPPELIN-3196) Plugin framework for Zeppelin Engine

2018-01-30 Thread Jeff Zhang (JIRA)
Jeff Zhang created ZEPPELIN-3196:


 Summary: Plugin framework for Zeppelin Engine
 Key: ZEPPELIN-3196
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3196
 Project: Zeppelin
  Issue Type: New Feature
Reporter: Jeff Zhang






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zeppelin issue #2700: [ZEPPELIN-3092] GitHub Integration

2018-01-30 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2700
  
ping @mohamagdy


---


[GitHub] zeppelin issue #2753: ZEPPELIN-3138. checkstyle for zeppelin-interpreter

2018-01-30 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2753
  
@prabhjyotsingh Mind to review it ? Thanks


---


[GitHub] zeppelin pull request #2753: ZEPPELIN-3138. checkstyle for zeppelin-interpre...

2018-01-30 Thread zjffdu
GitHub user zjffdu opened a pull request:

https://github.com/apache/zeppelin/pull/2753

ZEPPELIN-3138. checkstyle for zeppelin-interpreter

### What is this PR for?
Code Style improvement


### What type of PR is it?
[Improvement]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3138

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-3138

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2753.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2753


commit c777161d2939a6e92f70bb91830e8ba9f32ee235
Author: Jeff Zhang 
Date:   2018-01-30T02:19:41Z

ZEPPELIN-3138. checkstyle for zeppelin-interpreter




---


[GitHub] zeppelin issue #2709: ZEPPELIN-3111. Refactor SparkInterpreter

2018-01-30 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2709
  
@Leemoonsoo binary package is the same as before, spark/scala-2.11 and 
spark/scala-2.10 will be packaged together into 
`spark-interpreter-0.8.0-SNAPSHOT.jar` which doesn't contain scala library. 
scala library is in the spark distribution. So SparkInterpreter will load the 
correct scala version of SparkInterpreter (`SparkScala211Interpreter` or 
`SparkScala210Interpreter`) based the scala version in your spark distribution 
(depends on SPARK_HOME you set). 


---


[GitHub] zeppelin issue #2752: [ZEPPELIN-3195] Remove the limit on the number of run ...

2018-01-30 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2752
  
Actually, you can change the configuration in `zeppelin-site.xml`,  and 
change it to 65535 seems too large for me. 


---


Re: Remote Storage of interpreter configurations

2018-01-30 Thread Jeff Zhang
ZEPPELIN-2742 implement an unified storage interface for configuration
(including interpreter setting), you have add new implementation as you
want.

https://issues.apache.org/jira/browse/ZEPPELIN-2742



wilsonr guevara arevalo 于2018年1月31日周三 上午4:35写道:

> Hey everyone,
>
> I´m a software developer and as part of a project I required to save
> interpreters configurations in an external repository in the cloud (S3,
> Google Cloud, etc). I saw that the current version of zeppelin have this
> feature working but it just support storage of notebooks.
>
> The notebooks implementations uses the interface  NotebooksRepo which can
> be extended to any implementation that saves in different repositories. I'm
> implementing the required changes to add this behavior into the repository.
> This is a change I want to contribute to the project and that´s why I sent
> this mail.
>
> How could I handle the commit change and maybe know if it would be
> implemented and in which version.
>
> Any information about it I'll be attempt.
>
>
> Greetings
>
>
> Wilson René Guevara Arévalo | Software Developer
> Skype: wilsonr990
> wilsonr...@hotmail.com | wilsonr...@gmail.com
>
>
>


Remote Storage of interpreter configurations

2018-01-30 Thread wilsonr guevara arevalo
Hey everyone,

I´m a software developer and as part of a project I required to save 
interpreters configurations in an external repository in the cloud (S3, Google 
Cloud, etc). I saw that the current version of zeppelin have this feature 
working but it just support storage of notebooks.

The notebooks implementations uses the interface  NotebooksRepo which can be 
extended to any implementation that saves in different repositories. I'm 
implementing the required changes to add this behavior into the repository. 
This is a change I want to contribute to the project and that´s why I sent this 
mail.

How could I handle the commit change and maybe know if it would be implemented 
and in which version.

Any information about it I'll be attempt.


Greetings


Wilson René Guevara Arévalo | Software Developer
Skype: wilsonr990
wilsonr...@hotmail.com | wilsonr...@gmail.com




[GitHub] zeppelin pull request #2752: [ZEPPELIN-3195] Remove the limit on the number ...

2018-01-30 Thread mebelousov
GitHub user mebelousov opened a pull request:

https://github.com/apache/zeppelin/pull/2752

[ZEPPELIN-3195] Remove the limit on the number of run paragraphs at cron

### What is this PR for?
Increase interpreter pool size for unlimit the number of paragraph that run 
at cron schedule.

### What type of PR is it?
[Hot Fix]

### What is the Jira issue?
*https://issues.apache.org/jira/browse/ZEPPELIN-3195

### How should this be tested?
* Create note with 15 paragraphs
* Check that at cron will be executed only 10 paragraphs
* Checkout this branch and rebuild app
* Check that all paragraphs are executed at cron

### Questions:
* Does the licenses files need update? NA
* Is there breaking changes for older versions? NA
* Does this needs documentation? NA

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/tinkoff-dwh/zeppelin ZEPPELIN-3195

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2752.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2752


commit 827054ce769b7c61ff8344c4df19f09ef5598e80
Author: mebelousov 
Date:   2018-01-30T18:58:00Z

ZEPPELIN-3195 Increase interpreter pool size




---


[jira] [Created] (ZEPPELIN-3195) Remove the limit on the number of run paragraphs at cron

2018-01-30 Thread Maxim Belousov (JIRA)
Maxim Belousov created ZEPPELIN-3195:


 Summary: Remove the limit on the number of run paragraphs at cron
 Key: ZEPPELIN-3195
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3195
 Project: Zeppelin
  Issue Type: Bug
  Components: Interpreters
Affects Versions: 0.8.0
Reporter: Maxim Belousov
Assignee: Maxim Belousov


At the current moment the parameter "ZEPPELIN_INTERPRETER_MAX_POOL_SIZE" limits 
the number of paragraphs that executed at cron.
Need to set "ZEPPELIN_INTERPRETER_MAX_POOL_SIZE" with large number.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zeppelin pull request #2751: [ZEPPELIN-3182] Support saving notebooks to Goo...

2018-01-30 Thread karth295
GitHub user karth295 opened a pull request:

https://github.com/apache/zeppelin/pull/2751

[ZEPPELIN-3182] Support saving notebooks to Google Cloud Storage

Same as #2738 , but targeted toward `branch-0.8`

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/karth295/zeppelin master

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2751.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2751


commit 8dc819ee4a322d3616f82f6c720eac221fc32ea0
Author: Karthik Palaniappan 
Date:   2018-01-29T03:10:40Z

Unify logic to clear notebook runtime state on load from storage

commit 1b6d277fc424f69c9f4c615edf19d157fa263c9a
Author: Karthik Palaniappan 
Date:   2018-01-29T03:21:34Z

[ZEPPELIN-3182] Support saving notebooks to Google Cloud Storage




---


[GitHub] zeppelin issue #2709: ZEPPELIN-3111. Refactor SparkInterpreter

2018-01-30 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/2709
  
in the binary package, how spark/scala-2.11 and spark/scala-2.10 modules 
will be packaged?


---


[GitHub] zeppelin issue #2745: [ZEPPELIN-3189] NPE on paragraph run via API

2018-01-30 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/2745
  
Merge to master if no further comment


---


[jira] [Created] (ZEPPELIN-3194) Create new interpreter for SAP Universe

2018-01-30 Thread Tinkoff DWH (JIRA)
Tinkoff DWH created ZEPPELIN-3194:
-

 Summary: Create new interpreter for SAP Universe
 Key: ZEPPELIN-3194
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3194
 Project: Zeppelin
  Issue Type: New Feature
Reporter: Tinkoff DWH


* create/delete/execute queries
 * SQL-like language штещ Paragraph (for ease of use)
 * autocomplete (list of universes, keywords, info about universe)
 * Promt parameters in queries



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)


[GitHub] zeppelin pull request #2750: ZEPPELIN-3108. Support Spark 2.3

2018-01-30 Thread zjffdu
GitHub user zjffdu opened a pull request:

https://github.com/apache/zeppelin/pull/2750

ZEPPELIN-3108. Support Spark 2.3

### What is this PR for?
Spark 2.3 remove `JobProgressListener` which cause zeppelin unable to run 
spark 2.3.  
This PR try to make Zeppelin support spark 2.3 via using 
`sc.statusTracker`, see `JobProgressUtil.scala`

### What type of PR is it?
[Improvement ]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3108

### How should this be tested?
* Verified manually. 

### Screenshots (if appropriate)
![screen shot 2018-01-30 at 9 45 01 
pm](https://user-images.githubusercontent.com/164491/35569317-dce6f348-0606-11e8-9b18-74a847d64ac9.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-3108

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2750.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2750


commit 3bf9666b6b48ea167c3cd4835b8f763909d85230
Author: Jeff Zhang 
Date:   2017-11-14T07:29:58Z

ZEPPELIN-3108. Support Spark 2.3




---