[GitHub] zeppelin issue #3099: [ZEPPELIN-3665] fix notebook name

2018-07-30 Thread Savalek 
Github user Savalek commented on the issue:

https://github.com/apache/zeppelin/pull/3099
  
@felixcheung, I added scren shots.


---

[GitHub] zeppelin issue #3098: ZEPPELIN-3664

2018-07-30 Thread fsteinle 
Github user fsteinle commented on the issue:

https://github.com/apache/zeppelin/pull/3098
  
@mebelousov: Basically this is not related to emails but to the 
userPrincipalName. The principalSuffix parameter makes sense, but doesn't 
address this issue. In our case we wanna keep the suffix to be sure it's really 
unique. Not all users of the organization are in the same AD branch.


---

[jira] [Created] (ZEPPELIN-3671) Add info about running interpreters to API and JMX

2018-07-30 Thread George Klimov (JIRA) 
George Klimov created ZEPPELIN-3671:
---

 Summary: Add info about running interpreters to API and JMX
 Key: ZEPPELIN-3671
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3671
 Project: Zeppelin
  Issue Type: Improvement
Affects Versions: 0.8.0
Reporter: George Klimov
Assignee: George Klimov


It would be nice if we could get PID of running interpreter, and group of 
paragraphs that running under that interpreter, using API and JMX.
Using this feature it will be easy to check cpu and memory load.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] zeppelin pull request #3102: [ZEPPELIN-3671] Add info about running interpre...

2018-07-30 Thread egorklimov 
GitHub user egorklimov opened a pull request:

https://github.com/apache/zeppelin/pull/3102

[ZEPPELIN-3671] Add info about running interpreters to API and JMX

### What is this PR for?
It would be nice if we could get PID of running interpreter, and group of 
paragraphs that running under that interpreter, using API and JMX.

Using this feature it will be easy to check CPU and memory load, etc. 
This PR adds:
* API method to get info about running interpreters 
(`/api/interpreter/running`)
* API method to get info about running paragraphs grouped by interpreters 
(`/api/notebook/jobmanager/running`)
* Few JMX methods which do the same as API.
* Template for simple running paragraphs analysis using API.

### What type of PR is it?
Improvement

### What is the Jira issue?
Issue on Jira https://issues.apache.org/jira/browse/ZEPPELIN-3671

### How should this be tested?
* CI is green

### Screenshots (if appropriate)
Example of tables built on response data:
* Interpreters:

![intp-table-example](https://user-images.githubusercontent.com/6136993/43404050-3e123f3c-941f-11e8-9223-056cd0d96adf.png)
* Paragraphs:

![running-paragraphs-info](https://user-images.githubusercontent.com/6136993/43404049-3df6ee58-941f-11e8-9e7e-d60a1859a7de.png)
* Count of paragraphs belongs to each interpreter:

![paragraph-example](https://user-images.githubusercontent.com/6136993/43404047-3dd8e6ba-941f-11e8-89a0-658c4686ef96.png)

Example of cpu and memory load analysis:
* Pie chart for memory load

![memory-example](https://user-images.githubusercontent.com/6136993/43404053-3e6d7726-941f-11e8-88a4-5d872bf8efaf.png)
* Pie chart for cpu load

![cpu-example](https://user-images.githubusercontent.com/6136993/43404051-3e2f5c20-941f-11e8-9aa8-2749b843180a.png)

[Tree of processes associated with 
running](http://localhost:8080/#/notebook/2DNG4YSTH/paragraph/20180727-122427_2143015301?asIframe)

The same data using JMX (viewed in jconsole):

* Running interpreters:

![jconsole2](https://user-images.githubusercontent.com/6136993/43408918-2a31b306-942b-11e8-9a51-f2cf78f52a8c.png)
* Running paragraphs

![jconsole-example](https://user-images.githubusercontent.com/6136993/43408919-2a550478-942b-11e8-854d-7281615f1b17.png)


### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? Yes, info about API should be updated


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/TinkoffCreditSystems/zeppelin DW-17571

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/3102.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3102


commit 47b6fd4df9d5a7088a77b60479946d50ad1fff71
Author: egorklimov 
Date:   2018-07-24T13:28:43Z

MBean register fixed

commit 2fe7e965d1475541e25696f38e5d71d606458054
Author: egorklimov 
Date:   2018-07-24T16:22:20Z

Running statistics functions added

commit 86a4308e86541f0685f7ea9484f5ddad038fad39
Author: egorklimov 
Date:   2018-07-27T17:44:54Z

Bugs fixed

commit 2547443ab166dde30007d80a73aa3d113f976c0c
Author: Egor Klimov 
Date:   2018-07-30T12:00:10Z

Add template1

commit 3119311c1d06957245f9716d7181020686871665
Author: Egor Klimov 
Date:   2018-07-30T12:01:39Z

Add template 2

commit beaa547d5e79efebc381f470524a2cd53ff13f6f
Author: Egor Klimov 
Date:   2018-07-30T12:11:15Z

Bug fixed

commit 3f8ce54fcff5d675628f982c9ca3b701b99a5441
Author: Egor Klimov 
Date:   2018-07-30T13:16:38Z

Admin template updated

commit a321aee0588b58fc8e91697383aade6567115fe2
Author: Egor Klimov 
Date:   2018-07-30T13:18:14Z

Interpreter template updated

commit e071378c64c294d2ff6ce0f0ff1daba02de16576
Author: egorklimov 
Date:   2018-07-30T15:54:15Z

Docs updated, bug fixed




---

[GitHub] zeppelin issue #3101: [ZEPPELIN-3667] [Improvement] Large CVS download.

2018-07-30 Thread maitreyak 
Github user maitreyak commented on the issue:

https://github.com/apache/zeppelin/pull/3101
  
Intended for branch-0.7. We use this version of Zeppelin with the posted 
fix at our organization. 
We don't intend to update to version 0.8+ due to the custom enhancements we 
have made. 

Thought it would be useful for folks on the same branch version or EMR 
folks.


---

[GitHub] zeppelin issue #3102: [WIP][ZEPPELIN-3671] Add info about running interprete...

2018-07-30 Thread egorklimov 
Github user egorklimov commented on the issue:

https://github.com/apache/zeppelin/pull/3102
  
No tests added yet.


---

[jira] [Created] (ZEPPELIN-3672) spark interpreter: Java output (to the console) is lost

2018-07-30 Thread DG (JIRA) 
DG created ZEPPELIN-3672:


 Summary: spark interpreter:  Java output (to the console) is lost
 Key: ZEPPELIN-3672
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3672
 Project: Zeppelin
  Issue Type: Bug
  Components: Interpreters
Affects Versions: 0.9.0
Reporter: DG


It could be a trivial configuration issue (in which case apologies!!  A 
Zeppelin newbie here), or perhaps it is a bug, in any event the output is 
unexpected

 

 
{noformat}
%spark

System.out.println("hello from java")
println("hello from scala")
{noformat}
only "scala" is shown in the output, whilst Java is lost.  Similarly, all 
output from Java through Log4j is lost as well.

The issue is critical, since we cannot currently show iteration log 
(convergence, and other metrics) from a Spark-Java app.

Ideas?

Thank you beforehand!!

 

 



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] zeppelin pull request #3103: ZEPPELIN-3666. Use zeppelin.interpreter.default...

2018-07-30 Thread zjffdu 
GitHub user zjffdu opened a pull request:

https://github.com/apache/zeppelin/pull/3103

ZEPPELIN-3666. Use zeppelin.interpreter.default to replace 
zeppelin.interpreter.group.order


### What is this PR for?

Actually user only care about the default interpreter rather than the whole 
interpreter order, so that we can use zeppelin.interpreter.default to replace 
zeppelin.interpreter.group.order, otherwise we may miss to update 
zeppelin.interpreter.group.order when adding new interpreter




### What type of PR is it?
[Refactoring]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3666

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-3666

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/3103.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3103


commit 741f51654bcfd508289e85eefc24a622ca786424
Author: Jeff Zhang 
Date:   2018-07-27T05:46:55Z

ZEPPELIN-3666. Use zeppelin.interpreter.default to replace 
zeppelin.interpreter.group.order




---

[GitHub] zeppelin pull request #3104: ZEPPELIN-3668. Can't hide Spark Jobs (Spark UI)...

2018-07-30 Thread zjffdu 
GitHub user zjffdu opened a pull request:

https://github.com/apache/zeppelin/pull/3104

ZEPPELIN-3668. Can't hide Spark Jobs (Spark UI) button

### What is this PR for?

This is to fix the bug of unable to hide spark jobs. 


### What type of PR is it?
[Bug Fix]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3668

### How should this be tested?
* Unit test added
* Verify it manually as well.

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-3668

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/3104.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3104


commit 3249122c1b971290a11d83db42330b1512cfbaf4
Author: Jeff Zhang 
Date:   2018-07-31T01:04:57Z

ZEPPELIN-3668. Can't hide Spark Jobs (Spark UI) button




---

[GitHub] zeppelin pull request #3105: ZEPPELIN-3672. spark interpreter: Java output (...

2018-07-30 Thread zjffdu 
GitHub user zjffdu opened a pull request:

https://github.com/apache/zeppelin/pull/3105

ZEPPELIN-3672. spark interpreter: Java output (to the console) is lost

### What is this PR for?
This is to fix the bug of redirecting java stdout to zeppelin frontend


### What type of PR is it?
[Bug Fix]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3672

### How should this be tested?
* Unit test added

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-3672

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/3105.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3105


commit a2af68c8cdadd839908ed6e230c2ea7396399c53
Author: Jeff Zhang 
Date:   2018-07-31T01:12:56Z

ZEPPELIN-3672. spark interpreter: Java output (to the console) is lost




---

[GitHub] zeppelin issue #3078: [ZEPPELIN-3628] HTML anchor links on paragraph don't w...

2018-07-30 Thread zjffdu 
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/3078
  
Will merge if no more comment


---

[GitHub] zeppelin issue #3084: [zeppelin-3639] Add Ipython interpreter prerequisite c...

2018-07-30 Thread khalidhuseynov 
Github user khalidhuseynov commented on the issue:

https://github.com/apache/zeppelin/pull/3084
  
@Tagar thanks for suggestion, but I think it's better not to include this 
check for tornado in this function since it's not really pre-requisite check. 
if we add it, then we need to keep track it, and restore back when the issue 
with tornado is fixed. 


---

[GitHub] zeppelin pull request #3093: [ZEPPELIN-3655] Add missing roles information t...

2018-07-30 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/3093


---

[GitHub] zeppelin issue #3103: ZEPPELIN-3666. Use zeppelin.interpreter.default to rep...

2018-07-30 Thread Tagar 
Github user Tagar commented on the issue:

https://github.com/apache/zeppelin/pull/3103
  
@zjffdu, do I understand correctly that `zeppelin.interpreter.default` 
would choose default interpreter, and not just interpreter group?
If so, it would also resolve 
https://issues.apache.org/jira/browse/ZEPPELIN-3282
Thanks!


---

[GitHub] zeppelin issue #3084: [zeppelin-3639] Add Ipython interpreter prerequisite c...

2018-07-30 Thread Tagar 
Github user Tagar commented on the issue:

https://github.com/apache/zeppelin/pull/3084
  
that makes sense. thanks @khalidhuseynov 


---

[GitHub] zeppelin issue #3092: [ZEPPELIN-3653] - New Java interpreter

2018-07-30 Thread zjffdu 
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/3092
  
LGTM, will merge soon


---

[GitHub] zeppelin issue #3092: [ZEPPELIN-3653] - New Java interpreter

2018-07-30 Thread felixcheung 
Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/3092
  
did you add the behavior in doc?


---

[GitHub] zeppelin issue #3100: ZEPPELIN-3557. Remove interpreter profiles

2018-07-30 Thread zjffdu 
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/3100
  
Actually this is my long time confusion part. `-Pr` would copy its artifact 
to `interpreter/spark` folder but it never used. I don't know the history of 
`-Pr`, is it an existing issue ?  


---

[GitHub] zeppelin pull request #3078: [ZEPPELIN-3628] HTML anchor links on paragraph ...

2018-07-30 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/3078


---