[GitHub] zeppelin pull request #3019: [ZEPPELIN-3540] Show Spark inline UI in Non-Sec...

2018-06-13 Thread shahsank3t 
GitHub user shahsank3t opened a pull request:

https://github.com/apache/zeppelin/pull/3019

[ZEPPELIN-3540] Show Spark inline UI in Non-Secure mode

### What is this PR for?
After running a paragraph via Spark interpreter, we will be showing a 
"Spark UI" link. On clicking it, we show the Spark UI with the respective 
running job running.

### What type of PR is it?
[Improvement]

### What is the Jira issue?
[[ZEPPELIN-3540](https://issues.apache.org/jira/browse/ZEPPELIN-3540)]

### How should this be tested?
Using Spark interpreter, run a paragraph. On successful execution, we will 
see a Spark UI link(as shown in screenshot below) Click on the link and the pop 
up modal opens up showing the Spark job in the Zeppelin context.

### Screenshots (if appropriate)

![spark-ui-link](https://user-images.githubusercontent.com/6761317/41392631-778ed0e2-6fbf-11e8-94c4-cfab750184cf.png)


![webui-modal](https://user-images.githubusercontent.com/6761317/41392636-80a4d000-6fbf-11e8-8717-c24d70f1ebcf.png)



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/shahsank3t/zeppelin ZEPPELIN-3540

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/3019.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3019


commit ce95666881dfd32a20cc6297e441d738f5661aea
Author: Sanket Shah 
Date:   2018-06-14T04:50:09Z

Show Spark inline UI in Non-Secure mode




---

[GitHub] zeppelin issue #2986: ZEPPELIN-2035. BI directional RPC framework between Ze...

2018-06-13 Thread zjffdu 
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2986
  
@Leemoonsoo If no more comments, I will merge it to continue the rest of 
the work


---

[GitHub] zeppelin pull request #2998: [ZEPPELIN-3522] String "defaultValue" instead o...

2018-06-13 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2998


---

[GitHub] zeppelin pull request #3005: [ZEPPELIN-3528] Ordering by interpreter name in...

2018-06-13 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/3005


---

[GitHub] zeppelin issue #3015: [ZEPPELIN-3490] Yarn cluster mode doesn't work with de...

2018-06-13 Thread zjffdu 
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/3015
  
What will happen if user also specify jars via `spark.jars` ? Would that 
override `--jars` or combine with it ?


---

[GitHub] zeppelin pull request #3018: [ZEPPELIN-3539] Add jceks stored password suppo...

2018-06-13 Thread prabhjyotsingh 
GitHub user prabhjyotsingh opened a pull request:

https://github.com/apache/zeppelin/pull/3018

[ZEPPELIN-3539] Add jceks stored password support for LDAP

### What is this PR for?
This is to add support for storing password in jceks for LDAP (realm).

If the hadoopSecurityCredentialPath path is present and not empty in the 
shiro.ini, then the password is read from the keystore file and it need not be 
stored inside the shiro.ini file.

### What type of PR is it?
[Improvement | Feature]

### Todos
* [ ] - Add documentation

### What is the Jira issue?
* [ZEPPELIN-3539](https://issues.apache.org/jira/browse/ZEPPELIN-3539)

### How should this be tested?
Create a keystore file using the hadoop credential command line
```
hadoop credential create ldapRealm.systemPassword -provider 
jceks://file/user/zeppelin/conf/zeppelin.jceks
```
Change the following values in the Shiro.ini file, and uncomment the line:
```
ldapRealm.hadoopSecurityCredentialPath = 
jceks://file/user/zeppelin/conf/zeppelin.jceks
```


### Questions:
* Does the licenses files need update? N/A
* Is there breaking changes for older versions? N/A
* Does this needs documentation? N/A


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/prabhjyotsingh/zeppelin ZEPPELIN-3539

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/3018.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3018


commit 1428b3d1b2db34d06b07463a39250a8acd83b7f4
Author: Prabhjyot Singh 
Date:   2018-06-13T10:08:27Z

[ZEPPELIN-3539] Add jceks stored password support for LDAP

Change-Id: Ie675f85706bc3793bdc3072a324e1d566b8c3d63




---

[GitHub] zeppelin pull request #3017: [ZEPPELIN-3507] Restart interpreter setting may...

2018-06-13 Thread BruceXu1991 
Github user BruceXu1991 closed the pull request at:

https://github.com/apache/zeppelin/pull/3017


---

[GitHub] zeppelin issue #3017: [ZEPPELIN-3507] Restart interpreter setting may cause ...

2018-06-13 Thread BruceXu1991 
Github user BruceXu1991 commented on the issue:

https://github.com/apache/zeppelin/pull/3017
  
sorry, originally I want to merge this PR to V0.7.2 , but made some 
mistakes.  


---

[GitHub] zeppelin pull request #3017: [ZEPPELIN-3507] Restart interpreter setting may...

2018-06-13 Thread BruceXu1991 
GitHub user BruceXu1991 reopened a pull request:

https://github.com/apache/zeppelin/pull/3017

[ZEPPELIN-3507]  Restart interpreter setting may cause lock contention and 
lead to ZeppelinServer return 503 code

### What is this PR for?
This PR is to fix lock contention problem described in 
[ZEPPELIN-3507](https://issues.apache.org/jira/browse/ZEPPELIN-3507) by adding 
thrift socket timeout.

When there is TCP or any network problem, the socket connection may hung, 
which may cause a serial of lock contention problem. By adding user defined 
socket timeout can deal with the problem.



A few sentences describing the overall goals of the pull request's commits.
First time? Check out the contributing guide - 
https://zeppelin.apache.org/contribution/contributions.html


### What type of PR is it?
Bug Fix 

### Todos
no

### What is the Jira issue?
[ZEPPELIN-3507] https://issues.apache.org/jira/browse/ZEPPELIN-3507

### How should this be tested?
manual test

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update?
no
* Is there breaking changes for older versions?
no
* Does this needs documentation?
no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/BruceXu1991/zeppelin fix-lock-contention

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/3017.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3017


commit d91b310cbb985eac1e12ab9528a3be9e8e1b834c
Author: Prabhjyot Singh 
Date:   2017-01-07T12:37:00Z

[ZEPPELIN-1906] Use multiple InterpreterResult for displaying multiple JDBC 
queries

### What is this PR for?
Use multiple InterpreterResult for displaying multiple JDBC queries.
IMO since other sql editors allows to execute multiple sql separated with 
";" and ours display mechanism being more powerful, hence, it should also allow 
the same.

### What type of PR is it?
[Improvement]

### What is the Jira issue?
* [ZEPPELIN-1906](https://issues.apache.org/jira/browse/ZEPPELIN-1906)

### How should this be tested?
Try running following in a paragraph (with Postgres setting) and check for 
output.

```
%jdbc
create table test_temp_table (id int);
select column_name, data_type, character_maximum_length from 
INFORMATION_SCHEMA.COLUMNS where table_name = 'test_temp_table';
SELECT table_name FROM information_schema.tables WHERE table_schema = 
'public';
drop table test_temp_table;
SELECT table_name FROM information_schema.tables WHERE table_schema = 
'public';
```

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? N/A
* Is there breaking changes for older versions? N/A
* Does this needs documentation? N/A

Author: Prabhjyot Singh 

Closes #1845 from prabhjyotsingh/ZEPPELIN-1906 and squashes the following 
commits:

b27352a [Prabhjyot Singh] on error show previous output.
f9fd5c6 [Prabhjyot Singh] allow last query to be without ";"
b3e742e [Prabhjyot Singh] fixing checkstyle-fail-build
ac4663d [Prabhjyot Singh] add block comment
f3da37f [Prabhjyot Singh] replace regex with slightly better logic.
e6727b5 [Prabhjyot Singh] add testcase for spliting sql.
c096e76 [Prabhjyot Singh] remove extra empty lines
e675190 [Prabhjyot Singh] user same connection instead of creating new 
everytime
f5ab796 [Prabhjyot Singh] Use multiple InterpreterResult for displaying 
multiple JDBC queries

(cherry picked from commit 8464971c7aab0734f96d0a5a11d842b8e595324a)
Signed-off-by: Prabhjyot Singh 

commit b8637f5e5fa4aab8859e6bc90fa7886ba9157b24
Author: Alexander Shoshin 
Date:   2017-01-11T08:45:31Z

[ZEPPELIN-1787] Add an example of Flink Notebook

### What is this PR for?
This PR will add an example of batch processing with Flink to Zeppelin 
tutorial notebooks. There are no any Flink notebooks in the tutorial at the 
moment.

### What type of PR is it?
Improvement

### What is the Jira issue?
[ZEPPELIN-1787](https://issues.apache.org/jira/browse/ZEPPELIN-1787)

### How should this be tested?
You should open `Using Flink for batch processing` notebook from the 
`Zeppelin Tutorial` folder and run all paragraphs one by one

### Questions:
* Does the licenses files need update? - **no**
* Is there breaking changes for older versions? - **no**
* Does this needs documentation? - **no**

Author: Alexander Shoshin 

Closes #1758 from AlexanderShoshin/ZEPPELIN-1787 and squashes the following 
commits:

83cbffb [Alexander Shoshin] remove

[GitHub] zeppelin pull request #3017: [ZEPPELIN-3507] Restart interpreter setting may...

2018-06-13 Thread BruceXu1991 
Github user BruceXu1991 closed the pull request at:

https://github.com/apache/zeppelin/pull/3017


---

[GitHub] zeppelin pull request #3017: [ZEPPELIN-3507] Fix lock contention

2018-06-13 Thread BruceXu1991 
GitHub user BruceXu1991 opened a pull request:

https://github.com/apache/zeppelin/pull/3017

[ZEPPELIN-3507]  Fix lock contention

### What is this PR for?
This PR is to fix lock contention problem described in 
[ZEPPELIN-3507](https://issues.apache.org/jira/browse/ZEPPELIN-3507) by adding 
thrift socket timeout.

When there is TCP or any network problem, the socket connection may hung, 
which may cause a serial of lock contention problem. By adding user defined 
socket timeout can deal with the problem.



A few sentences describing the overall goals of the pull request's commits.
First time? Check out the contributing guide - 
https://zeppelin.apache.org/contribution/contributions.html


### What type of PR is it?
Bug Fix 

### Todos
no

### What is the Jira issue?
[ZEPPELIN-3507] https://issues.apache.org/jira/browse/ZEPPELIN-3507

### How should this be tested?
manual test

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update?
no
* Is there breaking changes for older versions?
no
* Does this needs documentation?
no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/BruceXu1991/zeppelin fix-lock-contention

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/3017.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3017


commit d91b310cbb985eac1e12ab9528a3be9e8e1b834c
Author: Prabhjyot Singh 
Date:   2017-01-07T12:37:00Z

[ZEPPELIN-1906] Use multiple InterpreterResult for displaying multiple JDBC 
queries

### What is this PR for?
Use multiple InterpreterResult for displaying multiple JDBC queries.
IMO since other sql editors allows to execute multiple sql separated with 
";" and ours display mechanism being more powerful, hence, it should also allow 
the same.

### What type of PR is it?
[Improvement]

### What is the Jira issue?
* [ZEPPELIN-1906](https://issues.apache.org/jira/browse/ZEPPELIN-1906)

### How should this be tested?
Try running following in a paragraph (with Postgres setting) and check for 
output.

```
%jdbc
create table test_temp_table (id int);
select column_name, data_type, character_maximum_length from 
INFORMATION_SCHEMA.COLUMNS where table_name = 'test_temp_table';
SELECT table_name FROM information_schema.tables WHERE table_schema = 
'public';
drop table test_temp_table;
SELECT table_name FROM information_schema.tables WHERE table_schema = 
'public';
```

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? N/A
* Is there breaking changes for older versions? N/A
* Does this needs documentation? N/A

Author: Prabhjyot Singh 

Closes #1845 from prabhjyotsingh/ZEPPELIN-1906 and squashes the following 
commits:

b27352a [Prabhjyot Singh] on error show previous output.
f9fd5c6 [Prabhjyot Singh] allow last query to be without ";"
b3e742e [Prabhjyot Singh] fixing checkstyle-fail-build
ac4663d [Prabhjyot Singh] add block comment
f3da37f [Prabhjyot Singh] replace regex with slightly better logic.
e6727b5 [Prabhjyot Singh] add testcase for spliting sql.
c096e76 [Prabhjyot Singh] remove extra empty lines
e675190 [Prabhjyot Singh] user same connection instead of creating new 
everytime
f5ab796 [Prabhjyot Singh] Use multiple InterpreterResult for displaying 
multiple JDBC queries

(cherry picked from commit 8464971c7aab0734f96d0a5a11d842b8e595324a)
Signed-off-by: Prabhjyot Singh 

commit b8637f5e5fa4aab8859e6bc90fa7886ba9157b24
Author: Alexander Shoshin 
Date:   2017-01-11T08:45:31Z

[ZEPPELIN-1787] Add an example of Flink Notebook

### What is this PR for?
This PR will add an example of batch processing with Flink to Zeppelin 
tutorial notebooks. There are no any Flink notebooks in the tutorial at the 
moment.

### What type of PR is it?
Improvement

### What is the Jira issue?
[ZEPPELIN-1787](https://issues.apache.org/jira/browse/ZEPPELIN-1787)

### How should this be tested?
You should open `Using Flink for batch processing` notebook from the 
`Zeppelin Tutorial` folder and run all paragraphs one by one

### Questions:
* Does the licenses files need update? - **no**
* Is there breaking changes for older versions? - **no**
* Does this needs documentation? - **no**

Author: Alexander Shoshin 

Closes #1758 from AlexanderShoshin/ZEPPELIN-1787 and squashes the following 
commits:

83cbffb [Alexander Shoshin] remove localhost url
5255e17 [Alexander Shoshin] Merge branch 'master' into

[GitHub] zeppelin pull request #2994: [ZEPPELIN-3285] Refine the style of Notebook ti...

2018-06-13 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2994


---

[GitHub] zeppelin pull request #2991: [ZEPPELIN-3476] change description "auto-restar...

2018-06-13 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2991


---

[GitHub] zeppelin pull request #2982: [ZEPPELIN-3492] The paragraph's table does not ...

2018-06-13 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2982


---

[jira] [Created] (ZEPPELIN-3540) Show Spark inline UI in Non-Secure mode

2018-06-13 Thread Sameer Shaikh (JIRA) 
Sameer Shaikh created ZEPPELIN-3540:
---

 Summary: Show Spark inline UI in Non-Secure mode 
 Key: ZEPPELIN-3540
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3540
 Project: Zeppelin
  Issue Type: Improvement
Reporter: Sameer Shaikh






--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] zeppelin pull request #3016: ZEPPELIN-3538. Fail to bootstrap PySpark in yar...

2018-06-13 Thread zjffdu 
GitHub user zjffdu opened a pull request:

https://github.com/apache/zeppelin/pull/3016

ZEPPELIN-3538. Fail to bootstrap PySpark in yarn cluster mode

### What is this PR for?
After ZEPPELIN-3375, PySparkInterpreter extends PythonInterpreter. 
PySparkInterpreter may fail to bootstrap PySpark as we miss to add hook to the 
pyspark bootstrap code.


### What type of PR is it?
[Bug Fix]

### Todos
* [ ] - Task

### What is the Jira issue?
* https://issues.apache.org/jira/browse/ZEPPELIN-3538

### How should this be tested?
* CI pass

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/zjffdu/zeppelin ZEPPELIN-3538

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/3016.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #3016


commit 3a1d8a737b22d9f6b32b3c417f8d373d4f617021
Author: Jeff Zhang 
Date:   2018-06-13T02:14:14Z

ZEPPELIN-3538. Fail to bootstrap PySpark in yarn cluster mode




---

[GitHub] zeppelin issue #2991: [ZEPPELIN-3476] change description "auto-restart inter...

2018-06-13 Thread Savalek 
Github user Savalek commented on the issue:

https://github.com/apache/zeppelin/pull/2991
  
@felixcheung, I did it.


---

[jira] [Created] (ZEPPELIN-3539) Add jceks stored password support for LDAP

2018-06-13 Thread Prabhjyot Singh (JIRA) 
Prabhjyot Singh created ZEPPELIN-3539:
-

 Summary: Add jceks stored password support for LDAP
 Key: ZEPPELIN-3539
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-3539
 Project: Zeppelin
  Issue Type: Bug
Reporter: Prabhjyot Singh


In LdapRealm there is a property _ldapRealm.contextFactory.systemPassword_ 
where the user needs to set system password in cleartext, this provides an 
alternate mechanism to store the same in jceks.



--
This message was sent by Atlassian JIRA
(v7.6.3#76005)

[GitHub] zeppelin issue #2974: ZEPPELIN-3472 No interpreter status is shown after res...

2018-06-13 Thread zjffdu 
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2974
  
hmm, I missed that statement in description. But I think it would be better 
to pop up a error message to users when it fails to restart. I don't think user 
would know to hover over that icon to see the error message. 

BTW, another thing I'd like to clarify is that the restarting button 
doesn't means `restarting interpreter` for now. It is just `terminate the 
interpreter but not start it`.  Interpreter starting happens when user run 
paragraph.This is a legacy issue we should fix. 


---

[GitHub] zeppelin issue #2974: ZEPPELIN-3472 No interpreter status is shown after res...

2018-06-13 Thread bikassaha 
Github user bikassaha commented on the issue:

https://github.com/apache/zeppelin/pull/2974
  
The description says "on hovering the (circle) you will see success / error 
message for the respective interpreter." I wonder if that is going to show 
whats wrong in starting/restarting the interpreter.


---

[GitHub] zeppelin issue #2974: ZEPPELIN-3472 No interpreter status is shown after res...

2018-06-13 Thread zjffdu 
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2974
  
@sameer79 Or we could make it simple for now that the status icon means 
whether the interpreter restarting operation is successful just as what this PR 
did now IIUC.  One concern is that when the restarting operation is failed, 
what user would get in frontend besides the red status icon. Because I think 
red status icon is not sufficient for users, user don't know what to do for 
this kind of failure. At least, frontend should tell user what's wrong in 
restarting interpreter. 


---

[GitHub] zeppelin issue #3007: zeppelin 0.8 version pyspark interpreter error when us...

2018-06-13 Thread zjffdu 
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/3007
  
@lizhenhuan the protobuf in spark project is not related. The version you 
see in pom file is the protobu java version which is not the same as the python 
package version. I guess you hit this issue because that you install another 
version of protobuf before installing grpc. Could you try using virtualenv to 
create a clean enviroment ? You don't need to install protobuf expclitly, it 
will be installed automatically as the dependency of grpc. 


---

[GitHub] zeppelin issue #2373: [ZEPPELIN-2598] Securing Zeppelin with OpenID Connect

2018-06-13 Thread xixikaikai 
Github user xixikaikai commented on the issue:

https://github.com/apache/zeppelin/pull/2373
  
Is there any document or example to tell us how to use SSO function in 
zeppelin?


---

[GitHub] zeppelin issue #2373: [ZEPPELIN-2598] Securing Zeppelin with OpenID Connect

2018-06-13 Thread xixikaikai 
Github user xixikaikai commented on the issue:

https://github.com/apache/zeppelin/pull/2373
  
@1ambda Do you have a sample code to test this function?


---