[GitHub] zeppelin issue #2309: [ZEPPELIN-2482] added font size for paragraph

2017-06-13 Thread tinkoff-dwh 
Github user tinkoff-dwh commented on the issue:

https://github.com/apache/zeppelin/pull/2309
  
the same errors

```
ParagraphActionsIT.testSingleDynamicFormSelectForm:624 » NoSuchElement 
Cannot ...
ParagraphActionsIT.testMultipleDynamicFormsSameType:707 » NoSuchElement 
Cannot...
ParagraphActionsIT.testRunOnSelectionChange:282 » NoSuchElement Cannot 
locate ...
```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: [DISCUSSION] Extending TableData API

2017-06-13 Thread Jeff Zhang 
Hi Park,

Thanks for the sharing, this is a very interested and innovated idea. I
have several comments and concerns.

1. What does the resource registration mean ?
   IIUC, currently it means it would cache the data in Interpreter Process.
Then it might be a memory issue when more and more resources are
registered. Maybe we could introduce resource retention mechanism or cache
the data in other formats (just like the spark table cache policy, user can
specify how to cache the data, like memory, disk and etc.)

2. The scope of resource sharing
   For now, it seems it is globally shared. But I think user level sharing
might be more common. Then we need to create a namespace for each user.
That means the same resource name could exist in different user namespace.

3. The data route might cause performance issue.
   From the diagram, If spark interpreter needs to access a resource from
jdbc interpreter. Then first data needs to be send to zeppelin server, and
then zeppelin server send the data to spark interpreter. This kind of data
route introduce a bit more overhead to me. And zeppelin server will become
a bottleneck and require large memory when there're many resources to be
shared across users/interpreters. So I would suggest the following
approach. Zeppelin Server just control the metadata and ACL of resources.
And Spark Interpreter will fetch data from Jdbc Interpreter directly
instead of through zeppelin server.  Here's the sequences
   1). SparkInterpreter ask for metadata and token for the resource
   2). Zeppelin Server will check whether this SparkInterprter has
permission to access this resource, if yes, then send the metadata and
token to SparkInterpreter. The metadata includes the RPC address of the
JdbcInterpreter and token is for security.
   3). SparkInterpreter ask JdbcInterpreter for the resource via the
the token and metadata received in step 2
   4). JdbcInterpreter verify the token, and send the data to
SparkInterpreter.
[image: image.png]


Khalid Huseynov 于2017年6月13日周二 上午11:53写道：

> Thanks for the questions guys!
>
> @Jun Kim actually that feature was originally discussed and was put into
> backlog since proposal was more about tables processed by interpreters and
> their sharing. However having quick visualisation on the fly for not so
> large data makes sense indeed, and possibly could be done by importing data
> into some interpreter by default (Spark, python, etc). So I believe it can
> be done once initial basics for resource sharing is completed.
>
> @Andrea Santurbano there should be listing of tables with schema info,
> but i'm not sure exactly what you mean by drop-down feature between
> tables in the UI. Could you give little more details/example on that as
> well as  enhancements on graph part you meant?
>
>
> On Mon, Jun 12, 2017 at 4:01 PM, Andrea Santurbano 
> wrote:
>
>> Hi guys,
>> this is great! I think this can also enable some drop-down feature
>> between tables in the UI...
>> Do you think this enhancements can also include the graph part?
>>
>> Andrea
>>
>> Il giorno lun 12 giu 2017 alle ore 05:47 Jun Kim  ha
>> scritto:
>>
>>> All of the enhancements looks great to me!
>>>
>>> And I wish a feature which can upload a small CSV file (maybe about
>>> 20MB..?) and play with it directly.
>>> It would be great if I can drag a file to Zeppelin and register it as
>>> the table.
>>>
>>> Thanks :)
>>>
>>> 2017년 6월 12일 (월) 오전 11:40, Park Hoon <1am...@gmail.com>님이 작성:
>>>
 Hi All,

 Recently, ZEPPELIN-753
  (Tabledata
 abstraction) and ZEPPELIN-2020
  (Remote method
 invocation for resources) were resolved.
 Based on this work, we can improve Zeppelin with the following
 enhancements:

 * register the table result as a shared resource
 * list all available (registered) tables
 * preview tables including its meta information (e.g columns, types, ..)
 * download registered tables as CSV, and other formats.
 * pivoting/filtering in backend to transforming larger data
 * cross join tables in different interpreters (e.g Spark interpreter
 uses a table result generated from JDBC interpreter)

 You can find the full proposal in Extending Table Data API
 
  which
 is contributed by @1ambda, @khalidhuseynov, @Leemoonsoo.

 Any question, feedback or discussion will be welcomed.


 Thanks.

>>> --
>>> Taejun Kim
>>>
>>> Data Mining Lab.
>>> School of Electrical and Computer Engineering
>>> University of Seoul
>>>
>>
>

[GitHub] zeppelin issue #2407: [ZEPPELIN-1907] Shell Interpreter does not renew ticke...

2017-06-13 Thread zjffdu 
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2407
  
@prabhjyotsingh I left one minor comment. Besides that I found 1 other 
issues.  

* Code duplication and inconsistency between `ShellInterpreter` and 
`ShellSecurityImpl`. Both of these 2 classes will create DefaultExecutor and do 
the real  shell execution. But it seems the command in `ShellSecurityImpl` can 
not be canceled, because it is not put in `executors`. It would be better to 
put the common logic together. 

But this issue is not related with this ticket, could be done in another 
ticket. 




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #2356: [ZEPPELIN-2460] Highlight active line in editor

2017-06-13 Thread Leemoonsoo 
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/2356
  
@1ambda Layout change impact user experiences a lot and i'd like to be more 
prudent on change.

I have created PR for reverting it. 
https://github.com/apache/zeppelin/pull/2409


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #2409: Revert layout change made by pr2356

2017-06-13 Thread Leemoonsoo 
GitHub user Leemoonsoo opened a pull request:

https://github.com/apache/zeppelin/pull/2409

Revert layout change made by pr2356

### What is this PR for?
This PR reverts layout change made by #2356.


### What type of PR is it?
Fix

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/Leemoonsoo/zeppelin 
revert_layoutchange_from_pr2356

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2409.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2409


commit 391c5d9b71515906181d15a98171bf5d55c341dd
Author: Lee moon soo 
Date:   2017-06-10T22:32:19Z

revert layout change made by https://github.com/apache/zeppelin/pull/2356

commit 2abb91a8ebca1cad2f2b49f846e3074347f24cc4
Author: Lee moon soo 
Date:   2017-06-10T23:14:22Z

revert changes on test




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #2309: [ZEPPELIN-2482] added font size for paragraph

2017-06-13 Thread 1ambda 
Github user 1ambda commented on the issue:

https://github.com/apache/zeppelin/pull/2309
  
Looks good. I guess the failed job in 
https://travis-ci.org/tinkoff-dwh/zeppelin/builds/242104908 is due to a flaky 
test. But just to make sure, could you restart it so that CI will be green?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #2407: [ZEPPELIN-1907] Shell Interpreter does not rene...

2017-06-13 Thread prabhjyotsingh 
GitHub user prabhjyotsingh reopened a pull request:

https://github.com/apache/zeppelin/pull/2407

[ZEPPELIN-1907] Shell Interpreter does not renew ticket on secure cluster

### What is this PR for?
Kerberos ticket and renew lifetime are set to 1 hour. On accessing secure 
Hadoop from shell interpreter, it does kinit and returns result successfully 
but after 1 hour, the ticket gets expired and Hadoop list fails with below 
exception.

```
%sh
hadoop fs -ls /

17/01/05 09:29:45 WARN ipc.Client: Exception encountered while connecting 
to the server : 
javax.security.sasl.SaslException: GSS initiate failed [Caused by 
GSSException: No valid credentials provided (Mechanism level: Failed to find 
any Kerberos tgt)]
at 
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
at 
org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:413)
at 
org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:595)
at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:397)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:762)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:758)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
at 
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:757)
at org.apache.hadoop.ipc.Client$Connection.access$3200(Client.java:397)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1618)
at org.apache.hadoop.ipc.Client.call(Client.java:1449)
at org.apache.hadoop.ipc.Client.call(Client.java:1396)
at 
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:233)
at com.sun.proxy.$Proxy10.getFileInfo(Unknown Source)
ls: Failed on local exception: java.io.IOException: 
javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: 
No valid credentials provided (Mechanism level: Failed to find any Kerberos 
tgt)]; Host Details : local host is: "zeppelin1.hwxblr.com/10.0.1.57"; 
destination host is: "zeppelin1.hwxblr.com":8020; 
ExitValue: 1
```

### What type of PR is it?
[Bug Fix]

### What is the Jira issue?
* [ZEPPELIN-1907](https://issues.apache.org/jira/browse/ZEPPELIN-1907)

### How should this be tested?
On a Kerberos enabled cluster, run this paragraph
```
%sh
hdfs dfs -ls /user/zeppelin/
```
Wait for key-tab to expire (or run `kdestroy`), and re-run the same 
paragraph.

### Screenshots (if appropriate)
Before:
https://user-images.githubusercontent.com/674497/27078184-511ed810-5050-11e7-8afa-90247f33047a.png;>

After:
https://user-images.githubusercontent.com/674497/27078183-5109d690-5050-11e7-82e4-d79a5e98295f.png;>


### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/prabhjyotsingh/zeppelin ZEPPELIN-1907

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2407.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2407


commit ab823d3ee9373c38f5f083d3471adf351c9177a2
Author: Prabhjyot Singh 
Date:   2017-06-13T10:18:44Z

relogin using keytab, and append message for the same

commit 7c539ef2eb943b30befc97bd5a15120e8d9ee42e
Author: Prabhjyot Singh 
Date:   2017-06-13T14:11:11Z

add null check




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #2407: [ZEPPELIN-1907] Shell Interpreter does not rene...

2017-06-13 Thread prabhjyotsingh 
Github user prabhjyotsingh closed the pull request at:

https://github.com/apache/zeppelin/pull/2407


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #318: Save all repos, and not just the first two

2017-06-13 Thread dirceusemighini 
Github user dirceusemighini closed the pull request at:

https://github.com/apache/zeppelin/pull/318


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[ANNOUNCE] Apache Zeppelin 0.7.2 released

2017-06-13 Thread Mina Lee 
The Apache Zeppelin community is pleased to announce the availability of
the 0.7.2 release.

Zeppelin is a collaborative data analytics and visualization tool for
distributed, general-purpose data processing system such as Apache Spark,
Apache Flink, etc.

The community put significant effort into improving Apache Zeppelin since
the last release. 25 contributors provided 50+ patches
for improvements and bug fixes. More than 40+ issues have been resolved.

We encourage you to download the latest release from
http://zeppelin.apache.org/download.html

Release note is available at
http://zeppelin.apache.org/releases/zeppelin-release-0.7.2.html

We welcome your help and feedback. For more information on the project and
how to get involved, visit our website at http://zeppelin.apache.org/

Thank you all users and contributors who have helped to improve Apache
Zeppelin.

Regards,
The Apache Zeppelin community

[GitHub] zeppelin pull request #2408: [DOC][HOTFIX] Fix latest version typo

2017-06-13 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2408


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #2408: [DOC][HOTFIX] Fix latest version typo

2017-06-13 Thread minahlee 
GitHub user minahlee opened a pull request:

https://github.com/apache/zeppelin/pull/2408

[DOC][HOTFIX] Fix latest version typo

### What is this PR for?
Fix version typo in nav menu from 0.7.1 to 0.7.2

### What type of PR is it?
Documentation | Hot Fix

### Todos
* [ ] - Task

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/minahlee/zeppelin fix/navMenu

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2408.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2408


commit b6eef77b46ff95ed82e3f5bd562aed3d1dbd6a92
Author: Mina Lee 
Date:   2017-06-13T16:51:49Z

Fix latest version typo




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #2406: [DOC] 0.7.2 release note

2017-06-13 Thread asfgit 
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2406


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-2645) Adding way to register RemoteInterpreterServer's port into InterpreterProcess

2017-06-13 Thread Jongyoul Lee (JIRA) 
Jongyoul Lee created ZEPPELIN-2645:
--

 Summary: Adding way to register RemoteInterpreterServer's port 
into InterpreterProcess
 Key: ZEPPELIN-2645
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2645
 Project: Zeppelin
  Issue Type: Bug
Reporter: Jongyoul Lee
Assignee: Jongyoul Lee


>From now, the port of interpreter is fixed by Zeppelin server, and which 
>connect interpreter via this port. But it's not fragile running interpreter 
>remotely. Then I suggest reverse way to pass the port information from 
>interpreter to server. It require one more communication channel and I'll use 
>netty for it. This issue is initialized from ZEPPELIN-2035 and related to 
>ZEPPELIN-2040.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] zeppelin issue #2329: [WIP][ZEPPELIN-2040] ClusterManager to support launchi...

2017-06-13 Thread jongyoul 
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/2329
  
@zjffdu I agree with you. It's very basic and minimum feature to run 
interpreters in Zeppelin. I'll take that issue ASAP.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #2405: [ZEPPELIN-2640] Roles are not getting honored from shi...

2017-06-13 Thread prabhjyotsingh 
Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/2405
  
Thank you @felixcheung, @khalidhuseynov for the review.
Will merge this if no more discussion.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-2644) Import IPython Or any Databricks supported format Notebooks into Zeppelin

2017-06-13 Thread Nassir (JIRA) 
Nassir created ZEPPELIN-2644:


 Summary: Import IPython Or any Databricks supported format 
Notebooks into Zeppelin
 Key: ZEPPELIN-2644
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2644
 Project: Zeppelin
  Issue Type: Bug
Reporter: Nassir


Can anyone help in importing IPython notebooks into Apache Zeppelin.

I also would like to be able to use any of the export formats from Databricks 
such as DBC archive, IPython notebook, HTML, or source file.

can zeppelin import any of these?

Thanks
Nassir



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[jira] [Created] (ZEPPELIN-2643) Adding functionality to hook into WebSocket traffic

2017-06-13 Thread stergiotis (JIRA) 
stergiotis created ZEPPELIN-2643:


 Summary: Adding functionality to hook into WebSocket traffic
 Key: ZEPPELIN-2643
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2643
 Project: Zeppelin
  Issue Type: Improvement
  Components: front-end
Affects Versions: 0.7.2
Reporter: stergiotis


I would like to propose an extension mechanism which is orthogonal to the 
concept of interpreters. This mechanism has proven valuable (and simple) to 
implement certain kind of end-to-end functionalities across interpreters (e.g. 
enhanced security, auditing, resource and session management, ...). In order to 
do so it is necessary to hook into the Zeppelin frontend to backend 
communication. 

I therefore propose the following:
# Introduce a mechanism to late-bind two hook functions upon website 
instanciation (e.g. try to  a zepplin external resource (in a CORS 
compliant manner)). Lets call these functions window.hookOutgoing(..) and 
window.hookIncoming(..).
# Modify 
https://github.com/apache/zeppelin/blob/master/zeppelin-web/src/components/websocketEvents/websocketEvents.factory.js
```javascript
websocketCalls.ws.send(JSON.stringify(window.hookOutgoing(data))) // instead of 
websocketCalls.ws.send(JSON.stringify(data))
```
and
```javascript
payload = angular.fromJson(window.hookIncoming(event.data)) // instead of 
payload = angular.fromJson(event.data)
```
Remarks:
I am aware of the fact that this exposes Zeppelin internal datastructures which 
may be subject to changes. I am looking for a late-bind option which does not 
make use of Angular's dependency injection mechanism.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] zeppelin pull request #2407: [ZEPPELIN-1907] Shell Interpreter does not rene...

2017-06-13 Thread prabhjyotsingh 
GitHub user prabhjyotsingh opened a pull request:

https://github.com/apache/zeppelin/pull/2407

[ZEPPELIN-1907] Shell Interpreter does not renew ticket on secure cluster

### What is this PR for?
Kerberos ticket and renew lifetime are set to 1 hour. On accessing secure 
Hadoop from shell interpreter, it does kinit and returns result successfully 
but after 1 hour, the ticket gets expired and Hadoop list fails with below 
exception.

```
%sh
hadoop fs -ls /

17/01/05 09:29:45 WARN ipc.Client: Exception encountered while connecting 
to the server : 
javax.security.sasl.SaslException: GSS initiate failed [Caused by 
GSSException: No valid credentials provided (Mechanism level: Failed to find 
any Kerberos tgt)]
at 
com.sun.security.sasl.gsskerb.GssKrb5Client.evaluateChallenge(GssKrb5Client.java:211)
at 
org.apache.hadoop.security.SaslRpcClient.saslConnect(SaslRpcClient.java:413)
at 
org.apache.hadoop.ipc.Client$Connection.setupSaslConnection(Client.java:595)
at org.apache.hadoop.ipc.Client$Connection.access$2000(Client.java:397)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:762)
at org.apache.hadoop.ipc.Client$Connection$2.run(Client.java:758)
at java.security.AccessController.doPrivileged(Native Method)
at javax.security.auth.Subject.doAs(Subject.java:422)
at 
org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1724)
at 
org.apache.hadoop.ipc.Client$Connection.setupIOstreams(Client.java:757)
at org.apache.hadoop.ipc.Client$Connection.access$3200(Client.java:397)
at org.apache.hadoop.ipc.Client.getConnection(Client.java:1618)
at org.apache.hadoop.ipc.Client.call(Client.java:1449)
at org.apache.hadoop.ipc.Client.call(Client.java:1396)
at 
org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:233)
at com.sun.proxy.$Proxy10.getFileInfo(Unknown Source)
ls: Failed on local exception: java.io.IOException: 
javax.security.sasl.SaslException: GSS initiate failed [Caused by GSSException: 
No valid credentials provided (Mechanism level: Failed to find any Kerberos 
tgt)]; Host Details : local host is: "zeppelin1.hwxblr.com/10.0.1.57"; 
destination host is: "zeppelin1.hwxblr.com":8020; 
ExitValue: 1
```

### What type of PR is it?
[Bug Fix]

### What is the Jira issue?
* [ZEPPELIN-1907](https://issues.apache.org/jira/browse/ZEPPELIN-1907)

### How should this be tested?
On a Kerberos enabled cluster, run this paragraph
```
%sh
hdfs dfs -ls /user/zeppelin/
```
Wait for key-tab to expire (or run `kdestroy`), and re-run the same 
paragraph.

### Screenshots (if appropriate)
Before:
https://user-images.githubusercontent.com/674497/27078184-511ed810-5050-11e7-8afa-90247f33047a.png;>

After:
https://user-images.githubusercontent.com/674497/27078183-5109d690-5050-11e7-82e4-d79a5e98295f.png;>


### Questions:
* Does the licenses files need update?
* Is there breaking changes for older versions?
* Does this needs documentation?


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/prabhjyotsingh/zeppelin ZEPPELIN-1907

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2407.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2407


commit ab823d3ee9373c38f5f083d3471adf351c9177a2
Author: Prabhjyot Singh 
Date:   2017-06-13T10:18:44Z

relogin using keytab, and append message for the same




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-2642) NPM error on Zeppelin build

2017-06-13 Thread Nelson Costa (JIRA) 
Nelson Costa created ZEPPELIN-2642:
--

 Summary: NPM error on Zeppelin build
 Key: ZEPPELIN-2642
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2642
 Project: Zeppelin
  Issue Type: Bug
Reporter: Nelson Costa


Hi, looking for some help/advice given I'm not an expert on this front-end 
issues.

Running "mvn clean package -DskipTests" against latest master fails with this 
error:

{noformat}
[INFO] $ bower install --silent
[INFO] Done in 2454.70s.
[INFO] 
[INFO] --- frontend-maven-plugin:1.3:yarn (yarn build) @ zeppelin-web ---
[INFO] Found proxies: [genproxy{protocol='http', host='xxx', port=8080}, 
genproxyhttps{protocol='https', host='xxx', port=8080}]
[INFO] Running 'yarn run build:dist --https-proxy=http://xxx:8080 
--proxy=http://xxx:8080' in /opt/src/zeppelin/zeppelin-web
[INFO] yarn run v0.18.1
[INFO] $ npm-run-all prebuild && grunt pre-webpack-dist && webpack && grunt 
post-webpack-dist 
[INFO] 
[INFO] > zeppelin-web@0.0.0 prebuild /opt/src/zeppelin/zeppelin-web
[INFO] > npm-run-all clean lint:once
[INFO] 
[INFO] 
[INFO] > zeppelin-web@0.0.0 clean /opt/src/zeppelin/zeppelin-web
[INFO] > rimraf dist && rimraf .tmp
[INFO] 
[INFO] 
[INFO] > zeppelin-web@0.0.0 lint:once /opt/src/zeppelin/zeppelin-web
[INFO] > eslint src
[INFO] 
[INFO] 
[INFO] /opt/src/zeppelin/zeppelin-web/src/app/app.js
[INFO]   166:1   error  More than 1 blank line not allowed
no-multiple-empty-lines
[INFO]   180:3   error  Unexpected var, use let or const instead  no-var
[INFO]   180:27  error  Extra space before value for key 'headers'
key-spacing
[INFO]   181:5   error  Strings must use singlequote  quotes
[INFO]   181:25  error  Strings must use singlequote  quotes
[INFO]   182:5   error  Expected indentation of 2 spaces but found 4  indent
[INFO]   189:50  error  Strings must use singlequote  quotes
[INFO]   190:18  error  Strings must use singlequote  quotes
[INFO]   196:5   error  Unexpected var, use let or const instead  no-var
[INFO]   197:30  error  Expected '===' and instead saw '=='   eqeqeq
[INFO]   197:49  error  Expected '!==' and instead saw '!='   eqeqeq
[INFO]   198:7   error  Expected space or tab after '//' in comment   
spaced-comment
[INFO] 
[INFO] /opt/src/zeppelin/zeppelin-web/src/app/notebook/notebook.controller.js
[INFO]   57:34  warning  Unnecessary escape character: \/  no-useless-escape
[INFO]   57:44  warning  Unnecessary escape character: \/  no-useless-escape
[INFO]   57:59  warning  Unnecessary escape character: \/  no-useless-escape
[INFO]   57:69  warning  Unnecessary escape character: \/  no-useless-escape
[INFO] 
[INFO] 
/opt/src/zeppelin/zeppelin-web/src/app/visualization/builtins/visualization-nvd3chart.js
[INFO]   131:37  warning  Unexpected mix of '&&' and '||'  no-mixed-operators
[INFO]   131:54  warning  Unexpected mix of '&&' and '||'  no-mixed-operators
[INFO] 
[INFO] 
/opt/src/zeppelin/zeppelin-web/src/components/noteListDataFactory/noteList.datafactory.js
[INFO]   38:40  warning  Unnecessary escape character: \/  no-useless-escape
[INFO]   38:45  warning  Unnecessary escape character: \/  no-useless-escape
[INFO] 
[INFO] ??? 20 problems (12 errors, 8 warnings)
[INFO] 
[ERROR] 
[ERROR] npm ERR! Linux 3.10.0-514.16.1.el7.x86_64
[ERROR] npm ERR! argv "/opt/src/zeppelin/zeppelin-web/node/node" 
"/opt/src/zeppelin/zeppelin-web/node/node_modules/npm/bin/npm-cli.js" "run" 
"lint:once"
[ERROR] npm ERR! node v6.9.1
[ERROR] npm ERR! npm  v4.2.0
[ERROR] npm ERR! code ELIFECYCLE
[ERROR] npm ERR! errno 1
[ERROR] npm ERR! zeppelin-web@0.0.0 lint:once: `eslint src`
[ERROR] npm ERR! Exit status 1
[ERROR] npm ERR! 
[ERROR] npm ERR! Failed at the zeppelin-web@0.0.0 lint:once script 'eslint src'.
[ERROR] npm ERR! Make sure you have the latest version of node.js and npm 
installed.
[ERROR] npm ERR! If you do, this is most likely a problem with the zeppelin-web 
package,
[ERROR] npm ERR! not with npm itself.
[ERROR] npm ERR! Tell the author that this fails on your system:
[ERROR] npm ERR! eslint src
[ERROR] npm ERR! You can get information on how to open an issue for this 
project with:
[ERROR] npm ERR! npm bugs zeppelin-web
[ERROR] npm ERR! Or if that isn't available, you can get their info via:
[ERROR] npm ERR! npm owner ls zeppelin-web
[ERROR] npm ERR! There is likely additional logging output above.
[ERROR] 
[ERROR] npm ERR! Please include the following file with any support request:
[ERROR] npm ERR! /root/.npm/_logs/2017-06-12T23_04_19_174Z-debug.log
[ERROR] ERROR: "lint:once" exited with 1.
[ERROR] 
[ERROR] npm ERR! Linux 3.10.0-514.16.1.el7.x86_64
[ERROR] npm ERR! argv "/opt/src/zeppelin/zeppelin-web/node/node" 
"/opt/src/zeppelin/zeppelin-web/node/node_modules/npm/bin/npm-cli.js" "run" 
"prebuild"
[ERROR] npm ERR! node v6.9.1
[ERROR] npm ERR! npm  v4.2.0
[ERROR]

[jira] [Created] (ZEPPELIN-2641) Livy interpreter doesn't support Chinese encoding

2017-06-13 Thread heyang wang (JIRA) 
heyang wang created ZEPPELIN-2641:
-

 Summary: Livy interpreter doesn't support Chinese encoding 
 Key: ZEPPELIN-2641
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2641
 Project: Zeppelin
  Issue Type: Bug
  Components: livy-interpreter
Affects Versions: 0.7.1, 0.8.0
Reporter: heyang wang
Priority: Critical


When using Livy to interact with spark. Spark sql with Chinese character always 
return empty result.

The reason is because Zeppelin use restTemplate.java from  spring frame work. 
When sending restful request to Livy, the headers is defined as 
Content-Type：application/json. This setting doesn't specify the encoding of the 
charset and spring will use ISO-8895-1 by default. But ISO-8895-1 isn't 
compatible with Chinese. The code Livy receive from Zeppelin contain invalid 
Chinese encoding and will be interpret by spark as ?.

Change header from  application/json to MediaType.APPLICATION_JSON_UTF8_VALUE 
in BaseLivyInterpreter.java and rebuild can solve this problem.

It seems encoding problem affect more than Chinese since ISO-8895-1's coverage 
is restricted. I think update the encoding to UTF-8 would be helpful.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)

[GitHub] zeppelin issue #2391: [ZEPPELIN-2501] Better Job Navigation Experience

2017-06-13 Thread khalidhuseynov 
Github user khalidhuseynov commented on the issue:

https://github.com/apache/zeppelin/pull/2391
  
@1ambda thanks for contribution, tested and looks much better! When 
searching for note and clicking on it (e.g. redirect to /#/notebook/2CBFCSS6X) 
i can see below stacktrace in console

```
TypeError: Cannot read property 'create' of undefined
at Object.link 
(http://localhost:8080/app.6e54de3d53176984dde0.js:11:1236)
at http://localhost:8080/scripts/vendor.51ccc0a5e9a88265.js:34:5609
at qa 
(http://localhost:8080/scripts/vendor.51ccc0a5e9a88265.js:34:41840)
at n (http://localhost:8080/scripts/vendor.51ccc0a5e9a88265.js:34:34290)
at g (http://localhost:8080/scripts/vendor.51ccc0a5e9a88265.js:34:30249)
at http://localhost:8080/scripts/vendor.51ccc0a5e9a88265.js:34:29780
at http://localhost:8080/scripts/vendor.51ccc0a5e9a88265.js:34:32385
at d (http://localhost:8080/scripts/vendor.51ccc0a5e9a88265.js:34:30743)
at m (http://localhost:8080/scripts/vendor.51ccc0a5e9a88265.js:34:32827)
at http://localhost:8080/scripts/vendor.51ccc0a5e9a88265.js:34:159637 

```

not sure if it's related to this PR or not,  maybe we could check that. 
except that look good


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #2405: [ZEPPELIN-2640] Roles are not getting honored f...

2017-06-13 Thread prabhjyotsingh 
Github user prabhjyotsingh closed the pull request at:

https://github.com/apache/zeppelin/pull/2405


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #2405: [ZEPPELIN-2640] Roles are not getting honored f...

2017-06-13 Thread prabhjyotsingh 
GitHub user prabhjyotsingh reopened a pull request:

https://github.com/apache/zeppelin/pull/2405

[ZEPPELIN-2640] Roles are not getting honored from shiro_ini for setting 
permissions in Zeppelin notebook

### What is this PR for?
Roles are not getting honored from shiro_ini for setting permissions in 
Zeppelin notebook when securityManager.realm is set to $activeDirectoryRealm

### What type of PR is it?
[Bug Fix]

### Todos
* [x] - Create JIRA 

### What is the Jira issue?
* [ZEPPELIN-2640](https://issues.apache.org/jira/browse/ZEPPELIN-2640)

### How should this be tested?
Use the below-attached shiro.ini, the thing which is different is 
`securityManager.realm = $activeDirectoryRealm`. When this is used, Zeppelin 
does not set the roles that were assigned to that particular user.  

```
[main]
activeDirectoryRealm = org.apache.zeppelin.realm.ActiveDirectoryGroupRealm
activeDirectoryRealm.systemUsername = 
CN=Administrator,CN=Users,DC=COMPANY,DC=COM
activeDirectoryRealm.systemPassword = Password1!
activeDirectoryRealm.searchBase = CN=Users,DC=COMPANY,DC=COM
activeDirectoryRealm.url = ldap://ad-nano.mydomain.com:389
activeDirectoryRealm.groupRolesMap = 
"CN=zeppelin,OU=groups,DC=COMPANY,DC=COM":"admin","CN=finance,OU=groups,DC=COMPANY,DC=COM":"finance"
activeDirectoryRealm.authorizationCachingEnabled = true

securityManager.realm = $activeDirectoryRealm

sessionManager = org.apache.shiro.web.session.mgt.DefaultWebSessionManager
cacheManager = org.apache.shiro.cache.MemoryConstrainedCacheManager
securityManager.cacheManager = $cacheManager
securityManager.sessionManager = $sessionManager
securityManager.sessionManager.globalSessionTimeout = 8640
shiro.loginUrl = /api/login

[urls]
/api/version = anon
/** = authc
```

So, before this PR if you `tail -f 
zeppelin--.local.log` in the log you will see this line 
` WARN [2017-06-12 12:42:06,620] ({qtp226744878-19} 
LoginRestApi.java[postLogin]:119) - 
{"status":"OK","message":"","body":{"principal":"zeppelin","ticket":"4b1e513f-7736-4474-b2d6-259ff3d39f91","roles":"[]"}}`
 

And after applying this PR you will be able to see the role that got 
assigned to this user i.e.
` WARN [2017-06-12 12:42:06,620] ({qtp226744878-19} 
LoginRestApi.java[postLogin]:119) - 
{"status":"OK","message":"","body":{"principal":"zeppelin","ticket":"4b1e513f-7736-4474-b2d6-259ff3d39f91","roles":"[admin]"}}`

### Screenshots (if appropriate)
N/A

### Questions:
* Does the licenses files need update? N/A
* Is there breaking changes for older versions? N/A
* Does this needs documentation? N/A


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/prabhjyotsingh/zeppelin 
bug/securityManagerActiveDirectory

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2405.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2405


commit 9439ac8a7100438ed05c52b9eac4e0c05079a9e8
Author: Prabhjyot Singh 
Date:   2017-06-12T07:09:02Z

fix when securityManager.realm is set to $activeDirectoryRealm




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-2640) Roles are not getting honored from shiro_ini for setting permissions in Zeppelin notebook

2017-06-13 Thread Prabhjyot Singh (JIRA) 
Prabhjyot Singh created ZEPPELIN-2640:
-

 Summary: Roles are not getting honored from shiro_ini for setting 
permissions in Zeppelin notebook
 Key: ZEPPELIN-2640
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2640
 Project: Zeppelin
  Issue Type: Bug
Reporter: Prabhjyot Singh
Assignee: Prabhjyot Singh


Roles are not getting honored from shiro_ini for setting permissions in 
Zeppelin notebook when securityManager.realm is set to $activeDirectoryRealm



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)