[GitHub] zeppelin issue #2495: [HOTFIX] JDBC completions. fix cursor position

2017-08-01 Thread tinkoff-dwh
Github user tinkoff-dwh commented on the issue:

https://github.com/apache/zeppelin/pull/2495
  
Ready to review


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2490: [Zeppelin-2718] Find and replace code in note

2017-08-01 Thread tinkoff-dwh
Github user tinkoff-dwh commented on the issue:

https://github.com/apache/zeppelin/pull/2490
  
Ready to review


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2449: [Zeppelin-2676] recent notes list

2017-08-01 Thread tinkoff-dwh
Github user tinkoff-dwh commented on the issue:

https://github.com/apache/zeppelin/pull/2449
  
Ready to review


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2455: ZEPPELIN-1515. Notebook: HDFS as a backend storage (Us...

2017-08-01 Thread hayssams
Github user hayssams commented on the issue:

https://github.com/apache/zeppelin/pull/2455
  
@zjffdu Yes when you want to start zeppelin not as a daemon. 
Please also note the docker image rely on zeppelin.sh



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-2824) We have to do the same with Zeppelin Markdown in Jupyter Convertor.

2017-08-01 Thread CloverHearts (JIRA)
CloverHearts created ZEPPELIN-2824:
--

 Summary: We have to do the same with Zeppelin Markdown in Jupyter 
Convertor.
 Key: ZEPPELIN-2824
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2824
 Project: Zeppelin
  Issue Type: Bug
Reporter: CloverHearts


The markdown of the Zeppelin note changed in the Jupyter note convertor does 
not match the results of some Zeppelin.
This is because Zeppelin uses some user change plugin.
This is confusing.
We need to make this same change.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] zeppelin issue #2513: fix non import of java.util.Collections of branch-0.7

2017-08-01 Thread reminia
Github user reminia commented on the issue:

https://github.com/apache/zeppelin/pull/2513
  
@Leemoonsoo 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2513: fix non import of java.util.Collections of bran...

2017-08-01 Thread reminia
GitHub user reminia opened a pull request:

https://github.com/apache/zeppelin/pull/2513

fix non import of java.util.Collections of branch-0.7

fix branch-0.7 compiled failure of non import of Collections in 
NotebookServer.java

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/reminia/zeppelin fix-compile

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2513.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2513


commit 534510f23e8a7c777d970a46af1e524812016aa0
Author: lichenyang 
Date:   2017-08-01T10:56:07Z

fix non import of java.util.Collections of branch-0.7




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2509: [ZEPPELIN-2818] Improve to better rendering fro...

2017-08-01 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/2509


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #2512: [ZEPPELIN-2823] Notebook saved status is wrong ...

2017-08-01 Thread prabhjyotsingh
GitHub user prabhjyotsingh opened a pull request:

https://github.com/apache/zeppelin/pull/2512

[ZEPPELIN-2823] Notebook saved status is wrong if there was a network 
disconnect or a flaky network.

### What is this PR for?
Notebook content doesn't get saved if there is a flaky network, and at 
times user's paragraph content also gets lost in this process.


### What type of PR is it?
[Bug Fix]


### What is the Jira issue?
* [ZEPPELIN-2823](https://issues.apache.org/jira/browse/ZEPPELIN-2823)

### How should this be tested?
Steps to re-produce:
 - create a new notebook
 - in the first paragraph enter text, say "version1"
 - now disconnect the network (say by removing LAN cable)
 - update this paragraph again with text "version2"
 - reconnect network
 - now observe the on the WebSocket reconnect, the content of this 
paragraph will go back to "version1"

### Screenshots (if appropriate)

Before

![before](https://user-images.githubusercontent.com/674497/28852738-5772029e-76e0-11e7-82ed-8c2a25d3ab47.gif)

After

![after](https://user-images.githubusercontent.com/674497/28852739-5774efcc-76e0-11e7-9e48-4bda935c4686.gif)


### Questions:
* Does the licenses files need an update? N/A
* Is there breaking changes for older versions? N/A
* Does this needs documentation? N/A


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/prabhjyotsingh/zeppelin ZEPPELIN-2823

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/2512.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #2512


commit d2a835f7785159833e2a00cf519f1c95fcc87c24
Author: Prabhjyot Singh 
Date:   2017-08-02T00:35:03Z

wait for server confirmation before updating stats of notebook




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-2823) Notebook saved status is wrong if there was a network disconnect or a flaky network.

2017-08-01 Thread Prabhjyot Singh (JIRA)
Prabhjyot Singh created ZEPPELIN-2823:
-

 Summary: Notebook saved status is wrong if there was a network 
disconnect or a flaky network.
 Key: ZEPPELIN-2823
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2823
 Project: Zeppelin
  Issue Type: Bug
Reporter: Prabhjyot Singh
Assignee: Prabhjyot Singh


Notebook content doesn't get saved if there is a flaky network, and at times 
user's paragraph content also gets lost in this process.



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] zeppelin issue #2455: ZEPPELIN-1515. Notebook: HDFS as a backend storage (Us...

2017-08-01 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/2455
  
@hayssams Any reason why `zeppelin-daemon.sh` doesn't fit for you ? Because 
zeppelin does not guarantee `zeppelin.sh` can launch zeppelin server properly. 
`zeppelin-daemon.sh` not only add `HADOOP_CONF_DIR` but also other libraries, 
if you don't use `zeppelin-daemon.sh`, zeppelin-server may fail to launch. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2462: ZEPPELIN-2527 Changed editor cursor to thin

2017-08-01 Thread malayhm
Github user malayhm commented on the issue:

https://github.com/apache/zeppelin/pull/2462
  
Screenshot with the latest change:


![cursor-change-pr-after-2px](https://user-images.githubusercontent.com/1881135/28850207-548e2f86-76e9-11e7-9fc9-0498f4b7ac0b.gif)



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2502: [ZEPPELIN-2807] Passing Z variables to SQL Interpreter...

2017-08-01 Thread Tagar
Github user Tagar commented on the issue:

https://github.com/apache/zeppelin/pull/2502
  
Info from Jupyter comitter @takluyver 

> It's fairly brief, but here:
> 
http://ipython.readthedocs.io/en/stable/interactive/reference.html#manual-capture-of-command-output-and-magic-output
>  
> E.g. found that quoting of curly brackets is done using {{..}} etc.
> If this documentation doesn't exist (I can't find where this is 
documented), please point to code 
> that handles this logic.
> 
> The expansion of variables and expressions is done by the var_expand() 
method:
> 
https://github.com/ipython/ipython/blob/8f50a3771614d3e22505eabc9332d1bc44af6f0e/IPython/core/interactiveshell.py#L3037
> 
> Running a shell command and capturing the output is the getoutput() 
method:
> 
https://github.com/ipython/ipython/blob/8f50a3771614d3e22505eabc9332d1bc44af6f0e/IPython/core/interactiveshell.py#L2279
> 
> The escaped double curly braces {{...}} is part of Python's standard 
string formatting machinery, which we use in var_expand().
>  



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #2455: ZEPPELIN-1515. Notebook: HDFS as a backend storage (Us...

2017-08-01 Thread hayssams
Github user hayssams commented on the issue:

https://github.com/apache/zeppelin/pull/2455
  
Yes but sometimes we need to launch zeppelin through zeppelin.sh equally in 
Mesos by Marathon


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-2822) Livy Interpreter should have a way to set Livy RSCConf RPC_CLIENT_HANDSHAKE_TIMEOUT

2017-08-01 Thread Prabhu Joseph (JIRA)
Prabhu Joseph created ZEPPELIN-2822:
---

 Summary: Livy Interpreter should have a way to set Livy RSCConf  
RPC_CLIENT_HANDSHAKE_TIMEOUT
 Key: ZEPPELIN-2822
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-2822
 Project: Zeppelin
  Issue Type: Bug
  Components: livy-interpreter
Affects Versions: 0.7.2
Reporter: Prabhu Joseph


Consider a Node which has NN1 (NameNode) and HiveMetaStore is down but we have 
HA for both services. Running livy script will create a new session and will 
wait for ipc.client.connect.timeout (20s) for each jar upload into hdfs 

{code}
17/07/31 13:59:29 INFO ContextLauncher: 17/07/31 13:59:39 INFO Client: Source 
and destination file systems are the same. Not copying 
hdfs://prabhu/hdp/apps/2.6.1.0-129/spark/spark-hdp-assembly.jar
17/07/31 13:59:49 INFO ContextLauncher: 17/07/31 13:59:49 INFO Client: 
Uploading resource 
file:/usr/hdp/current/livy-server/rsc-jars/livy-rsc-0.3.0.2.6.1.0-129.jar -> 
hdfs://prabhu/user/diasmi/.sparkStaging/application_1501501991083_0001/livy-rsc-0.3.0.2.6.1.0-129.jar
{code}

and 5 seconds (hive.metastore.client.socket.timeout)

{code}
17/07/26 09:09:46 INFO ContextLauncher: 17/07/26 09:09:46 INFO metastore: 
Trying to connect to metastore with URI thrift://prabhu01:9083
17/07/26 09:09:51 INFO ContextLauncher: 17/07/26 09:09:51 WARN metastore: 
Failed to connect to the MetaStore Server...
17/07/26 09:09:51 INFO ContextLauncher: 17/07/26 09:09:51 INFO metastore: 
Trying to connect to metastore with URI thrift://prabhu02:9083
17/07/26 09:09:51 INFO ContextLauncher: 17/07/26 09:09:51 INFO metastore: 
Connected to metastore.
{code}

and finally will fail with timeout with Livy Server Connect Timeout. 90 Seconds 
is too low for this case. Zeppelin has to have a way for overriding this 
timeout configuration.

RPC_CLIENT_HANDSHAKE_TIMEOUT("server.connect.timeout", "90s")

{code}
17/07/31 14:00:51 ERROR RSCClient: Failed to connect to context.
java.util.concurrent.TimeoutException: Timed out waiting for context to start.
at 
com.cloudera.livy.rsc.ContextLauncher.connectTimeout(ContextLauncher.java:133)
at 
com.cloudera.livy.rsc.ContextLauncher.access$200(ContextLauncher.java:62)
at com.cloudera.livy.rsc.ContextLauncher$2.run(ContextLauncher.java:121)
at 
io.netty.util.concurrent.PromiseTask$RunnableAdapter.call(PromiseTask.java:38)
at 
io.netty.util.concurrent.ScheduledFutureTask.run(ScheduledFutureTask.java:120)
at 
io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:357)
at io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:357)
at 
io.netty.util.concurrent.SingleThreadEventExecutor$2.run(SingleThreadEventExecutor.java:111)
at java.lang.Thread.run(Thread.java:745)
{code}



--
This message was sent by Atlassian JIRA
(v6.4.14#64029)


[GitHub] zeppelin issue #2506: [ZEPPELIN-2813] revisions comparator

2017-08-01 Thread tinkoff-dwh
Github user tinkoff-dwh commented on the issue:

https://github.com/apache/zeppelin/pull/2506
  
@felixcheung @khalidhuseynov 
fixed. added documentation


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---