[GitHub] zeppelin issue #1172: [Zeppelin-1161] Revert precise execution time

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1172
  
@AhyoungRyu Made modifications and added screenshot


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #908: ZEPPELIN-598 ] Dynamic loading for Interpreter and API

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/908
  
@cloverhearts I've got it. Thanks.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1174: [ Improve ] Paragraph dynamic relationship exec...

[cloverhearts]

GitHub user cloverhearts opened a pull request:

https://github.com/apache/zeppelin/pull/1174

[ Improve ] Paragraph dynamic relationship executable form

### What is this PR for?
Through a dynamic form, you can execute the order in para graph.
There is a difference with traditional methods.
Please check the following flowchart.

![workflowdynamicformcontrol](https://cloud.githubusercontent.com/assets/10525473/16791726/a4b96ff0-48fc-11e6-8e23-9ec577066bb7.png)

** The results will have to succeed, the following paragraph will be 
executed. **

### What type of PR is it?
Improvement

### How should this be tested?

```
%md

${workflow:workflow=MyWorkflowName,NotebookId01:ParagraphId01|NotebookId02:ParagraphId02}
```

### Screenshots (if appropriate)

![2](https://cloud.githubusercontent.com/assets/10525473/16791758/ea6b66fc-48fc-11e6-99da-9674a8af10f5.gif)

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? yes


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/cloverhearts/zeppelin 
improve/relation-paragraph-job-mylocal

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1174.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1174


commit 3736023afb5d1187d2fc505578d5a370b14f060d
Author: CloverHearts 
Date:   2016-07-04T08:05:21Z

Relation running paragraph - backend prototype

commit 08999a1fa2113f34974fc01961e8ce7d1f56f590
Author: CloverHearts 
Date:   2016-07-04T08:06:28Z

Merge branch 'master' into improve/zengine-dynamic-form

commit a9b0a28c85e5419e7c29f16a088209ef2cfa91a9
Author: CloverHearts 
Date:   2016-07-05T04:27:39Z

replace testcode.

commit fb8cadee1b55ab943b9786a27c2e2094232b4d1f
Author: CloverHearts 
Date:   2016-07-06T06:14:40Z

workflow test

commit 62a0f44b4edca9c1b03b6acba36acc77b187b528
Author: CloverHearts 
Date:   2016-07-06T11:37:43Z

workflow onSuccess event to running flow- backend

commit df50be33dfa22a6f79b32eb625a4a7cdd356a2af
Author: CloverHearts 
Date:   2016-07-06T11:44:46Z

Merge branch 'master' into improve/relation-paragraph-job

# Conflicts:
#   
zeppelin-server/src/main/java/org/apache/zeppelin/socket/NotebookServer.java

commit 7cc30c3a31142dfe0c05195b4b7763f42a8a4d47
Author: astroshim 
Date:   2016-07-06T15:20:31Z

bugfix HDFSFileInterpreter completion

commit 9831e0bb60ccbc2cc7cb2294060a397ba1acd2b1
Author: astroshim 
Date:   2016-07-06T15:33:10Z

add testcase

commit 1ba32319d0ef53ec468e2c1c14ca184d08ba9cad
Author: CloverHearts 
Date:   2016-07-07T04:10:28Z

Merge branch 'bugfix/HDFSFileInterpreterCompletion' of 
https://github.com/astroshim/zeppelin into improve/relation-paragraph-job

commit 9661f480d3bb0d52cc7a5b43d307abca1ed3651d
Author: CloverHearts 
Date:   2016-07-07T04:18:05Z

Merge branch 'master' into improve/relation-paragraph-job

commit e8d92b4b079bc3a724a7f5bb738aebde823ea2b8
Author: CloverHearts 
Date:   2016-07-07T05:09:41Z

add test

commit 688d3e340b1a2b80590e0ff40c97fd2549815d60
Author: CloverHearts 
Date:   2016-07-08T01:01:40Z

Merge branch 'master' into improve/relation-paragraph-job-mylocal

commit f74b4b74943a40ddf5c501dc919ff3cf51a1cea1
Author: CloverHearts 
Date:   2016-07-08T01:10:49Z

PR Roleback

commit ceebea73a3be0c372b7cbfe6d1ace4d6b6922095
Author: CloverHearts 
Date:   2016-07-08T01:25:38Z

fixed file interpreter (restore pr)

commit 6e47336efccf1173b9eb034e711b296df71553ec
Author: CloverHearts 
Date:   2016-07-11T03:26:36Z

Merge branch 'master' into improve/relation-paragraph-job-mylocal

commit 6438d6c27522f15ae0724be80f37ba196d6db1be
Author: CloverHearts 
Date:   2016-07-11T21:18:40Z

Merge branch 'master' into improve/relation-paragraph-job-mylocal

commit 7423afd7bd89000d5d3cb34e3d464a10601f974f
Author: CloverHearts 
Date:   2016-07-11T22:59:03Z

workflow web controller

commit 00508f2b7ce16670b7268b6c912d2801af8b2299
Author: CloverHearts 
Date:   2016-07-12T05:43:18Z

fixed workflow directive syntax

commit a5066f2487c559c106654028a0da4463d4c71b28
Author: CloverHearts 
Date:   2016-07-12T13:00:58Z

[GitHub] zeppelin pull request #1121: [Improve] workflow - run to relation paragraph

[cloverhearts]

Github user cloverhearts closed the pull request at:

https://github.com/apache/zeppelin/pull/1121


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1110: [ZEPPELIN-1091] Disable ace editor's showSettingsMenu ...

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1110
  
Merging if there is no more discussions


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1171: [ZEPPELIN-1150] Table contents disappear 2nd run onwar...

[astroshim]

Github user astroshim commented on the issue:

https://github.com/apache/zeppelin/pull/1171
  
Build error has gone and working good!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1171: [ZEPPELIN-1150] Table contents disappear 2nd run onwar...

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1171
  
@Leemoonsoo Tested,
Fix for the table after re-run confirmed.

For the second item, I would keep the solution used in 
https://issues.apache.org/jira/browse/ZEPPELIN-1078
Since you changes do not bring any improvement regarding performance 
degrade.
(We still do a renderText, when the text result is the same as before)



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1173: ZeppelinHub Realm

[anthonycorbacho]

GitHub user anthonycorbacho opened a pull request:

https://github.com/apache/zeppelin/pull/1173

ZeppelinHub Realm

### What is this PR for?
Add a new Shiro Realm that lets users authenticate in Apache Zeppelin using 
their ZeppelinHub credentials.

### What type of PR is it?
`Feature`

### Todos
* [ ] - Create ZeppelinHub Realm that extends `AuthorizingRealm`.
* [ ] - Update `shiro.ini` file and add ZeppelinHub configuration template. 

### What is the Jira issue?
No related Jira issue yet.

### How should this be tested?
 - Assuming that you already have an account 
[Zeppelinhub](https://www.zeppelinhub.com/register), edit `conf/shiro.ini` file 
and uncomment ZeppelinHub related configuration.
 - Start your Zeppelin
 - Login with your ZeppelinHub credentials.

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? Maybe 
[HERE](http://zeppelin.apache.org/docs/0.6.0/security/shiroauthentication.html)


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/anthonycorbacho/incubator-zeppelin 
feat/ZeppelinHubAuthentication

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1173.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1173


commit 7975467c54d09b5f17e51aa08fc66d5600a2318e
Author: Anthony Corbacho 
Date:   2016-07-13T03:23:15Z

Create new Apache Shiro Realm for ZeppelinHub

This Realm will let users login with they ZeppelinHub credentials.

commit 24d4ea0ab898b1dfa533a90eff863c5c2b58cbcc
Author: Anthony Corbacho 
Date:   2016-07-13T03:24:29Z

Add new setting in Shiri.ini to handle ZeppelinHub realm.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1172: [Zeppelin-1161] Revert precise execution time

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1172
  
@AhyoungRyu No, that discussion was about the elapsed time.
Right, for long one, maybe we should show something else than seconds. I 
will modify that.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1172: [Zeppelin-1161] Revert precise execution time

[AhyoungRyu]

Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1172
  
@corneadoug Wasn't it intended behaviour because of 
[https://github.com/apache/zeppelin/pull/862#issuecomment-221474937](https://github.com/apache/zeppelin/pull/862#issuecomment-221474937)?
 Anyway I prefer to show the precise execution time even if it shows such as 
`3600 seconds` 👍 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #908: ZEPPELIN-598 ] Dynamic loading for Interpreter and API

[cloverhearts]

Github user cloverhearts commented on the issue:

https://github.com/apache/zeppelin/pull/908
  
@jongyoul Task is waiting.
It has been delayed due to other work in progress.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1145: [ZEPPELIN-1012] Support Interpreter Aliases

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1145
  
@Leemoonsoo Concerning `sql interpreter not found`, I'll fix that issue 
with another one. I'll remove `jdbc` magic after I adopt this feature.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Actual execution time is not getting displayed in paragraph

[Corneau Damien]

I just confirmed it and created an issue:
https://issues.apache.org/jira/browse/ZEPPELIN-1161
PR should be coming pretty quickly

On Tue, Jul 12, 2016 at 11:44 PM, Sachin Janani 
wrote:

> Ok will create a issue and if possible submit a patch for this
>
> Thanks,
> SJ
>
> On Tue, Jul 12, 2016 at 8:09 PM, Hyung Sung Shim 
> wrote:
>
> > Yea. It seems you're right.
> > You can create issue for this.
> >
> > 2016-07-12 23:26 GMT+09:00 Sachin Janani :
> >
> > > But i think this changes are overridden by
> > > https://github.com/apache/zeppelin/pull/862 and the number of seconds
> > are
> > > not visible now
> > >
> > > On Tue, Jul 12, 2016 at 7:48 PM, Hyung Sung Shim 
> > > wrote:
> > >
> > > > Hi.
> > > > Yes it's a known behaviour maybe since
> > > > https://github.com/apache/zeppelin/pull/848.
> > > >
> > > > 2016-07-12 21:49 GMT+09:00 Sachin Janani :
> > > >
> > > > > Hi All,
> > > > > In the latest release of zeppelin it seems that the actual task
> > > execution
> > > > > time is not displayed on the paragraph which was previously working
> > > > > properly.
> > > > > After looking into the code I found that  it has been replaced with
> > > > > Moment.js which shows length of time as string ,something like
> "Took
> > a
> > > > few
> > > > > seconds" but not exactly the number of seconds .
> > > > > Is this a know behaviour?
> > > > >
> > > > >
> > > > > Thanks and Regards,
> > > > > Sachin Janani
> > > > >
> > > >
> > >
> >
>

[GitHub] zeppelin pull request #1171: [ZEPPELIN-1150] Table contents disappear 2nd ru...

[Leemoonsoo]

GitHub user Leemoonsoo opened a pull request:

https://github.com/apache/zeppelin/pull/1171

[ZEPPELIN-1150] Table contents disappear 2nd run onwards

### What is this PR for?
Fix for 
[ZEPPELIN-1150](https://issues.apache.org/jira/browse/ZEPPELIN-1150).

### What type of PR is it?
Bug Fix

### Todos
* [x] - Recreate table on data refresh
* [x] - Better solution for 
[ZEPPELIN-1078](https://issues.apache.org/jira/browse/ZEPPELIN-1150) without 
performance degrade

### What is the Jira issue?
[ZEPPELIN-1150](https://issues.apache.org/jira/browse/ZEPPELIN-1150)

### How should this be tested?
Reproduce procedure described in the issue

### Questions:
* Does the licenses files need update? no 
* Is there breaking changes for older versions? no
* Does this needs documentation? no



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/Leemoonsoo/zeppelin ZEPPELIN-1150

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1171.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1171


commit b3406b70aaa6337c3f442793fa289f91bd401790
Author: Lee moon soo 
Date:   2016-07-13T02:00:51Z

Recreate table when (data) is refreshed




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1168: [MINOR] Add formatter

[jongyoul]

GitHub user jongyoul reopened a pull request:

https://github.com/apache/zeppelin/pull/1168

[MINOR] Add formatter

### What is this PR for?
Unifying the format of codes

### What type of PR is it?
[Feature]

### Todos
* [x] - Add formatter
* [x] - Convert sample file

### What is the Jira issue?
N/A

### How should this be tested?

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jongyoul/zeppelin minor/add-formatter

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1168.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1168


commit 66232b4c9112355fd8be140ce6c7920b81290309
Author: Jongyoul Lee 
Date:   2016-07-12T13:40:00Z

Added formatter for Intellij and Eclipse

commit 7281cf73aea957b27473f2cfbcf89c83df7c81ac
Author: Jongyoul Lee 
Date:   2016-07-12T13:40:50Z

Adjusted new style on ZeppelinServer.java

commit baf94f9e5deb8c70a3cf178cb9e03ad549195363
Author: Jongyoul Lee 
Date:   2016-07-12T14:53:40Z

Adjusted new style on JsonResponse.java

commit 6c94abf4be20cb72305ddfef1e9cdfdf139ba443
Author: Jongyoul Lee 
Date:   2016-07-12T15:47:58Z

Added license information into *style.xml

commit 1409a143d60c853e8da3813430811be34a013992
Author: Jongyoul Lee 
Date:   2016-07-12T16:00:30Z

Added docs




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1168: [MINOR] Add formatter

[jongyoul]

Github user jongyoul closed the pull request at:

https://github.com/apache/zeppelin/pull/1168


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-1160) Add an option to serially execute all paragraphs

[Yesha Vora (JIRA)]

Yesha Vora created ZEPPELIN-1160:


 Summary: Add an option to serially execute all paragraphs
 Key: ZEPPELIN-1160
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1160
 Project: Zeppelin
  Issue Type: Improvement
Reporter: Yesha Vora


In Zeppelin, we have an option to run all paragraphs simultaneously.

On other hand, Most of our Zeppelin example notebooks require to run paragraphs 
serially. Thus , user need to manually run each paragraph. It will be good to 
have an option to run all paragraph in a notebook serially.




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ZEPPELIN-1159) Livy interpreter gets "404 not found" error

[Yesha Vora (JIRA)]

Yesha Vora created ZEPPELIN-1159:


 Summary: Livy interpreter gets "404 not found" error
 Key: ZEPPELIN-1159
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1159
 Project: Zeppelin
  Issue Type: Bug
  Components: zeppelin-interpreter
Affects Versions: 0.6.0
Reporter: Yesha Vora
Priority: Critical


Livy SparkR gets "404 not found" error 

Scenario:
* Start a notebook and Run below sparkR paragraph.
{code}
%sh
hdfs dfs -copyFromLocal examples/src/main/resources/people.json /tmp{code}

{code}
%livy.sparkr
sc <- sparkR.init(sparkPackages="com.databricks:spark-csv_2.11:1.0.3")
sqlContext <- sparkRSQL.init(sc)
people <- read.df(sqlContext, "/tmp/people.json", "json") 
head(people)
printSchema(people)
write.df(people, path="people.parquet", source="parquet", mode="overwrite")
output ==
Re-using existing Spark Context. Please stop SparkR with sparkR.stop() or 
restart R to create a new Spark Context
  agename
1  NA Michael
2  30Andy
3  19  Justin
root
 |-- age: long (nullable = true)
 |-- name: string (nullable = true)
NULL
Attaching package: ‘SparkR’
The following objects are masked from ‘package:stats’:
cov, filter, lag, na.omit, predict, sd, var
The following objects are masked from ‘package:base’:
colnames, colnames<-, endsWith, intersect, rank, rbind, sample,
startsWith, subset, summary, table, transform{code}
* let the livy session expire.
* run the same paragraph again. 
%livy.sparkR fails to execute with "404 Not Found"

{code:title=livy interpreter log}
 INFO [2016-07-12 22:59:35,395] ({pool-2-thread-9} 
SchedulerFactory.java[jobFinished]:137) - Job remoteInterpretJob_1468364375373 
finished by scheduler org.apache.zeppelin.livy.LivySparkRInterpreter1028865681
 INFO [2016-07-12 22:59:37,620] ({pool-2-thread-5} 
SchedulerFactory.java[jobStarted]:131) - Job remoteInterpretJob_1468364377620 
started by scheduler org.apache.zeppelin.livy.LivySparkRInterpreter1028865681
ERROR [2016-07-12 22:59:37,633] ({pool-2-thread-5} 
LivySparkRInterpreter.java[interpret]:81) - Exception in LivySparkRInterpreter 
while interpret
org.springframework.web.client.HttpClientErrorException: 404 Not Found
at 
org.springframework.web.client.DefaultResponseErrorHandler.handleError(DefaultResponseErrorHandler.java:91)
at 
org.springframework.web.client.RestTemplate.handleResponse(RestTemplate.java:667)
at 
org.springframework.web.client.RestTemplate.doExecute(RestTemplate.java:620)
at 
org.springframework.web.client.RestTemplate.execute(RestTemplate.java:580)
at 
org.springframework.web.client.RestTemplate.exchange(RestTemplate.java:498)
at org.apache.zeppelin.livy.LivyHelper.executeHTTP(LivyHelper.java:354)
at 
org.apache.zeppelin.livy.LivyHelper.executeCommand(LivyHelper.java:299)
at org.apache.zeppelin.livy.LivyHelper.interpret(LivyHelper.java:240)
at 
org.apache.zeppelin.livy.LivySparkRInterpreter.interpret(LivySparkRInterpreter.java:79)
at 
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:341)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at 
org.apache.zeppelin.scheduler.FIFOScheduler$1.run(FIFOScheduler.java:139)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)
 INFO [2016-07-12 22:59:37,637] ({pool-2-thread-5} 
SchedulerFactory.java[jobFinished]:137) - Job remoteInterpretJob_1468364377620 
finished by scheduler 
org.apache.zeppelin.livy.LivySparkRInterpreter1028865681{code}

This issue looks like Livy interpreter specific.
The interpreter works fine after restarting livy interpreter. 





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] zeppelin issue #1170: BigQuery Interpreter for Apazhe Zeppelin[ZEPPELIN-1153...

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1170
  
Great contribution, thank you!

Couple of questions on top of few one already raised above:
 - will you be willing to add some tests as well? Looking at other 
interpreters impl like #1164 one can see how to test I.e syntax errors and 
other conditions, etc
 - would it be hard or do you have plans to implement `cancel` and 
`getProgress` as part of this contribution? They are very usefull in case of 
big queries and improve user experience a lot on UI
 - in current code, you use static interpreter registration mechanism, 
which is now [deprecated](https://issues.apache.org/jira/browse/ZEPPELIN-804) 
and all interpreters are in the process of migration. While we are here, in 
order not to create one more migration sub-tesk for later, could you please 
switch to `interpreter-settings.json` one instead? Its a dime change, here is 
an example of how it is done for another interpreter #1063 
 - every interpreter and it's supported/unsupported features and 
cobfiguration options are usually documented under `/docs/` which becomes part 
of the 
[website](http://zeppelin.apache.org/docs/0.6.0/development/howtocontributewebsite.html).
 Would you care to document this one as well?
 - for every new library introduced by this module, which Jar will end up 
in the release convenience binary (all, with default scope) we need to have a 
record in 
`https://github.com/apache/zeppelin/blob/master/zeppelin-distribution/src/bin_license/LICENSE`
 specifying it's license

Feel free to ask here, if something is not clearly or in case you have any 
further questions!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Zeppelin 0.6.0 on CDH 5.7.1

[Benjamin Kim]

It looks like not mismatched versions. I tried local[*] mode and got the same 
error again just for Spark SQL (SQLContext).

java.lang.NullPointerException
at 
org.apache.spark.sql.hive.client.ClientWrapper.conf(ClientWrapper.scala:205)
at 
org.apache.spark.sql.hive.client.ClientWrapper.client(ClientWrapper.scala:261)
at 
org.apache.spark.sql.hive.client.ClientWrapper$$anonfun$withHiveState$1.apply(ClientWrapper.scala:273)
at 
org.apache.spark.sql.hive.client.ClientWrapper.liftedTree1$1(ClientWrapper.scala:228)
at 
org.apache.spark.sql.hive.client.ClientWrapper.retryLocked(ClientWrapper.scala:227)
at 
org.apache.spark.sql.hive.client.ClientWrapper.withHiveState(ClientWrapper.scala:270)
at org.apache.spark.sql.hive.HiveQLDialect.parse(HiveContext.scala:65)
at 
org.apache.spark.sql.SQLContext$$anonfun$2.apply(SQLContext.scala:211)
at 
org.apache.spark.sql.SQLContext$$anonfun$2.apply(SQLContext.scala:211)
at 
org.apache.spark.sql.execution.SparkSQLParser$$anonfun$org$apache$spark$sql$execution$SparkSQLParser$$others$1.apply(SparkSQLParser.scala:114)
at 
org.apache.spark.sql.execution.SparkSQLParser$$anonfun$org$apache$spark$sql$execution$SparkSQLParser$$others$1.apply(SparkSQLParser.scala:113)
at scala.util.parsing.combinator.Parsers$Success.map(Parsers.scala:136)
at scala.util.parsing.combinator.Parsers$Success.map(Parsers.scala:135)
at 
scala.util.parsing.combinator.Parsers$Parser$$anonfun$map$1.apply(Parsers.scala:242)
at 
scala.util.parsing.combinator.Parsers$Parser$$anonfun$map$1.apply(Parsers.scala:242)
at 
scala.util.parsing.combinator.Parsers$$anon$3.apply(Parsers.scala:222)
at 
scala.util.parsing.combinator.Parsers$Parser$$anonfun$append$1$$anonfun$apply$2.apply(Parsers.scala:254)
at 
scala.util.parsing.combinator.Parsers$Parser$$anonfun$append$1$$anonfun$apply$2.apply(Parsers.scala:254)
at 
scala.util.parsing.combinator.Parsers$Failure.append(Parsers.scala:202)
at 
scala.util.parsing.combinator.Parsers$Parser$$anonfun$append$1.apply(Parsers.scala:254)
at 
scala.util.parsing.combinator.Parsers$Parser$$anonfun$append$1.apply(Parsers.scala:254)
at 
scala.util.parsing.combinator.Parsers$$anon$3.apply(Parsers.scala:222)
at 
scala.util.parsing.combinator.Parsers$$anon$2$$anonfun$apply$14.apply(Parsers.scala:891)
at 
scala.util.parsing.combinator.Parsers$$anon$2$$anonfun$apply$14.apply(Parsers.scala:891)
at scala.util.DynamicVariable.withValue(DynamicVariable.scala:57)
at 
scala.util.parsing.combinator.Parsers$$anon$2.apply(Parsers.scala:890)
at 
scala.util.parsing.combinator.PackratParsers$$anon$1.apply(PackratParsers.scala:110)
at 
org.apache.spark.sql.catalyst.AbstractSparkSQLParser.parse(AbstractSparkSQLParser.scala:34)
at 
org.apache.spark.sql.SQLContext$$anonfun$1.apply(SQLContext.scala:208)
at 
org.apache.spark.sql.SQLContext$$anonfun$1.apply(SQLContext.scala:208)
at 
org.apache.spark.sql.execution.datasources.DDLParser.parse(DDLParser.scala:43)
at org.apache.spark.sql.SQLContext.parseSql(SQLContext.scala:231)
at org.apache.spark.sql.hive.HiveContext.parseSql(HiveContext.scala:333)
at org.apache.spark.sql.SQLContext.sql(SQLContext.scala:817)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at 
sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at 
sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:497)
at 
org.apache.zeppelin.spark.SparkSqlInterpreter.interpret(SparkSqlInterpreter.java:117)
at 
org.apache.zeppelin.interpreter.LazyOpenInterpreter.interpret(LazyOpenInterpreter.java:94)
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterServer$InterpretJob.jobRun(RemoteInterpreterServer.java:341)
at org.apache.zeppelin.scheduler.Job.run(Job.java:176)
at 
org.apache.zeppelin.scheduler.ParallelScheduler$JobRunner.run(ParallelScheduler.java:162)
at 
java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:511)
at java.util.concurrent.FutureTask.run(FutureTask.java:266)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.access$201(ScheduledThreadPoolExecutor.java:180)
at 
java.util.concurrent.ScheduledThreadPoolExecutor$ScheduledFutureTask.run(ScheduledThreadPoolExecutor.java:293)
at 
java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
at 
java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
at java.lang.Thread.run(Thread.java:745)

Thanks,
Ben


> On Jul 9, 2016, at 11:43 PM, Felix Cheung  wrote:
> 
> Right, it is possible we might encounter this with Spark 2.0.
> 
> 

google bigQuery Interpreter

[Babu Prasad Elumalai]

Hi,

https://issues.apache.org/jira/browse/ZEPPELIN-1153

I have created an Interpreter for BigQuery for Apache Zeppelin.
The code is currently in my local dev environment and I would like to
review and push the changes out.

Above is the Jira that I created for this project.

Please let me know how I should proceed with this.

Thanks!

-Babu

[GitHub] zeppelin pull request #1170: BigQuery Interpreter for Apazhe Zeppelin[ZEPPEL...

[babupe]

GitHub user babupe opened a pull request:

https://github.com/apache/zeppelin/pull/1170

BigQuery Interpreter for Apazhe Zeppelin[ZEPPELIN-1153]

### What is this PR for?
Google BigQuery is a popular no-ops datawarehouse. This commit will enable 
Apache Zeppelin users to perform BI and Analytics on their datasets in BigQuery.

### What type of PR is it?
Feature

### Todos
* Make bigquery interpreter appear in the interpreters section in the UI
* Build SQL completion 
* Authorization of non-gcp 

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1153

### How should this be tested?
copy conf/zeppelin-site.xml.template to conf/zeppelin-site.xml
Add org.apache.zeppelin.bigquery.bigQueryInterpreter to property 
zeppelin.interpreters in zeppelin-site.xml
Start Zeppelin
Add BigQuery Interpreter with your project ID
Create new note with %bsql.sql and run your SQL against public datasets in 
bigquery.

### Screenshots (if appropriate)
![screenshot from 2016-07-12 14 27 
30](https://cloud.githubusercontent.com/assets/4242273/16785302/31b104e2-4842-11e6-87c0-b79763dd85c0.png)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/babupe/zeppelin babupe-bigquery

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1170.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1170


commit 2a2bedcf3f90459f2fae5d7efe4798cd6058748f
Author: Babu Prasad Elumalai 
Date:   2016-07-12T21:37:10Z

BigQuery Interpreter for Apazhe Zeppelin




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-1158) Use "zeppelin-${cluster_name}@${realm}" instead of "zeppelin/${cluster-name}{realm}" for identity in kerberos.json

[Shraddha Sumit (JIRA)]

Shraddha Sumit created ZEPPELIN-1158:


 Summary: Use "zeppelin-${cluster_name}@${realm}" instead of 
"zeppelin/${cluster-name}{realm}" for identity in kerberos.json
 Key: ZEPPELIN-1158
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1158
 Project: Zeppelin
  Issue Type: Bug
  Components: zeppelin-server
Reporter: Shraddha Sumit
Priority: Critical


1. deploy cluster using ambari Ui including zeppelin as service
2. enable kerberos.
On configure identities page verify zeppelin principal
Expected: unique principal of form zeppelin-cl1 to be found
Actual: Found non unique principal: "zeppelin/$
{ cluster_name}
@$
{ realm}
"



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

ApacheCon Europe Call For Papers Open

[Rich Bowen]

As you are no doubt already aware, we will be holding ApacheCon in
Seville, Spain, the week of November 14th, 2016. The call for papers
(CFP) for this event is now open, and will remain open until 
September 9th.

The event is divided into two parts, each with its own CFP. The first
part of the event, called Apache Big Data, focuses on Big Data
projects and related technologies.

Website: http://events.linuxfoundation.org/events/apache-big-data-europe
CFP: http://events.linuxfoundation.org/events/apache-big-data-europe/program/cfp

The second part, called ApacheCon Europe, focuses on the Apache
Software Foundation as a whole, covering all projects, community
issues, governance, and so on.

Website: http://events.linuxfoundation.org/events/apachecon-europe
CFP: http://events.linuxfoundation.org/events/apachecon-europe/program/cfp

ApacheCon is the official conference of the Apache Software
Foundation, and is the best place to meet members of your project and
other ASF projects, and strengthen your project's community.

If your organization is interested in sponsoring ApacheCon, contact me
at e...@apache.org  ApacheCon is a great place to find the brightest
developers in the world, and experts on a huge range of technologies.

I hope to see you in Seville!

[GitHub] zeppelin issue #1145: [ZEPPELIN-1012] Support Interpreter Aliases

[Leemoonsoo]

Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1145
  
Another behavior change i found from this PR is,

When no interpreter is binded to a notebook, (e.g. incase of 
conf/interpreter.json is removed)
When user open a notebook, Zeppelin automatically open interpreter binding 
menu and suggest default set of selections.

Previously, default set of selections were, a interpreter setting from each 
interpreter groups.
For example, if there are interpreter setting `spark, spark2, md, sh`, 
suggested selection will be `spark, md, sh`.


![image](https://cloud.githubusercontent.com/assets/1540981/16780143/36dacf38-482a-11e6-8865-dfdb80509725.png)

This PR suggest the first interpreter setting only. `spark` in the same 
situation.


![image](https://cloud.githubusercontent.com/assets/1540981/16780096/fdad68d8-4829-11e6-8242-0a22856b5859.png)



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1145: [ZEPPELIN-1012] Support Interpreter Aliases

[Leemoonsoo]

Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1145
  
@jongyoul 

Regarding `Prefix Not found`,

Thought it was coming from this PR but found that `Prefix Not found` 
message looks like coming after  ca27bf5c11ad29070eb392f04ea4867d992313fa.
Previously, in the same situation, `sql interpreter not found` was printed.

The difference is, previously, ZeppelinServer (InterpreterFactory, 
NoteReplLoader) decide which interpreter to load and print `sql interpreter not 
found`. After ca27bf5c11ad29070eb392f04ea4867d992313fa, it starts jdbc 
interpreter and jdbc interpreter prints it.



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1157: [ZEPPELIN-1146] Zeppelin JDBC interpreter should work ...

[prabhjyotsingh]

Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/1157
  
@rja1 Sure, attaching both screenshot and json. I have tested this for hive 
and phoenix.

https://cloud.githubusercontent.com/assets/674497/16776893/11020f28-4885-11e6-878b-d715561efca3.png;>


```
{
"id": "2BQPN9U57",
"name": "jdbc",
"group": "jdbc",
"properties": {
"phoenix.user": "phoenixuser",
"hive.url": 
"jdbc:hive2://prabhu-zeppelin-secure-1.novalocal:2181,prabhu-zeppelin-secure-2.novalocal:2181,prabhu-zeppelin-secure-4.novalocal:2181/;serviceDiscoveryMode\u003dzooKeeper;zooKeeperNamespace\u003dhiveserver2",
"psql.password": "",
"default.driver": "org.postgresql.Driver",
"phoenix.driver": 
"org.apache.phoenix.jdbc.PhoenixDriver",
"hive.user": "hive",
"psql.user": "phoenixuser",
"psql.url": "jdbc:postgresql://localhost:5432/",
"default.user": "gpadmin",
"phoenix.hbase.client.retries.number": "1",
"phoenix.url": 
"jdbc:phoenix:prabhu-zeppelin-secure-1.novalocal,prabhu-zeppelin-secure-2.novalocal,prabhu-zeppelin-secure-4.novalocal:/hbase-secure",
"tajo.url": "jdbc:tajo://localhost:26002/default",
"tajo.driver": "org.apache.tajo.jdbc.TajoDriver",
"psql.driver": "org.postgresql.Driver",
"default.password": "",
"zeppelin.interpreter.localRepo": 
"/usr/hdp/current/zeppelin-server/local-repo/2BQPN9U57",
"zeppelin.jdbc.auth.type": "KERBEROS",
"hive.password": "",
"zeppelin.jdbc.concurrent.use": "true",
"hive.driver": "org.apache.hive.jdbc.HiveDriver",
"zeppelin.jdbc.keytab.location": 
"/etc/security/keytabs/zeppelin.server.kerberos.keytab",
"common.max_count": "1000",
"phoenix.password": "",
"zeppelin.jdbc.principal": 
"zeppelin/secu...@example.com",
"zeppelin.jdbc.concurrent.max_connection": "10",
"default.url": "jdbc:postgresql://localhost:5432/"
},
"interpreterGroup": [{
"class": "org.apache.zeppelin.jdbc.JDBCInterpreter",
"name": "sql"
}],
"dependencies": [{
"groupArtifactVersion": 
"org.apache.hive:hive-jdbc:2.0.1",
"local": false
}, {
"groupArtifactVersion": 
"org.apache.hadoop:hadoop-common:2.7.2",
"local": false
}, {
"groupArtifactVersion": 
"org.apache.hive.shims:hive-shims-0.23:2.1.0",
"local": false
}, {
"groupArtifactVersion": 
"org.apache.phoenix:phoenix-core:4.4.0-HBase-1.1",
"local": false
}],
"option": {
"remote": true,
"perNoteSession": false,
"perNoteProcess": false,
"isExistingProcess": false
}
}
```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1157: [ZEPPELIN-1146] Zeppelin JDBC interpreter should work ...

[rja1]

Github user rja1 commented on the issue:

https://github.com/apache/zeppelin/pull/1157
  
@prabhjyotsingh would you mind sharing your jdbc interpreter settings 
please?  I must be missing something..  Thanks


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1144: [ZEPPELIN-1128] add try-catch in close() method.

[voyageth]

Github user voyageth commented on the issue:

https://github.com/apache/zeppelin/pull/1144
  
Change catch SQLException to Exception. I think connection.close() can 
throw other Exception.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1144: add try-catch in close() method.

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1144
  
@voyageth Could you please change the title including [ZEPPELIN-1128]?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #908: ZEPPELIN-598 ] Dynamic loading for Interpreter and API

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/908
  
What's the status of this PR?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1138: [DOC][MINOR] Add shell interpreter docs to _nav...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1138


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1144: add try-catch in close() method.

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1144
  
LGTM. Merging if there's no more discussion.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1169: [WIP] [ZEPPELIN-759] Spark 2.0 support

[Leemoonsoo]

GitHub user Leemoonsoo opened a pull request:

https://github.com/apache/zeppelin/pull/1169

[WIP] [ZEPPELIN-759] Spark 2.0 support

### What is this PR for?
This PR implement spark 2.0 support based on #747.
This PR has approach from #980 which is reimplementing code in scala.

You can try build this branch

```
mvn clean package -Dscala-2.11 -Pspark-2.0 -Dspark.version=2.0.0-preview 
-Ppyspark -Psparkr -Pyarn -Phadoop-2.6 -DskipTests
```

### What type of PR is it?
Improvements

### Todos
* [x] - Spark 2.0 support
* [ ] - Rebase after #747 merge
* [ ] - .travis.yml to use spark version 2.0.0 instead of 2.0.0-preview 
after spark 2.0.0 release
* [ ] - Update LICENSE file
* [ ] - Update related document (build)

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-759

### How should this be tested?

Build and try
```
mvn clean package -Dscala-2.11 -Pspark-2.0 -Dspark.version=2.0.0-preview 
-Ppyspark -Psparkr -Pyarn -Phadoop-2.6 -DskipTests
```

### Screenshots (if appropriate)

![spark2](https://cloud.githubusercontent.com/assets/1540981/16771611/fe804038-4805-11e6-8447-3fa4258bb51d.gif)

### Questions:
* Does the licenses files need update? yes
* Is there breaking changes for older versions? no
* Does this needs documentation? yes


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/Leemoonsoo/zeppelin spark2

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1169.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1169


commit 44622072f633f1aa2329df107f691f4a293bfc31
Author: Luciano Resende 
Date:   2016-02-25T04:46:46Z

[ZEPPELIN-605] Add support for Scala 2.11

Enable Zeppelin to be built with both Scala 2.10
and Scala 2.11, mostly to start supporting interpreters
that are moving to Scala 2.11 only such as Spark.

commit 864e52fc94997e16c2cb0922dd3af1423a4934a9
Author: Luciano Resende 
Date:   2016-04-02T17:14:11Z

[ZEPPELIN-605] Add Scala 2.11 build profile

commit d8628c7158e29b076b661585ff5359f0e21a8438
Author: Luciano Resende 
Date:   2016-04-07T15:16:10Z

[ZEPPELIN-605] Enable Scala 2.11 REPL support for Spark Interpreter

Scala 2.11 has changed a lot of it's REPL support and in order to enable
building with Scala 2.10 and 2.11 we need to enable the new Scala 2.11
REPL and also make the build to compile based on the scala version.

commit ac0088bc86fc25eecec7e737f3acbeb93c181a20
Author: Luciano Resende 
Date:   2016-04-13T05:15:55Z

[ZEPPELIN-605] Rewrite Spark interpreter based on Scala 2.11 support

commit ceb1480be3d45f0c07f8dd01e42c0496863f2898
Author: Lee moon soo 
Date:   2016-06-09T16:45:03Z

Initial scala-210, 211 support in the single binary

commit fefcb2b8ad8589c40cd3849f2b02a50486d89a3d
Author: Lee moon soo 
Date:   2016-06-10T00:40:39Z

scala 2.11 support for spark interpreter

commit 32650c7b58257af5cf723c4ca55e736e02e6344d
Author: Lee moon soo 
Date:   2016-06-10T02:29:36Z

Fix some reflections

commit ce4a2d828486b1200394ffe89192ece03c6ca750
Author: Lee moon soo 
Date:   2016-06-10T02:57:57Z

Fix reflection on creating SparkCommandLine

commit fe3f8ea1fef6a4b5540cf3c70085156734659c8d
Author: Lee moon soo 
Date:   2016-06-10T19:40:07Z

Fix reflection around HttpServer and createTempDir

commit 35fc8a08403d24713e3c70c0c0e981fc1c005808
Author: Lee moon soo 
Date:   2016-06-11T05:55:49Z

fix style

commit 9542299a56a76a86403119b39b9e2a126b3312de
Author: Lee moon soo 
Date:   2016-06-13T17:24:52Z

Fix reflection

commit 43d4a700c1d78b40009103b03cb5b6c0ac1d4ea3
Author: Lee moon soo 
Date:   2016-06-13T17:31:39Z

style

commit 6da1364fe58df3188c1facdde2eae44f3dd77dfd
Author: Lee moon soo 
Date:   2016-06-13T18:10:19Z

SparkContext sharing seems not working in scala 2.11, disable the test

commit d7bd3ee10596008e41b6dfe6021449d161d50454
Author: Lee moon soo 
Date:   2016-06-13T19:10:20Z

Update FlinkInterpreter

commit c7df53d9007c8c3e78308c881928cacf97cfb468
Author: Lee moon soo 
Date:   2016-06-13T19:34:19Z

Update ignite interpreter

commit 1102d00fea1da86fab9c73f8055db37dc9959e87
Author: Lee moon soo 
Date:   2016-06-13T19:51:27Z

Remove unused methods

commit 9b2adf844f7dfe0986b975e2e9adda2efad30e30
Author: Luciano Resende 
Date:   2016-06-16T06:47:09Z

Force close

Closes 

Re: Actual execution time is not getting displayed in paragraph

[Sachin Janani]

Ok will create a issue and if possible submit a patch for this

Thanks,
SJ

On Tue, Jul 12, 2016 at 8:09 PM, Hyung Sung Shim  wrote:

> Yea. It seems you're right.
> You can create issue for this.
>
> 2016-07-12 23:26 GMT+09:00 Sachin Janani :
>
> > But i think this changes are overridden by
> > https://github.com/apache/zeppelin/pull/862 and the number of seconds
> are
> > not visible now
> >
> > On Tue, Jul 12, 2016 at 7:48 PM, Hyung Sung Shim 
> > wrote:
> >
> > > Hi.
> > > Yes it's a known behaviour maybe since
> > > https://github.com/apache/zeppelin/pull/848.
> > >
> > > 2016-07-12 21:49 GMT+09:00 Sachin Janani :
> > >
> > > > Hi All,
> > > > In the latest release of zeppelin it seems that the actual task
> > execution
> > > > time is not displayed on the paragraph which was previously working
> > > > properly.
> > > > After looking into the code I found that  it has been replaced with
> > > > Moment.js which shows length of time as string ,something like "Took
> a
> > > few
> > > > seconds" but not exactly the number of seconds .
> > > > Is this a know behaviour?
> > > >
> > > >
> > > > Thanks and Regards,
> > > > Sachin Janani
> > > >
> > >
> >
>

Re: Actual execution time is not getting displayed in paragraph

[Hyung Sung Shim]

Yea. It seems you're right.
You can create issue for this.

2016-07-12 23:26 GMT+09:00 Sachin Janani :

> But i think this changes are overridden by
> https://github.com/apache/zeppelin/pull/862 and the number of seconds are
> not visible now
>
> On Tue, Jul 12, 2016 at 7:48 PM, Hyung Sung Shim 
> wrote:
>
> > Hi.
> > Yes it's a known behaviour maybe since
> > https://github.com/apache/zeppelin/pull/848.
> >
> > 2016-07-12 21:49 GMT+09:00 Sachin Janani :
> >
> > > Hi All,
> > > In the latest release of zeppelin it seems that the actual task
> execution
> > > time is not displayed on the paragraph which was previously working
> > > properly.
> > > After looking into the code I found that  it has been replaced with
> > > Moment.js which shows length of time as string ,something like "Took a
> > few
> > > seconds" but not exactly the number of seconds .
> > > Is this a know behaviour?
> > >
> > >
> > > Thanks and Regards,
> > > Sachin Janani
> > >
> >
>

Re: Actual execution time is not getting displayed in paragraph

[Sachin Janani]

But i think this changes are overridden by
https://github.com/apache/zeppelin/pull/862 and the number of seconds are
not visible now

On Tue, Jul 12, 2016 at 7:48 PM, Hyung Sung Shim  wrote:

> Hi.
> Yes it's a known behaviour maybe since
> https://github.com/apache/zeppelin/pull/848.
>
> 2016-07-12 21:49 GMT+09:00 Sachin Janani :
>
> > Hi All,
> > In the latest release of zeppelin it seems that the actual task execution
> > time is not displayed on the paragraph which was previously working
> > properly.
> > After looking into the code I found that  it has been replaced with
> > Moment.js which shows length of time as string ,something like "Took a
> few
> > seconds" but not exactly the number of seconds .
> > Is this a know behaviour?
> >
> >
> > Thanks and Regards,
> > Sachin Janani
> >
>

Re: Actual execution time is not getting displayed in paragraph

[Hyung Sung Shim]

Hi.
Yes it's a known behaviour maybe since
https://github.com/apache/zeppelin/pull/848.

2016-07-12 21:49 GMT+09:00 Sachin Janani :

> Hi All,
> In the latest release of zeppelin it seems that the actual task execution
> time is not displayed on the paragraph which was previously working
> properly.
> After looking into the code I found that  it has been replaced with
> Moment.js which shows length of time as string ,something like "Took a few
> seconds" but not exactly the number of seconds .
> Is this a know behaviour?
>
>
> Thanks and Regards,
> Sachin Janani
>

[GitHub] zeppelin pull request #1166: Added another location of metastore_db in .giti...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1166


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1168: [MINOR] Add formatter

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1168
  
Ready to review. Could you please check Eclipse's one? Open 
ZeppelinServer.java and reformat it and check if something's different or not.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1168: [MINOR] Add formatter

[jongyoul]

GitHub user jongyoul opened a pull request:

https://github.com/apache/zeppelin/pull/1168

[MINOR] Add formatter

### What is this PR for?
Unifying the format of codes

### What type of PR is it?
[Feature]

### Todos
* [x] - Add formatter
* [x] - Convert sample file

### What is the Jira issue?
N/A

### How should this be tested?

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jongyoul/zeppelin minor/add-formatter

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1168.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1168


commit 84f50062ae9179139510a0d9267c254dd0f0154b
Author: Jongyoul Lee 
Date:   2016-07-12T13:40:00Z

Added formatter for Intellij and Eclipse

commit 72d4307278c651f063ae48d5856b156be5cb581f
Author: Jongyoul Lee 
Date:   2016-07-12T13:40:50Z

Adjusted new style on ZeppelinServer.java




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Actual execution time is not getting displayed in paragraph

[Sachin Janani]

Hi All,
In the latest release of zeppelin it seems that the actual task execution
time is not displayed on the paragraph which was previously working
properly.
After looking into the code I found that  it has been replaced with
Moment.js which shows length of time as string ,something like "Took a few
seconds" but not exactly the number of seconds .
Is this a know behaviour?


Thanks and Regards,
Sachin Janani

[GitHub] zeppelin issue #1157: [ZEPPELIN-1146] Zeppelin JDBC interpreter should work ...

[prabhjyotsingh]

Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/1157
  
Yes fair point, let me do a quick test and do it right away.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #989: Added ipfsnotebookrepo [ Zeppelin-683 WIP ]

[onkarshedge]

Github user onkarshedge commented on the issue:

https://github.com/apache/zeppelin/pull/989
  
@bzz right now I am working on Bittorrent support. I am using the 
[jlibtorrent](https://github.com/frostwire/frostwire-jlibtorrent) which uses 
libtorrent. The past week I spent time on using this library and some 
examples.I will post a PR in 2-3 days. Sorry for late response.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1157: [ZEPPELIN-1146] Zeppelin JDBC interpreter should work ...

[rconline]

Github user rconline commented on the issue:

https://github.com/apache/zeppelin/pull/1157
  
@jongyoul i think this suggestion makes sense. Its possible that other jdbc 
data sources may have security setup via ACL and don't need Kerberos. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1163: [ZEPPELIN-1149] %sh interpreter kerberos support

[rconline]

Github user rconline commented on the issue:

https://github.com/apache/zeppelin/pull/1163
  
@jongyoul here are some reference - http://linux.die.net/man/1/kinit & 
http://www.tutorialspoint.com/unix_commands/kinit.htm


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1157: [ZEPPELIN-1146] Zeppelin JDBC interpreter should work ...

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1157
  
And It's not necessary to have hadoop dependencies in case not to depend on 
hadoop environment like mysql and postresql. I think we need different way to 
deal with it. I think it's better to change the scope of those dependencies as 
provided and Zeppelin handles it with reflection. In case that you use Hive, 
you already have a dependencies of hadoop-common thus it's OK, otherwise, 
JdbcInterpreter doesn't need to have hadoop-common. What do you think of my 
idea?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1157: [ZEPPELIN-1146] Zeppelin JDBC interpreter should work ...

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1157
  
Doesn't it become potential problem to set hadoop version as 2.7.2? Is 
there a way to fit the version of hadoop globally?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1110: [ZEPPELIN-1091] Disable ace editor's showSettingsMenu ...

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1110
  
@astroshim Can you rebase it?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1110: [ZEPPELIN-1091] Disable ace editor's showSettingsMenu ...

[astroshim]

Github user astroshim commented on the issue:

https://github.com/apache/zeppelin/pull/1110
  
Is this PR going to be merged?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1160: WIP [Zeppelin - 1152] Listing note revision history

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1160
  
![screen shot 2016-07-12 at 5 42 56 
pm](https://cloud.githubusercontent.com/assets/710411/16760930/f0a79850-4858-11e6-95e3-7aa1462f47fe.png)

I made a dropdown for the revisions, so that it always show current one.
The caret button is only shown if there is some revisions.

Current dropdown format is: Date - Commit message


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1135: Add force layout visualization in paragraphs for SQL q...

[davidtzoor]

Github user davidtzoor commented on the issue:

https://github.com/apache/zeppelin/pull/1135
  
@corneadoug so is my PR ok?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1117: [ZEPPELIN-1086] Auto Completion for Interpreter.

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1117
  
@astroshim looks awesome, thank you for implementing!

How do you think, would it improve user experience with this feature if we 
could remove from suggestion list things, that are not interpreters? Like 
function names, etc. And how hard would that be to implement?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1161: [ZEPPELIN-906] Apply new mechanism to AlluxioIn...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1161


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #989: Added ipfsnotebookrepo [ Zeppelin-683 WIP ]

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/989
  
ping, @onkarshedge are there any updates for the past week?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-1157) Upgrade Angular and related libraries to a newer version

[JIRA]

François Rosière created ZEPPELIN-1157:
--

 Summary: Upgrade Angular and related libraries to a newer version
 Key: ZEPPELIN-1157
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1157
 Project: Zeppelin
  Issue Type: Improvement
  Components: GUI
Affects Versions: 0.6.0
Reporter: François Rosière


The Angular version and related dependencies should be updated to a newer 
version. 

The last Angular version is 1.5.7 while in Zeppelin we currently use the 1.5.0.

It becomes a real issue when we need to add more libraries having dependencies 
to Angular. In example: Angular Material (simplify layout definitions.), etc.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

Re: Any masterial about the internal architecture of zeppelin

[Alexander Bezzubov]

Hi Canan,

the best architecture documentation we have so far is "How to write an
interpreter" [1].

Hope this helps, and we are always looking for contributions especially in
the documentation area [2], so please do no hesitate to share your
discoveries!

 1.
http://zeppelin.apache.org/docs/0.6.0/development/writingzeppelininterpreter.html
 2.
http://zeppelin.apache.org/docs/0.6.0/development/howtocontributewebsite.html

--
Alex

On Tue, Jul 12, 2016 at 2:06 PM, Jongyoul Lee  wrote:

> Hi,
>
> There's no material for Zeppelin, but you can use debugger in your IDE and
> it would help to figure out Zeppelin's internal structure.
>
> Hope this help,
> JL
>
> On Tue, Jul 12, 2016 at 12:12 PM, canan chen  wrote:
>
> > I found several slides about zeppelin, but all of them are about the
> usage
> > of zeppelin. I am reading the zeppelin code and would like to contribute
> on
> > that. Is there any material about the internal architecture of zeppelin.
> > especially how the interpreter and display system work together. how to
> > debug that ? Thanks
> >
>
>
>
> --
> 이종열, Jongyoul Lee, 李宗烈
> http://madeng.net
>

[GitHub] zeppelin issue #747: [ZEPPELIN-605] Add support for Scala 2.11

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/747
  
Looks 👍 💯  to me
 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1147: ZEPPELIN-1130 Make Livy create session retries ...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1147


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1158: [ZEPPELIN-1131] Does not initialize login page ...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1158


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1166: Added another location of metastore_db in .gitignore

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1166
  
It's very simple PR and I'm merging it


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1166: Added another location of metastore_db in .giti...

[jongyoul]

GitHub user jongyoul opened a pull request:

https://github.com/apache/zeppelin/pull/1166

Added another location of metastore_db in .gitignore

### What is this PR for?
Avoiding tracking from metastore_db when you run ZeppelinServer in you IDE

### What type of PR is it?
[Improvement]

### Todos
* [x] - Add recursive directory of metastore_db in .gitignore

### What is the Jira issue?
N/A

### How should this be tested?

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jongyoul/zeppelin 
minor/add-metastore-db-in-gitignore

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1166.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1166


commit 65d195ae43e887345eb208281c7c34a5c40be9e6
Author: Jongyoul Lee 
Date:   2016-07-12T06:40:40Z

Added **/metastore-db in gitignore




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1163: [ZEPPELIN-1149] %sh interpreter kerberos support

[rconline]

Github user rconline commented on the issue:

https://github.com/apache/zeppelin/pull/1163
  
@felixcheung over a period of time, each interpreter will start to have 
their own Keytab's. I think we should have separate keytabs for different 
interpreters. We will ofcourse have to invest on getting a better management 
console for interpreters themselves. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1145: [ZEPPELIN-1012] Support Interpreter Aliases

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1145
  
Merging if there's no more discussion


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---