[GitHub] zeppelin issue #1336: [ZEPPELIN-1333] prevent calling runParagraph() on shif...

2016-08-18 Thread corneadoug
Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1336
  
@jongyoul Yes, and Front-end tests are green too.
So let's merge it


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1313: [ZEPPELIN-1245] Focus first paragraph after not...

2016-08-18 Thread rajarajan-g
Github user rajarajan-g closed the pull request at:

https://github.com/apache/zeppelin/pull/1313


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1313: [ZEPPELIN-1245] Focus first paragraph after not...

2016-08-18 Thread rajarajan-g
GitHub user rajarajan-g reopened a pull request:

https://github.com/apache/zeppelin/pull/1313

[ZEPPELIN-1245] Focus first paragraph after notebook creation

### What is this PR for?
Once the notebook is created, cursor should focus on the first paragraph


### What type of PR is it?
Bug Fix 

### Todos
* [ ] - None

### What is the Jira issue?
 https://issues.apache.org/jira/browse/ZEPPELIN-1245

### How should this be tested?
Once the Zeppelin server is started , Create a new notebook
check if cursor blinks on the first paragraph of the notebook

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/rajarajan-g/zeppelin ZEPPELIN-1245

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1313.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1313


commit e14792702e9011238b6431204bcefd472355106d
Author: rajarajan-g 
Date:   2016-08-10T08:41:12Z

fix for ZEPPELIN-1245

commit 068cd0b85d56ef615f8915418c6aeefae1abbfc7
Author: rajarajan-g 
Date:   2016-08-12T06:19:13Z

test case modified

commit 85794e9e79265e02bdd7d92b904768fff02d4551
Author: rajarajan-g 
Date:   2016-08-17T14:44:01Z

code modified as per review comments

commit 8eb7b32a6339d740524f1678066a4c74add058de
Author: rajarajan-g 
Date:   2016-08-17T15:08:03Z

test case changed to check the default behaviour




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1313: [ZEPPELIN-1245] Focus first paragraph after notebook c...

2016-08-18 Thread rajarajan-g
Github user rajarajan-g commented on the issue:

https://github.com/apache/zeppelin/pull/1313
  
Reopening the pull request to trigger CI build.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1340: [MINOR][DOC] Update available interpreters' ima...

2016-08-18 Thread AhyoungRyu
GitHub user AhyoungRyu opened a pull request:

https://github.com/apache/zeppelin/pull/1340

[MINOR][DOC] Update available interpreters' image in index.html

### What is this PR for?
I added available interpreters' logo image to `index.md` by #1004. So I 
updated this outdated `available_interpreters.png`. (added 
[BigQuery](https://cloud.google.com/bigquery/) & [Livy](http://livy.io/) logo)


### What type of PR is it?
Improvement

### What is the Jira issue?
Since it's just for `available_interpreters.png` update, didn't create Jira 
issue for this.

### Screenshots (if appropriate)
 - Before 
https://cloud.githubusercontent.com/assets/10060731/17765940/9783fd9a-6563-11e6-95e6-20b400209d80.png";>

 - After 
https://cloud.githubusercontent.com/assets/10060731/17765950/9ee9265a-6563-11e6-83f0-00728c4e31af.png";>


### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/AhyoungRyu/zeppelin 
update/availableInterpreterPic

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1340.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1340


commit 83206b8fcef9885d782a665bf9174a019780e820
Author: AhyoungRyu 
Date:   2016-08-18T07:46:01Z

Update available interpreters logo image in index.md




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GSoC - 2016][Zeppelin Notebooks] Fifth Notebook Review

2016-08-18 Thread anish singh
Hello,

Fifth notebook on the SNAP(Stanford Network Analysis Project) datasets is
ready for review at [0].

Documentation and blog for the notebook is ready at [1].

For ease of viewing, a sample video showing a demo run of the notebook is
available at [2].

Also, please let me know that for submission of work would it be alright to
paste/submit a link to the repository mentioned at [0]. Meanwhile, I will
work to clean up the repository and add appropriate documentation to
README.md file for other users to be able to run the notebooks.

Thanks,
Anish.


Re: [GSoC - 2016][Zeppelin Notebooks] Fifth Notebook Review

2016-08-18 Thread anish singh
Sorry, I forgot the links in the previous mail :-

Link to the notebook in repository -

[0]. https://github.com/anish18sun/Zeppelin-Notebooks/tree/master/2BTXWXKRW

Link to documentation and blog -

[1]. http://zeppelinnotes.blogspot.in/

Link to the demo video -

[2]. https://drive.google.com/open?id=0ByXTtaL2yHBuLW9maklXTGg0QlE

Thanks,
Anish.

On Thu, Aug 18, 2016 at 1:28 PM, anish singh  wrote:

> Hello,
>
> Fifth notebook on the SNAP(Stanford Network Analysis Project) datasets is
> ready for review at [0].
>
> Documentation and blog for the notebook is ready at [1].
>
> For ease of viewing, a sample video showing a demo run of the notebook is
> available at [2].
>
> Also, please let me know that for submission of work would it be alright
> to paste/submit a link to the repository mentioned at [0]. Meanwhile, I
> will work to clean up the repository and add appropriate documentation to
> README.md file for other users to be able to run the notebooks.
>
> Thanks,
> Anish.
>


[GitHub] zeppelin issue #1340: [MINOR][DOC] Update available interpreters' image in i...

2016-08-18 Thread anthonycorbacho
Github user anthonycorbacho commented on the issue:

https://github.com/apache/zeppelin/pull/1340
  
Can you order them alphabetically ? :)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1340: [MINOR][DOC] Update available interpreters' image in i...

2016-08-18 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1340
  
@anthonycorbacho Sure. Let me update then :)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1208: [gh-pages][ZEPPELIN-1216] Add a matrix table for "Zepp...

2016-08-18 Thread AhyoungRyu
Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1208
  
Using this PR I updated Spark logo to new one as #1279 did. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1336: [ZEPPELIN-1333] prevent calling runParagraph() on shif...

2016-08-18 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/1336
  
Yes, agreed, LGTM.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1341: [ZEPPELIN-1162] Fix rawType in NotebookRestApi

2016-08-18 Thread rajarajan-g
GitHub user rajarajan-g opened a pull request:

https://github.com/apache/zeppelin/pull/1341

[ZEPPELIN-1162] Fix rawType in NotebookRestApi

### What is this PR for?
Some HashSet is declared without types. Fix it in NotebookRestApi


### What type of PR is it?
Refactoring

### Todos


### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1162

### How should this be tested?
All existing test cases related to permissions

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/rajarajan-g/zeppelin ZEPPELIN-1162

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1341.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1341


commit 87b13f725deb7f76c0103a2666d2adde992e7a6e
Author: rajarajan-g 
Date:   2016-08-18T09:25:52Z

fix for rawtype




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1313: [ZEPPELIN-1245] Focus first paragraph after notebook c...

2016-08-18 Thread rajarajan-g
Github user rajarajan-g commented on the issue:

https://github.com/apache/zeppelin/pull/1313
  
CI build is success now. Please do review and let me in know in comments


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1318: [ZEPPELIN-1280][Spark on Yarn] Documents for running z...

2016-08-18 Thread felixcheung
Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/1318
  
I agree we could be more specific on the title/subject for this document.

But lots of company run production on Docker though, just FYI. Either 
Docker by itself on premise or in the cloud, with something like DC/OS.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1313: [ZEPPELIN-1245] Focus first paragraph after notebook c...

2016-08-18 Thread corneadoug
Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1313
  
I just tested this branch, but it isn't doing anything in my case


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1313: [ZEPPELIN-1245] Focus first paragraph after notebook c...

2016-08-18 Thread corneadoug
Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1313
  
Erratum, I was testing master branch


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1313: [ZEPPELIN-1245] Focus first paragraph after notebook c...

2016-08-18 Thread corneadoug
Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1313
  
In the case that the 1st paragraph's editor is hidden, it doesn't select. 
Do we care?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1341: [ZEPPELIN-1162] Fix rawType in NotebookRestApi

2016-08-18 Thread rajarajan-g
GitHub user rajarajan-g reopened a pull request:

https://github.com/apache/zeppelin/pull/1341

[ZEPPELIN-1162] Fix rawType in NotebookRestApi

### What is this PR for?
Some HashSet is declared without types. Fix it in NotebookRestApi


### What type of PR is it?
Refactoring

### Todos


### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1162

### How should this be tested?
All existing test cases related to permissions

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/rajarajan-g/zeppelin ZEPPELIN-1162

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1341.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1341


commit 87b13f725deb7f76c0103a2666d2adde992e7a6e
Author: rajarajan-g 
Date:   2016-08-18T09:25:52Z

fix for rawtype




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1341: [ZEPPELIN-1162] Fix rawType in NotebookRestApi

2016-08-18 Thread rajarajan-g
Github user rajarajan-g closed the pull request at:

https://github.com/apache/zeppelin/pull/1341


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1328: ZEPPELIN-1324: Make paragraph code selectable when run...

2016-08-18 Thread karup1990
Github user karup1990 commented on the issue:

https://github.com/apache/zeppelin/pull/1328
  
@corneadoug Addressed feedbacks.
Ready for review.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1342: [ZEPPELIN-1335] bug fixed y axis label for scat...

2016-08-18 Thread cloverhearts
GitHub user cloverhearts opened a pull request:

https://github.com/apache/zeppelin/pull/1342

[ZEPPELIN-1335] bug fixed y axis label for scatterChart and 
stackedAreaChart 

### What is this PR for?
When Y Axis be large value, the format that is displayed is incorrect.
(case by scatterChart and stackedAreaChart )


### What type of PR is it?
Bug Fix

### Todos
- [x] - fixed scatterChart  y Axis
- [x] - fixed stackedAreaChart y Axis format function.

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1335

### How should this be tested?
test paragraph context.
```
%spark 

case class DumyDataStruct(XAxis:Long, YAxis:Long)
var dumyDataRange = 1 to 1000

val dumyDataTable = dumyDataRange.map(data => {
DumyDataStruct(data, data * 10L)
}
)
dumyDataTable.toDF().registerTempTable("dumyGraph")
```

```
%sql
select * from dumyGraph
```
After running the Paragraphs, plase look at the Y-axis of the chart.

### Screenshots (if appropriate)
 before

![incorrect](https://cloud.githubusercontent.com/assets/10525473/17779342/4ff192f0-65a2-11e6-9008-f89f28dd208c.gif)

 after

![correct](https://cloud.githubusercontent.com/assets/10525473/17779339/4df4e3b2-65a2-11e6-90c8-6fee574aae12.gif)


### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/cloverhearts/zeppelin ZEPPELIN-1335

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1342.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1342


commit 550cb5d3ff05a09be2fccf91b9c697e1ed4642c3
Author: CloverHearts 
Date:   2016-08-18T15:08:47Z

pargarph result - scatterChart and stackedAreaChart label bug fixed




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1342: [ZEPPELIN-1335] bug fixed y axis label for scat...

2016-08-18 Thread cloverhearts
GitHub user cloverhearts reopened a pull request:

https://github.com/apache/zeppelin/pull/1342

[ZEPPELIN-1335] bug fixed y axis label for scatterChart and 
stackedAreaChart 

### What is this PR for?
When Y Axis be large value, the format that is displayed is incorrect.
(case by scatterChart and stackedAreaChart )


### What type of PR is it?
Bug Fix

### Todos
- [x] - fixed scatterChart  y Axis
- [x] - fixed stackedAreaChart y Axis format function.

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1335

### How should this be tested?
test paragraph context.
```
%spark 

case class DumyDataStruct(XAxis:Long, YAxis:Long)
var dumyDataRange = 1 to 1000

val dumyDataTable = dumyDataRange.map(data => {
DumyDataStruct(data, data * 10L)
}
)
dumyDataTable.toDF().registerTempTable("dumyGraph")
```

```
%sql
select * from dumyGraph
```
After running the Paragraphs, plase look at the Y-axis of the chart.

### Screenshots (if appropriate)
 before

![incorrect](https://cloud.githubusercontent.com/assets/10525473/17779342/4ff192f0-65a2-11e6-9008-f89f28dd208c.gif)

 after

![correct](https://cloud.githubusercontent.com/assets/10525473/17779339/4df4e3b2-65a2-11e6-90c8-6fee574aae12.gif)


### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/cloverhearts/zeppelin ZEPPELIN-1335

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1342.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1342


commit 550cb5d3ff05a09be2fccf91b9c697e1ed4642c3
Author: CloverHearts 
Date:   2016-08-18T15:08:47Z

pargarph result - scatterChart and stackedAreaChart label bug fixed




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1342: [ZEPPELIN-1335] bug fixed y axis label for scat...

2016-08-18 Thread cloverhearts
Github user cloverhearts closed the pull request at:

https://github.com/apache/zeppelin/pull/1342


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1343: ZEPPELIN-1328 - z.show in python interpreter do...

2016-08-18 Thread agoodm
GitHub user agoodm opened a pull request:

https://github.com/apache/zeppelin/pull/1343

ZEPPELIN-1328 - z.show in python interpreter does not display PNG images in 
python 3

### What is this PR for?
Support for plotting PNG images via matplotlib inline for the python 
interpreter was recently added (#1329). However, these changes did not work for 
python3 since it handles strings differently. This PR aims to make the inline 
plotting compatible with both python 2 and 3. 


### What type of PR is it?
Bug Fix

### What is the Jira issue?
* [ZEPPELIN-1328](https://issues.apache.org/jira/browse/ZEPPELIN-1328)

### How should this be tested?
In a python interpreteter cell, make sure the following produce an image:
```python
%python
import matplotlib.pyplot as plt
import numpy as np

x = np.arange(5)
plt.plot(x)
z.show(plt, fmt='png') # Repeat for fmt='svg'
```
This should be tested for both python2 and 3 interpreters (via the 
interpreter settings page). 

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/agoodm/zeppelin ZEPPELIN-1328

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1343.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1343






---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1344) Improving matplotlib integration with zeppelin

2016-08-18 Thread Alex Goodman (JIRA)
Alex Goodman created ZEPPELIN-1344:
--

 Summary: Improving matplotlib integration with zeppelin
 Key: ZEPPELIN-1344
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1344
 Project: Zeppelin
  Issue Type: Improvement
  Components: Interpreters, python-interpreter
Affects Versions: 0.7.0
Reporter: Alex Goodman
Assignee: Alex Goodman
 Fix For: 0.7.0


Currently plotting via matplotlib in a zeppelin notebook can be done using code 
like this:

{code}
%python
import matplotlib.pyplot as plt
import numpy as np
x = np.arange(5)
y = 2*x
plt.plot(x, y)
z.show(plt)
{code}

This style of inline notebook plotting has many limitations compared to that 
found in Jupyter, which of course has the advantage of being built natively in 
python as well as connections with the core matplotlib development team. This 
means for example in a Jupyter notebook, you can easily create an inline plot 
using

{code}
% matplotlib inline
import matplotlib.pyplot as plt
import numpy as np
x = np.arange(5)
y = 2*x
plt.plot(x, y)
plt.show()
{code}

You could even omit the call to {{plt.show()}} if the version of matplotlib you 
are using is 1.5 or later, and enable some interactive features similar to 
those in found in D3.js (like panning and zooming) if you instead use 
{{%matplotlib notebook}} at the top of the notebook cell. 

In order to accomplish this in zeppelin, we will first need to make our own 
custom matplotlib backend (I'll explain this in more detail in a separate JIRA 
issue). To summarize, these are the improvements in our matplotlib integration 
that should be made:

- Create a custom matplotlib backend for plotting inline images
- Support interactive plotting

On top of this, all of these changes should be ported to the pyspark 
interpreter as well since there are probably many users who would like to have 
matplotlib plotting in their spark related workflows. 



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[jira] [Created] (ZEPPELIN-1345) Create a custom matplotlib backend that natively supports inline plotting in a python interpreter cell

2016-08-18 Thread Alex Goodman (JIRA)
Alex Goodman created ZEPPELIN-1345:
--

 Summary: Create a custom matplotlib backend that natively supports 
inline plotting in a python interpreter cell
 Key: ZEPPELIN-1345
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1345
 Project: Zeppelin
  Issue Type: New Feature
  Components: python-interpreter
Affects Versions: 0.7.0
Reporter: Alex Goodman
Assignee: Alex Goodman
 Fix For: 0.7.0


This is a sub-task for ZEPPELIN-1344. The deliverable will be a custom 
matplotlib backend which natively supports inline plotting in zeppelin notebook 
cells (for the python and eventually pyspark interpreters). More information 
regarding matplotlib backends can be found here:

http://matplotlib.org/faq/usage_faq.html#what-is-a-backend

The focus of this issue will be getting support for plotting just static images 
similar to those generated in a Jupyter notebook cell when {{%matplotlib 
inline}} is used. Getting support for more interactive plotting will also 
require a custom backend that will be based off of this one.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


improving matplotlib integration in zeppelin

2016-08-18 Thread Goodman, Alexander (398K)
Hi all,

As per previous discussion I had with Alex Bezzubov on the users mailing
list, I have created two new JIRA issues ([1] and [2]) explaining in more
detail what I think we should ultimately strive for in our ongoing work to
improve matplotlib integration in zeppelin. For now I think I will be able
to handle the bulk of the work for the static images backend issue
[ZEPPELIN-1345] on my own, but more collaboration will be needed to get
interactive plotting to work.  Please feel free to discuss any thoughts or
suggestions you may have here.

[1] - https://issues.apache.org/jira/browse/ZEPPELIN-1344
[2] - https://issues.apache.org/jira/browse/ZEPPELIN-1345

Thanks,
Alex
-- 
Alex Goodman
Data Scientist I
Science Data Modeling and Computing (398K)
Jet Propulsion Laboratory
California Institute of Technology
Tel: +1-818-354-6012


Issues in Zeppelin 0.6.0

2016-08-18 Thread Nagasravanthi, Valluri
Hi,

I am using Zeppelin 0.6.0. Please find below the issues along with their 
detailed explanation.

Zeppelin 0.6.0 Issues:

a.   not able to execute DDL statements like Create/Drop tables using 
temptables derived from the hive table

* Error Log: "java.lang.RuntimeException: [1.1] failure: ``with'' 
expected but identifier drop found : When using sql interpreter to drop"



b.  not able to use the HiveContext to read the Hive table

* Error Log: "error: object HiveContext in package hive cannot be 
accessed in package org.apache.spark.sql.hive"

Detailed Explanation:
I upgraded to 0.6.0 from Zeppelin 0.5.6 last week. I am facing some issues 
while using notebooks on 0.6.0. I am using Ambari 2.4.2 as my Cluster Manager 
and Spark version is 1.6.

The workflow of notebook is as follows:

1.   Create a spark scala dataframe by reading a hive table in parquet/text 
format using sqlContext (sqlContext.read.parquet("/tablelocation/tablename")

2.   Import sqlcontext_implicits

3.   Register the dataframe as a temp table

4.   Write queries using %sql interpreter or sqlContext.sql

The issue which I am facing right now is that Even though I am able to execute 
"SELECT"  query on the temptables but I am not able to execute DDL statements 
like Create/Drop tables using temptables derived from the hive table.
Following is my code:
1st case:  sqlContext.sql("drop if exists tablename")
2nd case: %sql
  drop if exists tablename

I am getting the same error for both the cases: java.lang.RuntimeException: 
[1.1] failure: ``with'' expected but identifier drop found : When using sql 
interpreter to drop

It is to be noted that, the same code used to work in Zeppelin 0.5.6.

After researching a bit, I came across that I need to use HiveContext to query 
hive table.

The second issue which I am facing is I was able to import HiveContext using 
"import org.apache.spark.sql.hive.HiveContext" but I was not able to use the 
HiveContext to read the Hive table.

This is the code which I wrote :
(HiveContext.read.parquet("/tablelocation/tablename")

I got the following error:
error: object HiveContext in package hive cannot be accessed in package 
org.apache.spark.sql.hive

I am not able to deep dive into this error as there is not much support online.

Could anyone please suggest any fix for the errors ?

Thanks and Regards,

[Description: cid:image001.png@01D1EBF4.36D373B0]

Valluri Naga Sravanthi| On assignment to PfizerWorks
Cell: +91 9008412366
Email: pfizerwor...@pfizer.com; 
valluri.nagasravan...@pfizer.com
Website: http://pfizerWorks.pfizer.com



..



Re: Issues in Zeppelin 0.6.0

2016-08-18 Thread Jeff Zhang
Hi

Since you have many issues, let's focus one issue first.

>>> *not able to use the HiveContext to read the Hive table*


Can you paste your code of how you use HiveContext ? Do you create it by
yourself ? It should be created by zeppelin, so you don't need to create it.
What's  in interpreter log ?



On Thu, Aug 18, 2016 at 7:35 PM, Nagasravanthi, Valluri <
valluri.nagasravan...@pfizer.com> wrote:

> Hi,
>
>
>
> I am using Zeppelin 0.6.0. Please find below the issues along with their
> detailed explanation.
>
>
>
> *Zeppelin 0.6.0 Issues:*
>
> a.   *not able to execute DDL statements like Create/Drop tables
> using temptables derived from the hive table*
>
> · Error Log:* “*java.lang.RuntimeException: [1.1] failure:
> ``with'' expected but identifier drop found : When using sql interpreter to
> drop*”*
>
>
>
> b.  *not able to use the HiveContext to read the Hive table*
>
> · Error Log: *“*error: object HiveContext in package hive cannot
> be accessed in package org.apache.spark.sql.hive*”*
>
>
>
> *Detailed Explanation:*
>
> I upgraded to 0.6.0 from Zeppelin 0.5.6 last week. I am facing some issues
> while using notebooks on 0.6.0. I am using Ambari 2.4.2 as my Cluster
> Manager and Spark version is 1.6.
>
>
>
> The workflow of notebook is as follows:
>
> 1.   Create a spark scala dataframe by reading a hive table in
> parquet/text format using sqlContext (sqlContext.read.parquet(“/
> tablelocation/tablename”)
>
> 2.   Import sqlcontext_implicits
>
> 3.   Register the dataframe as a temp table
>
> 4.   Write queries using %sql interpreter or sqlContext.sql
>
>
>
> The issue which I am facing right now is that Even though I am able to
> execute “SELECT”  query on the temptables but *I am not able to execute
> DDL statements like Create/Drop tables using temptables derived from the
> hive table.  *
>
> Following is my code:
>
> 1st case:  sqlContext.sql(“drop if exists tablename”)
>
> 2nd case: %sql
>
>   drop if exists tablename
>
>
>
> I am getting the same error for both the cases:
> java.lang.RuntimeException: [1.1] failure: ``with'' expected but identifier
> drop found : When using sql interpreter to drop
>
>
>
> It is to be noted that, the same code used to work in Zeppelin 0.5.6.
>
>
>
> After researching a bit, I came across that I need to use HiveContext to
> query hive table.
>
>
>
> The second issue which I am facing is I was able to import HiveContext
> using “import org.apache.spark.sql.hive.HiveContext” *but I was not able
> to use the HiveContext to read the Hive table.*
>
>
>
> This is the code which I wrote :
>
> (HiveContext.read.parquet(“/tablelocation/tablename”)
>
>
>
> I got the following error:
>
> error: object HiveContext in package hive cannot be accessed in package
> org.apache.spark.sql.hive
>
>
>
> I am not able to deep dive into this error as there is not much support
> online.
>
>
>
> Could anyone please suggest any fix for the errors ?
>
>
>
> Thanks and Regards,
>
> **
>
> *[image: Description: cid:image001.png@01D1EBF4.36D373B0]*
>
> *Valluri Naga Sravanthi| On assignment to **P**fizerWorks*
>
> Cell*: +91 9008412366 <%2B91%209008412366>*
>
> *Email**: **pfizerwor...@pfizer.com* *; *
> *valluri.nagasravan...@pfizer.com* 
>
> *Website**: **http://pfizerWorks.pfizer.com*
> 
>
>
>
> *……*
>
>
>



-- 
Best Regards

Jeff Zhang


[jira] [Created] (ZEPPELIN-1346) Add contributing instructions to the website

2016-08-18 Thread CORNEAU Damien (JIRA)
CORNEAU Damien created ZEPPELIN-1346:


 Summary: Add contributing instructions to the website
 Key: ZEPPELIN-1346
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1346
 Project: Zeppelin
  Issue Type: Improvement
Reporter: CORNEAU Damien
Assignee: CORNEAU Damien


This issue is to move some of the contributions instructions to the website, 
and extend it to add more code specific good practices and advices.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1328: ZEPPELIN-1324: Make paragraph code selectable when run...

2016-08-18 Thread corneadoug
Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1328
  
@karup1990 Tested, works great
LGTM after fixing my inline comment


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1336: [ZEPPELIN-1333] prevent calling runParagraph() on shif...

2016-08-18 Thread corneadoug
Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1336
  
Merging if there is no more discussions


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1343: ZEPPELIN-1328 - z.show in python interpreter does not ...

2016-08-18 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1343
  
Looks great to me, thank you for taking care @agoodm !

Merging to master if there is no further discussion.


[CI 
failure](https://s3.amazonaws.com/archive.travis-ci.org/jobs/153350047/log.txt) 
is not relevant and is due to flaky `RemoteInterpreterTest` test
```
Running org.apache.zeppelin.interpreter.remote.RemoteInterpreterTest

18:31:23,153  INFO 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess:116 - 
Run interpreter process 
[/home/travis/build/apache/zeppelin/zeppelin-interpreter/../bin/interpreter.sh, 
-d, fake, -p, 50714, -l, fakeRepo]
18:31:23,660  INFO 
org.apache.zeppelin.interpreter.remote.RemoteInterpreter:223 - Create remote 
interpreter org.apache.zeppelin.interpreter.remote.mock.MockInterpreterA
18:31:23,906  INFO 
org.apache.zeppelin.interpreter.remote.RemoteInterpreter:223 - Create remote 
interpreter org.apache.zeppelin.interpreter.remote.mock.MockInterpreterB
18:31:23,945 ERROR 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventPoller:192 - Can't 
handle event RemoteInterpreterEvent(type:OUTPUT_UPDATE, 
data:{"data":"","noteId":"note","paragraphId":"id"})
java.lang.NullPointerException
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventPoller.run(RemoteInterpreterEventPoller.java:174)
18:31:23,986 ERROR 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventPoller:192 - Can't 
handle event RemoteInterpreterEvent(type:OUTPUT_APPEND, 
data:{"data":"","noteId":"note","paragraphId":"id"})
java.lang.NullPointerException
at 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterEventPoller.run(RemoteInterpreterEventPoller.java:160)
18:31:23,999  INFO 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess:127 - shutdown 
interpreter process
18:31:26,114  INFO 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterProcess:137 - Exception 
in RemoteInterpreterProcess while synchronized dereference, can safely ignore 
exception while client.shutdown() may terminates remote process
18:31:26,116  INFO 
org.apache.zeppelin.interpreter.remote.RemoteInterpreterManagedProcess:154 - 
Interpreter process exited 0
18:31:26,616  INFO org.apache.zeppelin.interpreter.InterpreterGroup:140 - 
Close interpreter group InterpreterGroup_1471545083152_-1987997814
18:31:26,634  INFO org.apache.zeppelin.interpreter.InterpreterGroup:204 - 
Destroy interpreter group InterpreterGroup_1471545083152_-1987997814
```


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1339: [WIP][ZEPPELIN-1332] Remove spark-dependencies & sugge...

2016-08-18 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1339
  
@AhyoungRyu great initiative, but while making this changes, you have to 
think also about CI use case of zeppelin build as well.

I.e so far `/.spark-dist/` is under cache on TravisCI which is S3 bucket 
that gets synced automatically with the content of this folder while running a 
build. It you un-tar the whole archive there - it will take forever to sync \w 
S3 and will defeat the purpose of cache on CI side, making build times longer.

If you ask me - I would say that before doing such big changes as 
refactoring of the build structure we all need very clear understanding and 
explanation of `what is the benefit` and what problem does this change solves. 

So far I have not understood the answer to the questions above from PR 
description (may be my fault). But, in case of voting for such change, will 
make me at least `-0` for if, if not `-1` due to potential bugs that such 
changes will bring.

If that is reduction of convenience binary size - then we need to know how 
much does the size changes with the proposed changes to understand if that is 
worth. If that impacts CI build times - we also need to know how much.

Also regarding user experience - while running `zeppelin-demon.sh` user 
does not usually expect it to be network-dependant and download 100Mb archives 
- is there at least a user notification\progress indicator? Otherwise there 
going to be bug reports like "Zeppelin is not starting" as soon as such change 
is introduced. 
And how about Windows users of Zeppelin? How about EMR\Dataproc\Juju\BigTop 
users, will the proposed change affect them?

Please take it with the grain of salt, and of course I will be happy to 
help addressing each item addressed one by one.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1334: [ZEPPELIN-682] New interpreter for Apache Beam (incuba...

2016-08-18 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1334
  
> It seems that your builder enforces the usage of Scala 2.11

@mfelgamal  you are right, `.travis.yml` contains Scala 2.11 as well as 
scala 2.10 profiles. 
In this case, could you please explicitly exclude `-pl "\!beam"` from [all 
such CI build 
profiles](https://github.com/apache/zeppelin/blob/master/.travis.yml#L38) and 
put a comment\commit message like `there is no maven Scala 2.11 build for Beam 
runner on Flink`


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1344: ZEPPELIN-1164: backport new Shiro realm to 0.6 ...

2016-08-18 Thread bzz
GitHub user bzz opened a pull request:

https://github.com/apache/zeppelin/pull/1344

ZEPPELIN-1164: backport new Shiro realm to 0.6 branch

Just a backport of #1173

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bzz/incubator-zeppelin branch-0.6-add-realm

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1344.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1344


commit fbf8615663bd24dc246dd40dbd2395b338384f82
Author: Anthony Corbacho 
Date:   2016-07-22T06:55:50Z

[ZEPPELIN-1164] ZeppelinHub Realm

Add a new Shiro Realm that lets users authenticate in Apache Zeppelin using 
their ZeppelinHub credentials.

`Feature`

* [x] - Create ZeppelinHub Realm that extends `AuthorizingRealm`.
* [x] - Update `shiro.ini` file and add ZeppelinHub configuration template.
* [x] - Add documentation

[Issue 1164](https://issues.apache.org/jira/browse/ZEPPELIN-1164)

 - Assuming that you already have an account 
[Zeppelinhub](https://www.zeppelinhub.com/register), edit `conf/shiro.ini` file 
and uncomment ZeppelinHub related configuration.
 - Start your Zeppelin
 - Login with your ZeppelinHub credentials.

* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? YES

Author: Anthony Corbacho 

Closes #1173 from anthonycorbacho/feat/ZeppelinHubAuthentication and 
squashes the following commits:

63b06c6 [Anthony Corbacho] Fix rebase mistake in documentation
0f16344 [Anthony Corbacho] Fix typo in documentation
5a27871 [Anthony Corbacho] Add Documentation about ZeppelinHub Realm 
configuration
8347fa9 [Anthony Corbacho] Handle long line > 100 char
9bf96ba [Anthony Corbacho] Remove author tag...
64154d4 [Anthony Corbacho] Add more method comments.
c207b5e [Anthony Corbacho] Change check of token.getUsername() in 
doGetAuthenticationInfo by using StringUtils::isBlank instead of checking only 
null.
38683e1 [Anthony Corbacho] Add new setting in Shiri.ini to handle 
ZeppelinHub realm.
34a8e5e [Anthony Corbacho] Create new Apache Shiro Realm for ZeppelinHub




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1344: ZEPPELIN-1164: backport new Shiro realm to 0.6 branch

2016-08-18 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1344
  
\cc @anthonycorbacho @Leemoonsoo @jongyoul for review


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1344: ZEPPELIN-1164: backport new Shiro realm to 0.6 branch

2016-08-18 Thread anthonycorbacho
Github user anthonycorbacho commented on the issue:

https://github.com/apache/zeppelin/pull/1344
  
look good


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[jira] [Created] (ZEPPELIN-1347) Release 0.6.2

2016-08-18 Thread Alexander Bezzubov (JIRA)
Alexander Bezzubov created ZEPPELIN-1347:


 Summary: Release 0.6.2
 Key: ZEPPELIN-1347
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1347
 Project: Zeppelin
  Issue Type: Wish
Reporter: Alexander Bezzubov
 Fix For: 0.6.2


There are few quite important bugs found in 0.6.1 (linked to this issue) it 
would be great to have them resolved ASAP and release 0.6.2



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)


[GitHub] zeppelin issue #1342: [ZEPPELIN-1335] bug fixed y axis label for scatterChar...

2016-08-18 Thread corneadoug
Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1342
  
@cloverhearts Tested, LGTM
Thanks for the fix


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1343: ZEPPELIN-1328 - z.show in python interpreter does not ...

2016-08-18 Thread bustios
Github user bustios commented on the issue:

https://github.com/apache/zeppelin/pull/1343
  
@agoodm your solution looks good, but the `import io` is going to generate 
an error in the `show_dataframe` method for Python 2. Running the tests can 
help you to catch this error. It would be better to use:

```python
from io import BytesIO
```
before (and not to delete):
```python
try:
import StringIO as io
except ImportError:
import io as io
```
another option could be:
```python
from io import BytesIO
try:
from StringIO import StringIO
except ImportError:
from io import StringIO
```
and replage `io.StringIO` by `StringIO`.

Personally, I prefer the second option because it has the advantage of 
avoiding the `io` package to be hidden by `import StringIO as io` for future 
use.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1342: [ZEPPELIN-1335] bug fixed y axis label for scatterChar...

2016-08-18 Thread cloverhearts
Github user cloverhearts commented on the issue:

https://github.com/apache/zeppelin/pull/1342
  
@corneadoug Thank you! have a nice day!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1231: [Zeppelin - 683][WIP] BittorrentNotebookRepo

2016-08-18 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1231
  
> If you are expecting to code the entire DHT from scratch, it's too tough 
for me

That is not an expectation here of course. 

Let's think about alternatives - another way is to distribute note.jspn 
though regular torrents, right? So we can assume that there is going to be a 
tracker one day, that lists all notebook that are shared and each Zeppelin 
instance will be just seeding it's own fraction of notebooks.

Then each revision of the note need to be stored as a separate file, as it 
will create a new torrent file\magnet link, right?

Do you think this will work?

 1. listing existing notes that shared through Bittorrent

  This will include listing local copies from filesystem i.e under 
`/notebook/bittorent` or `/notebook-bittorent` not to interfere \w existing 
VFSNotebookRepo impl.

 2. checkpointing AKA creating revisions
  Each revision will result in a new file i.e `note-revisionId.json` + a 
new .torrent/magnet link to share it

 3. listing revisions for each note
  This should be simple, given the assumptions from above. And each 
revision can be shared independently

 4. importing new note by magnet link (should work similar to current 
"import by URL")




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1342: [ZEPPELIN-1335] bug fixed y axis label for scatterChar...

2016-08-18 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1342
  
Great fix @cloverhearts and very nice PR description 👍 

Let's merge!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1343: ZEPPELIN-1328 - z.show in python interpreter does not ...

2016-08-18 Thread agoodm
Github user agoodm commented on the issue:

https://github.com/apache/zeppelin/pull/1343
  
@bustios Thanks for the catch. I agree that the second option you posted 
would be a lot cleaner, so I'll go ahead and test it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1344: ZEPPELIN-1164: backport new Shiro realm to 0.6 branch

2016-08-18 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1344
  
Thanks @anthonycorbacho for prompt review!

Merging to branch-0.6 if there is no further discussion


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1336: [ZEPPELIN-1333] prevent calling runParagraph() on shif...

2016-08-18 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1336
  
Looks great to me.

@corneadoug please, merge it to both _master_ and _branch-0.6_ as fix 
version is 0.6.2 for it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1333: [ZEPPELIN-1334] Environment variable defined in interp...

2016-08-18 Thread bzz
Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1333
  
@zjffdu thank you for fixing it!

After the review we better merge this to both, _master_ and _branch-0.6_


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1343: ZEPPELIN-1328 - z.show in python interpreter does not ...

2016-08-18 Thread agoodm
Github user agoodm commented on the issue:

https://github.com/apache/zeppelin/pull/1343
  
@bzz @bustios I tested the changes in a notebook for both python2/3 as well 
as ran the unit tests. Hopefully we are good to go this time.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1333: [ZEPPELIN-1334] Environment variable defined in interp...

2016-08-18 Thread zjffdu
Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1333
  
@bzz Sure, let me know if I need to create another PR for 0.6


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1310: [ZEPPELIN-913] Apply new mechanism to HbaseInte...

2016-08-18 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1310


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1322: [ZEPPELIN-1320] Run zeppelin interpreter process as we...

2016-08-18 Thread prabhjyotsingh
Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/1322
  
CI green! Ready for review.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1310: [ZEPPELIN-913] Apply new mechanism to HbaseInterpreter

2016-08-18 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1310
  
@ggdupont Could you tell me your jira ID? I'll update you as an assignee


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1231: [Zeppelin - 683][WIP] BittorrentNotebookRepo

2016-08-18 Thread onkarshedge
Github user onkarshedge commented on the issue:

https://github.com/apache/zeppelin/pull/1231
  
Yes, this can be done.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1333: [ZEPPELIN-1334] Environment variable defined in interp...

2016-08-18 Thread Leemoonsoo
Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1333
  
@zjffdu Tested and It looks good to me.

There is an unittest for set environment variable for remote interpreter at 
[RemoteInterpreterTest.java](https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/test/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterTest.java#L721).
 However, the unit test is not testing the case this fix addresses.

It's not going to be a blocker but I think it'll be really beneficial to 
have a unittest that covers this fix, somewhere in 
[InterpreterFactoryTest.java](https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/test/java/org/apache/zeppelin/interpreter/remote/RemoteInterpreterTest.java).
 @zjffdu Is it going to be difficult to add the test?  Let me know if you need 
any help!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1341: [ZEPPELIN-1162] Fix rawType in NotebookRestApi

2016-08-18 Thread rajarajan-g
Github user rajarajan-g closed the pull request at:

https://github.com/apache/zeppelin/pull/1341


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1341: [ZEPPELIN-1162] Fix rawType in NotebookRestApi

2016-08-18 Thread rajarajan-g
GitHub user rajarajan-g reopened a pull request:

https://github.com/apache/zeppelin/pull/1341

[ZEPPELIN-1162] Fix rawType in NotebookRestApi

### What is this PR for?
Some HashSet is declared without types. Fix it in NotebookRestApi


### What type of PR is it?
Refactoring

### Todos


### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1162

### How should this be tested?
All existing test cases related to permissions

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/rajarajan-g/zeppelin ZEPPELIN-1162

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1341.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1341


commit 87b13f725deb7f76c0103a2666d2adde992e7a6e
Author: rajarajan-g 
Date:   2016-08-18T09:25:52Z

fix for rawtype




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1301: [MINOR] Removed unused profiles from spark/pom.xml

2016-08-18 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1301
  
@zjffdu @bzz I've already removed yarn profile. Have I missed something?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1301: [MINOR] Removed unused profiles from spark/pom....

2016-08-18 Thread jongyoul
Github user jongyoul closed the pull request at:

https://github.com/apache/zeppelin/pull/1301


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1301: [MINOR] Removed unused profiles from spark/pom....

2016-08-18 Thread jongyoul
GitHub user jongyoul reopened a pull request:

https://github.com/apache/zeppelin/pull/1301

[MINOR] Removed unused profiles from spark/pom.xml

### What is this PR for?
Making spark/pom.xml simple

### What type of PR is it?
[Refactoring]

### Todos
* [x] - Simplified pom.xml in spark

### What is the Jira issue?
N/A

### How should this be tested?
No test. CI should be green

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jongyoul/zeppelin 
minor/remove-unused-profile-spark-pom

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1301.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1301


commit 0dc10e7a55d48094bdf7d02441a0aad1ee5d08ca
Author: Jongyoul Lee 
Date:   2016-08-08T06:39:19Z

Removed unused profiles from spark/pom.xml

commit fd7d012db3fd49a64fd93f09027401307b93a338
Author: Jongyoul Lee 
Date:   2016-08-08T07:00:53Z

Removed yarn dependency

commit 8de6cf84c9e13ad3be88e215d8f8c3e3ae014a37
Author: Jongyoul Lee 
Date:   2016-08-08T07:18:32Z

Removed yarn dependency




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1301: [MINOR] Removed unused profiles from spark/pom.xml

2016-08-18 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1301
  
And about docs, it never change some behaviour. I think another issue 
linked above is a better point to update docs.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1313: [ZEPPELIN-1245] Focus first paragraph after notebook c...

2016-08-18 Thread rajarajan-g
Github user rajarajan-g commented on the issue:

https://github.com/apache/zeppelin/pull/1313
  
In my opinion, since the editor itself is not available, it shouldn't focus 
that paragraph which is also behaviour after this PR

If you/other folks have any other opinions, please let me know.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


Re: improving matplotlib integration in zeppelin

2016-08-18 Thread moon soo Lee
Hi,

It's great to see improving matplotlib integration. Thanks a lot.

In my understanding, in interactive mode, the graph supposed to be updated
even if some matplotlib methods are called in the other paragraph(cell).
That means the result of a paragraph need to be updated by running another
paragraph.

Currently, i think there're two different facilities in Zeppelin to do that.

One possible way is using InterpreterContextRunner [1]. InterpreterContext
provides InterpreterContextRunner[2] and it gives ability to run other
paragraphs in the same note. However this approach does have some
limitations. Like if paragraph (cell) is in the other notebook, interactive
update of graph will not work anymore. And because it's not only update the
result of the other paragraph, but also run the other paragraph, it'll be
difficult to make interactive mode work correctly depends on user code in
each paragraphs.

Second possible approach is using AngularDisplay system.
Which allows interpreter send/receive some data and event from/to front-end
side.
So without rerun another paragraph, it's possible to update result of a
paragraph from another.
Any interpreter can get AngularObjectRegistry[3] from InterpreterContext
[4], and AngularObjectRegistry allows create object / add event hook to
communicate with front-end. I think this is more feasible approach.

Thanks,
moon

[1]
https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/zeppelin/interpreter/InterpreterContextRunner.java
[2]
https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/zeppelin/interpreter/InterpreterContext.java#L123
[3]
https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/zeppelin/display/AngularObjectRegistry.java
[4]
https://github.com/apache/zeppelin/blob/master/zeppelin-interpreter/src/main/java/org/apache/zeppelin/interpreter/InterpreterContext.java#L115


On Thu, Aug 18, 2016 at 11:57 AM Goodman, Alexander (398K) <
alexander.good...@jpl.nasa.gov> wrote:

> Hi all,
>
> As per previous discussion I had with Alex Bezzubov on the users mailing
> list, I have created two new JIRA issues ([1] and [2]) explaining in more
> detail what I think we should ultimately strive for in our ongoing work to
> improve matplotlib integration in zeppelin. For now I think I will be able
> to handle the bulk of the work for the static images backend issue
> [ZEPPELIN-1345] on my own, but more collaboration will be needed to get
> interactive plotting to work.  Please feel free to discuss any thoughts or
> suggestions you may have here.
>
> [1] - https://issues.apache.org/jira/browse/ZEPPELIN-1344
> [2] - https://issues.apache.org/jira/browse/ZEPPELIN-1345
>
> Thanks,
> Alex
> --
> Alex Goodman
> Data Scientist I
> Science Data Modeling and Computing (398K)
> Jet Propulsion Laboratory
> California Institute of Technology
> Tel: +1-818-354-6012
>


[GitHub] zeppelin pull request #1341: [ZEPPELIN-1162] Fix rawType in NotebookRestApi

2016-08-18 Thread rajarajan-g
GitHub user rajarajan-g reopened a pull request:

https://github.com/apache/zeppelin/pull/1341

[ZEPPELIN-1162] Fix rawType in NotebookRestApi

### What is this PR for?
Some HashSet is declared without types. Fix it in NotebookRestApi


### What type of PR is it?
Refactoring

### Todos


### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1162

### How should this be tested?
All existing test cases related to permissions

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/rajarajan-g/zeppelin ZEPPELIN-1162

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1341.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1341


commit 87b13f725deb7f76c0103a2666d2adde992e7a6e
Author: rajarajan-g 
Date:   2016-08-18T09:25:52Z

fix for rawtype




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1341: [ZEPPELIN-1162] Fix rawType in NotebookRestApi

2016-08-18 Thread rajarajan-g
Github user rajarajan-g closed the pull request at:

https://github.com/apache/zeppelin/pull/1341


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1176: [Zeppelin 1165 : improve] Paragraph dynamic relationsh...

2016-08-18 Thread xiufengliu
Github user xiufengliu commented on the issue:

https://github.com/apache/zeppelin/pull/1176
  
Hi, may I ask if this feature has been merged to the master?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1338: Zeppelin 1307 - Implement notebook revision in Zeppeli...

2016-08-18 Thread anthonycorbacho
Github user anthonycorbacho commented on the issue:

https://github.com/apache/zeppelin/pull/1338
  
ready for review


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin pull request #1326: [ZEPPELIN-1323] Add contribution guide for Zepp...

2016-08-18 Thread asfgit
Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1326


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1313: [ZEPPELIN-1245] Focus first paragraph after notebook c...

2016-08-18 Thread corneadoug
Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1313
  
I agree too.
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1168: [MINOR] Add formatter

2016-08-18 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1168
  
@bzz Yes, I also don't think it's good idea to reformat all of codes. I 
like your suggestion to adopt IDE formatter first. Let's find a way to sync 
both of IntelliJ and Eclipse formatters.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1176: [Zeppelin 1165 : improve] Paragraph dynamic relationsh...

2016-08-18 Thread corneadoug
Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1176
  
@xiufengliu No it wasn't merged.
In merged PR you can see a message saying: "asfgit closed this in 
CommitHash Xdays ago"
This is an interesting feature and there was some discussions on how this 
feature could be handled and how to define the flow, so I think it will need a 
lot of changes.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---


[GitHub] zeppelin issue #1265: [ZEPPELIN-1210] Run interpreter per user

2016-08-18 Thread jongyoul
Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1265
  
Merging if there's no more discussion


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---