[GitHub] zeppelin pull request #1126: ZEPPELIN-1108 ] Doesn't work autocompletion for...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1126


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Notebook copy per session/socket

[ashish rawat]

That would be awesome!

I have added the comment in the pull request also. Can't wait to try it out
with your changes.

Regards,
Ashish

On Wed, Jul 6, 2016 at 11:06 AM, Khalid Huseynov 
wrote:

> Thanks for the question Ashish,
>
> Actually it's a good feedback, and one of the reasons
> https://github.com/apache/zeppelin/pull/1105 was proposed is to facilitate
> the case of using note as a dashboard without intervening with storage and
> other notebooks. I'll consider this feedback in the PR then and possibly
> you can go ahead and try it and leave more feedback there.
>
> Best,
> Khalid.
>
> On Wed, Jul 6, 2016 at 4:06 AM, ashish rawat  wrote:
>
> > Thanks Moon and Mohit.
> >
> > Moon,
> >
> > It's not clear to me if offline mode would allow changing input controls
> > (dropdowns/input box etc) and view the new result. Our requirement is
> for a
> > dashboard mode, where multiple users can play with the data using the
> input
> > controls but don't interfere with each other's work. This is a very basic
> > requirement for making Dashboards using Zeppelin.
> >
> > I think isolating a notebook copy in a web socket/user session (in
> > Dashboard mode), can achieve the desired results.
> >
> > Mohit,
> >
> > I am avoiding creating multiple physical copies, since it looks difficult
> > to maintain for an ever increasing set of notebooks and users.
> >
> > Regards,
> > Ashish
> >
> >
> > On Tue, Jul 5, 2016 at 11:16 PM, Mohit Jaggi 
> wrote:
> >
> >> What if you make a physical copy of the notebook? Then the socket list
> >> will have only one destination. Perhaps you can define a “notebook
> >> template” as follows:
> >>
> >> Z -> Menu -> Create notebook template -> [ define your notebook template
> >> here ]
> >> Z -> Menu -> Create notebook from template -> [ choose the above
> template
> >> ] -> make a physical copy of the template
> >>
> >> If the template changes, the notebook is based on a previous version but
> >> I think that is fine for many use cases.
> >>
> >>
> >> On Jul 4, 2016, at 10:14 PM, ashish rawat  wrote:
> >>
> >> + user list, hoping someone can help here!
> >>
> >> On Mon, Jul 4, 2016 at 10:48 PM, ashish rawat 
> >> wrote:
> >>
> >>> Hi everyone,
> >>>
> >>> I am trying to implement a functionality in Zeppelin, where a notebook
> >>> copy can be kept with each websocket associated with that notebook.
> This
> >>> way the notebook would be opened in read-only mode and changes made by
> one
> >>> connection would not be visible to the other connections over the same
> >>> notebook. I would additionally disable the note.persist in this case.
> >>>
> >>> I explored the code a little and found that NotebookServer is keeping a
> >>> map of notebookIds to list of sockets. Further, it seems that any
> message
> >>> to a specific notebook gets broadcasted to the complete list of sockets
> >>> associated with that list.
> >>>
> >>> My initial idea was to just maintain a notebook copy for each
> websocket,
> >>> but now this is looking a little complex, since it seems that for every
> >>> job, I would also need to maintain the websocket which triggered it,
> >>> resulting in changes across the codebase.
> >>>
> >>> Can someone help me out in how to approach this change in the cleanest
> >>> and fastest way.
> >>>
> >>> Regards,
> >>> Ashish
> >>>
> >>> PS: The motivation for making this change is mentioned in one of my
> >>> earlier questions "Zeppelin multi-user dashboards" on the users list.
> >>>
> >>
> >>
> >>
> >
>

[GitHub] zeppelin issue #1120: [ZEPPELIN-1102] ElasticSearch interpreter auto complet...

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1120
  
👍  for adding a test!

Looks great to me, merging if there is no more dicsussion


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Notebook copy per session/socket

[Khalid Huseynov]

Thanks for the question Ashish,

Actually it's a good feedback, and one of the reasons
https://github.com/apache/zeppelin/pull/1105 was proposed is to facilitate
the case of using note as a dashboard without intervening with storage and
other notebooks. I'll consider this feedback in the PR then and possibly
you can go ahead and try it and leave more feedback there.

Best,
Khalid.

On Wed, Jul 6, 2016 at 4:06 AM, ashish rawat  wrote:

> Thanks Moon and Mohit.
>
> Moon,
>
> It's not clear to me if offline mode would allow changing input controls
> (dropdowns/input box etc) and view the new result. Our requirement is for a
> dashboard mode, where multiple users can play with the data using the input
> controls but don't interfere with each other's work. This is a very basic
> requirement for making Dashboards using Zeppelin.
>
> I think isolating a notebook copy in a web socket/user session (in
> Dashboard mode), can achieve the desired results.
>
> Mohit,
>
> I am avoiding creating multiple physical copies, since it looks difficult
> to maintain for an ever increasing set of notebooks and users.
>
> Regards,
> Ashish
>
>
> On Tue, Jul 5, 2016 at 11:16 PM, Mohit Jaggi  wrote:
>
>> What if you make a physical copy of the notebook? Then the socket list
>> will have only one destination. Perhaps you can define a “notebook
>> template” as follows:
>>
>> Z -> Menu -> Create notebook template -> [ define your notebook template
>> here ]
>> Z -> Menu -> Create notebook from template -> [ choose the above template
>> ] -> make a physical copy of the template
>>
>> If the template changes, the notebook is based on a previous version but
>> I think that is fine for many use cases.
>>
>>
>> On Jul 4, 2016, at 10:14 PM, ashish rawat  wrote:
>>
>> + user list, hoping someone can help here!
>>
>> On Mon, Jul 4, 2016 at 10:48 PM, ashish rawat 
>> wrote:
>>
>>> Hi everyone,
>>>
>>> I am trying to implement a functionality in Zeppelin, where a notebook
>>> copy can be kept with each websocket associated with that notebook. This
>>> way the notebook would be opened in read-only mode and changes made by one
>>> connection would not be visible to the other connections over the same
>>> notebook. I would additionally disable the note.persist in this case.
>>>
>>> I explored the code a little and found that NotebookServer is keeping a
>>> map of notebookIds to list of sockets. Further, it seems that any message
>>> to a specific notebook gets broadcasted to the complete list of sockets
>>> associated with that list.
>>>
>>> My initial idea was to just maintain a notebook copy for each websocket,
>>> but now this is looking a little complex, since it seems that for every
>>> job, I would also need to maintain the websocket which triggered it,
>>> resulting in changes across the codebase.
>>>
>>> Can someone help me out in how to approach this change in the cleanest
>>> and fastest way.
>>>
>>> Regards,
>>> Ashish
>>>
>>> PS: The motivation for making this change is mentioned in one of my
>>> earlier questions "Zeppelin multi-user dashboards" on the users list.
>>>
>>
>>
>>
>

[GitHub] zeppelin issue #1100: [ZEPPELIN-1054] Improve "Credentials" UI

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1100
  
In the case of login from credential page, its a separate issue, you 
shouldn't be able to do that.
I created an issue: https://issues.apache.org/jira/browse/ZEPPELIN-1123 and 
will take care of it.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1093: [Bug Fix] Fix "stackedAreaChart", "lineWithFocusChart"...

[voyageth]

Github user voyageth commented on the issue:

https://github.com/apache/zeppelin/pull/1093
  
Oh, empty string also make wired graph too!
This PR doesn't consider that condition.

This PR can fix following condition.
`%sh echo -e "%table key\tvalue\nnull\t1000\n1\t100\n2\t200\n99\t900"`

- before apply PR

![asis3](https://cloud.githubusercontent.com/assets/366810/16607769/dc2c09f2-437f-11e6-93c9-c4257eb6afd6.PNG)
- after apply PR

![tobe3](https://cloud.githubusercontent.com/assets/366810/16607770/dd342d34-437f-11e6-8837-295c63cffc43.PNG)




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1116: minor doc fix

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1116


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1122: [MINOR] Removed InterpreterInfoSerializer and r...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1122


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1116: minor doc fix

[prabhjyotsingh]

Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/1116
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1130: [ZEPPELIN-1113] Don't save Paragraph ColWidth if not n...

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1130
  
CI is green at last :) Merging if there is no more discussions


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1088: [ZEPPELIN-1062] Get original InterpreterSetting...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1088


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1122: [MINOR] Removed InterpreterInfoSerializer and r...

[jongyoul]

GitHub user jongyoul reopened a pull request:

https://github.com/apache/zeppelin/pull/1122

[MINOR] Removed InterpreterInfoSerializer and related codes

### What is this PR for?
Simplifying InterpreterFactory and reduce classes


### What type of PR is it?
[Refactoring]

### Todos
* [x] - Remove InterpreterInfoSerializer
* [x] - Add annotation for InterpreterInfo

### What is the Jira issue?
N/A

### How should this be tested?

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jongyoul/zeppelin 
minor-refactoring-gson-interpreterinfo

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1122.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1122


commit 979198966f4393ad7d6889aacc6da35f4740837d
Author: Jongyoul Lee 
Date:   2016-07-04T11:14:33Z

Removed InterpreterInfoSerializer and related codes
Added annotation for InterpreterInfo

commit ac08ce52d0b6ff48ad38c1fd090433ed61622a30
Author: Jongyoul Lee 
Date:   2016-07-04T11:31:17Z

Cleaned codes

commit a7aeb5331b9861310f40788e75067240964052a3
Author: Jongyoul Lee 
Date:   2016-07-05T02:38:35Z

Cleaned codes




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1130: [ZEPPELIN-1113] Don't save Paragraph ColWidth if not n...

[corneadoug]

Github user corneadoug commented on the issue:

https://github.com/apache/zeppelin/pull/1130
  
Re-Trigger CI, Tests are good locally


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1127: [HOTFIX] Remove duplicate closing brace in publ...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1127


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1077: [ZEPPELIN-921] Apply new mechanism to KnitR and RRepl

[elbamos]

Github user elbamos commented on the issue:

https://github.com/apache/zeppelin/pull/1077
  
I'm sorry I have not had a chance to finish addressing this. One issue is 
that a PR to interpreter.sh removed the rinterpreter jar from the classpath. It 
needs to be put back in. That will cause knitr to work. The second issue is 
that the other spark interpreter is hardcoded into the configuration files I 
believe related to livy - so it ignores the registration for rrepl as spark.r. 

> On Jul 5, 2016, at 5:38 PM, Rerngvit Yanggratoke 
 wrote:
> 
> I think I found the root cause of the problem. The key issue is that 
currently the build configuration packages 
"zeppelin-zrinterpreter-0.6.0-SNAPSHOT.jar" under "interpreter/spark" instead 
of under "interpreter/r" (as similar to other interpreter like "flink" or 
"sh"). Then, when the registration process is done at "InterpreterFactory.java" 
method "registerInterpreterFromResource" takes the "interpreter-setting.json" 
from "zeppelin-spark-0.6.0-SNAPSHOT.jar". I will try change this configuration 
and see whether it addressed the issue.
> 
> —
> You are receiving this because you were mentioned.
> Reply to this email directly, view it on GitHub, or mute the thread.
> 



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1077: [ZEPPELIN-921] Apply new mechanism to KnitR and RRepl

[rerngvit]

Github user rerngvit commented on the issue:

https://github.com/apache/zeppelin/pull/1077
  
I think I found the root cause of the problem. The key issue is that 
currently the build configuration packages 
"zeppelin-zrinterpreter-0.6.0-SNAPSHOT.jar" under "interpreter/spark" instead 
of under "interpreter/r" (as similar to other interpreter like "flink" or 
"sh"). Then, when the registration process is done at "InterpreterFactory.java" 
method "registerInterpreterFromResource" takes the "interpreter-setting.json" 
from "zeppelin-spark-0.6.0-SNAPSHOT.jar". I will try change this configuration 
and see whether it addressed the issue.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1116: minor doc fix

[zjffdu]

Github user zjffdu commented on the issue:

https://github.com/apache/zeppelin/pull/1116
  
right, I miss the newbie label. Add it in the next commit.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1077: [ZEPPELIN-921] Apply new mechanism to KnitR and RRepl

[rerngvit]

Github user rerngvit commented on the issue:

https://github.com/apache/zeppelin/pull/1077
  
@jongyoul Thanks. However, I tried that before and still observed the same 
behaviour. It seems to be related to something else: i.e., the fact 
interpreter-setting.json for r interpreter is not registered from 
InterpreterFactory.java for some reason. Any other suggestions are welcome.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1016: Bump up version to 0.7.0-SNAPSHOT

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1016


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1127: [HOTFIX] Remove duplicate closing brace in publish_rel...

[minahlee]

Github user minahlee commented on the issue:

https://github.com/apache/zeppelin/pull/1127
  
Merging if there is no more discussion


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Notebook copy per session/socket

[Mohit Jaggi]

What if you make a physical copy of the notebook? Then the socket list will 
have only one destination. Perhaps you can define a “notebook template” as 
follows:

Z -> Menu -> Create notebook template -> [ define your notebook template here ]
Z -> Menu -> Create notebook from template -> [ choose the above template ] -> 
make a physical copy of the template

If the template changes, the notebook is based on a previous version but I 
think that is fine for many use cases.

> On Jul 4, 2016, at 10:14 PM, ashish rawat  wrote:
> 
> + user list, hoping someone can help here!
> 
> On Mon, Jul 4, 2016 at 10:48 PM, ashish rawat  > wrote:
> Hi everyone,
> 
> I am trying to implement a functionality in Zeppelin, where a notebook copy 
> can be kept with each websocket associated with that notebook. This way the 
> notebook would be opened in read-only mode and changes made by one connection 
> would not be visible to the other connections over the same notebook. I would 
> additionally disable the note.persist in this case.
> 
> I explored the code a little and found that NotebookServer is keeping a map 
> of notebookIds to list of sockets. Further, it seems that any message to a 
> specific notebook gets broadcasted to the complete list of sockets associated 
> with that list.
> 
> My initial idea was to just maintain a notebook copy for each websocket, but 
> now this is looking a little complex, since it seems that for every job, I 
> would also need to maintain the websocket which triggered it, resulting in 
> changes across the codebase.
> 
> Can someone help me out in how to approach this change in the cleanest and 
> fastest way.
> 
> Regards,
> Ashish
> 
> PS: The motivation for making this change is mentioned in one of my earlier 
> questions "Zeppelin multi-user dashboards" on the users list.
> 
> 

[GitHub] zeppelin pull request #1136: [ZEPPELIN-1121] Bugfix pyspark autocompletion.

[astroshim]

Github user astroshim closed the pull request at:

https://github.com/apache/zeppelin/pull/1136


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1136: [ZEPPELIN-1121] Bugfix pyspark autocompletion.

[astroshim]

Github user astroshim commented on the issue:

https://github.com/apache/zeppelin/pull/1136
  
re-trigger CI


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1137: [ZEPPELIN-1122] BugFix for repositories snapsho...

[astroshim]

GitHub user astroshim opened a pull request:

https://github.com/apache/zeppelin/pull/1137

[ZEPPELIN-1122] BugFix for repositories snapshot is always set to true.

### What is this PR for?
This PR fixes a bug about snapshot setting and select box(true,false) html.


### What type of PR is it?
Bug Fix | Improvement


### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1122


### How should this be tested?
1. go Interpreter menu.
2. click ```repository information``` button that is right top.
3. click plus button (to Add New Repository)
and refer to screenshot.

### Screenshots (if appropriate)
- before

![b](https://cloud.githubusercontent.com/assets/3348133/16590775/e5476c82-4313-11e6-8abf-a1bb662b6ae4.gif)

- after

![a](https://cloud.githubusercontent.com/assets/3348133/16590780/ea491ce4-4313-11e6-82f0-29d7cd9cb0a0.gif)



### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/astroshim/zeppelin ZEPPELIN-1122

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1137.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1137


commit 829e9c1c086278baef4cad846e561f5044f705a1
Author: astroshim 
Date:   2016-07-05T15:46:44Z

fix select box and snapshot backend code.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-1122) Repositories snapshot is always set to true.

[Shim HyungSung (JIRA)]

Shim HyungSung created ZEPPELIN-1122:


 Summary: Repositories snapshot is always set to true.
 Key: ZEPPELIN-1122
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1122
 Project: Zeppelin
  Issue Type: Bug
Reporter: Shim HyungSung


The problem is that the snapshot is always set to "true".




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] zeppelin pull request #1136: [ZEPPELIN-1121] Bugfix pyspark autocompletion.

[astroshim]

GitHub user astroshim opened a pull request:

https://github.com/apache/zeppelin/pull/1136

[ZEPPELIN-1121] Bugfix pyspark autocompletion.

### What is this PR for?
This PR fixes autocompletion for pyspark interpreter bug.


### What type of PR is it?
Bug Fix


### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1121


### How should this be tested?
try to completion for pyspark interpreter on your paragraph.


### Screenshots (if appropriate)
  - before

![before](https://cloud.githubusercontent.com/assets/3348133/16589456/31464398-430e-11e6-87f0-a9446d5c5c14.gif)

  - after

![after](https://cloud.githubusercontent.com/assets/3348133/16589462/39540b74-430e-11e6-9e2b-0f23ed373521.gif)


### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/astroshim/zeppelin ZEPPELIN-1121

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1136.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1136


commit 4ef11177accd2909f65e91071faa05c82c189760
Author: astroshim 
Date:   2016-07-05T14:51:55Z

fix pyspark autocompletion code.




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1100: [ZEPPELIN-1054] Improve "Credentials" UI

[Leemoonsoo]

Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1100
  
Tested and overall working well. Found two (minor) problems

When i login from Credential page, list not refreshed after logged in

![credential1](https://cloud.githubusercontent.com/assets/1540981/16589360/a6ad5c84-4287-11e6-9000-c88d8bcc4fd8.gif)

"Edit" -> "Save" -> "Cancel" -> "Cancel" does not update actual credential 
in the backend. However, it displays modified value in frontend, until page is 
refreshed.

![credential2](https://cloud.githubusercontent.com/assets/1540981/16589361/a6af8298-4287-11e6-84a0-8ac2e258c24d.gif)



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-1120) Featured Tweets

[Lee moon soo (JIRA)]

Lee moon soo created ZEPPELIN-1120:
--

 Summary: Featured Tweets
 Key: ZEPPELIN-1120
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1120
 Project: Zeppelin
  Issue Type: Sub-task
Reporter: Lee moon soo


Would it be useful to shows related tweets on homepage?
http://flink.apache.org/ or http://zeppelin-project.org/ as example



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ZEPPELIN-1119) Powered by Zeppelin page

[Lee moon soo (JIRA)]

Lee moon soo created ZEPPELIN-1119:
--

 Summary: Powered by Zeppelin page
 Key: ZEPPELIN-1119
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1119
 Project: Zeppelin
  Issue Type: Sub-task
Reporter: Lee moon soo






--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ZEPPELIN-1118) Migrate Zeppelin Live Demo feature from zeppelin-project.org to zeppelin.apache.org

[Lee moon soo (JIRA)]

Lee moon soo created ZEPPELIN-1118:
--

 Summary: Migrate Zeppelin Live Demo feature from 
zeppelin-project.org to zeppelin.apache.org
 Key: ZEPPELIN-1118
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1118
 Project: Zeppelin
  Issue Type: Sub-task
Reporter: Lee moon soo


Greg suggested a way to migrate live demo feature
http://apache-zeppelin-dev-mailing-list.75694.x6.nabble.com/DISCUSS-Future-of-http-zeppelin-project-org-tp10998p11001.html

After the migration it'll be look like

- Home page of zeppelin.apache.org will have 'Start' (or 'try' or 'demo') 
button.
- "Start" button leads to demo.html
- demo.html will list available live demo instances provided by on behalf of 
Apache Zeppelin by third parties




--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ZEPPELIN-1117) Migrate some contents from zeppelin-projects.org to zeppelin.apache.org

[Lee moon soo (JIRA)]

Lee moon soo created ZEPPELIN-1117:
--

 Summary: Migrate some contents from zeppelin-projects.org to 
zeppelin.apache.org
 Key: ZEPPELIN-1117
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1117
 Project: Zeppelin
  Issue Type: Improvement
Reporter: Lee moon soo


Please see the discussion
http://apache-zeppelin-dev-mailing-list.75694.x6.nabble.com/DISCUSS-Future-of-http-zeppelin-project-org-tp10998.html





--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] zeppelin issue #1133: [DOC][ZEPPELIN-732] Helium Application

[Leemoonsoo]

Github user Leemoonsoo commented on the issue:

https://github.com/apache/zeppelin/pull/1133
  
Thank you @AhyoungRyu for taking care of it.
Looks good to me!


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: Notebook copy per session/socket

[moon soo Lee]

Hi Ashish,

Will offline mode proposed at https://github.com/apache/zeppelin/pull/1105 help
your case?

Thanks,
moon

On Mon, Jul 4, 2016 at 10:14 PM ashish rawat  wrote:

> + user list, hoping someone can help here!
>
> On Mon, Jul 4, 2016 at 10:48 PM, ashish rawat  wrote:
>
>> Hi everyone,
>>
>> I am trying to implement a functionality in Zeppelin, where a notebook
>> copy can be kept with each websocket associated with that notebook. This
>> way the notebook would be opened in read-only mode and changes made by one
>> connection would not be visible to the other connections over the same
>> notebook. I would additionally disable the note.persist in this case.
>>
>> I explored the code a little and found that NotebookServer is keeping a
>> map of notebookIds to list of sockets. Further, it seems that any message
>> to a specific notebook gets broadcasted to the complete list of sockets
>> associated with that list.
>>
>> My initial idea was to just maintain a notebook copy for each websocket,
>> but now this is looking a little complex, since it seems that for every
>> job, I would also need to maintain the websocket which triggered it,
>> resulting in changes across the codebase.
>>
>> Can someone help me out in how to approach this change in the cleanest
>> and fastest way.
>>
>> Regards,
>> Ashish
>>
>> PS: The motivation for making this change is mentioned in one of my
>> earlier questions "Zeppelin multi-user dashboards" on the users list.
>>
>
>

[GitHub] zeppelin issue #1123: [Zeppelin - 1104] ZeppelinHub storage max note size to...

[khalidhuseynov]

Github user khalidhuseynov commented on the issue:

https://github.com/apache/zeppelin/pull/1123
  
CI is green, and i think it's better to be included in 0.6 branch as well.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1044: Add force layout visualization in paragraphs for SQL q...

[davidtzoor]

Github user davidtzoor commented on the issue:

https://github.com/apache/zeppelin/pull/1044
  
@AhyoungRyu I created a new PR (#1135) and closing this one. I hope this 
time it will work.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1115: [ZEPPELIN-1099] Build and run Spark without spark-depe...

[jongyoul]

Github user jongyoul commented on the issue:

https://github.com/apache/zeppelin/pull/1115
  
Merging there's no more discussion.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1044: Add force layout visualization in paragraphs for SQL q...

[AhyoungRyu]

Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1044
  
@davidtzoor Never mind. Please feel free to do that :)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1044: Add force layout visualization in paragraphs for SQL q...

[davidtzoor]

Github user davidtzoor commented on the issue:

https://github.com/apache/zeppelin/pull/1044
  
I think these are all the PR that were accepted since my initial pull 
request.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1131: [gh-pages] Update Zeppelin screenshot images in gh-pag...

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1131
  
Looks good to me, merging if there is no further discussion


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #418: Zeppelin Flink Spark tutorial

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/418
  
Shall we wrap this work up?

AFAIK we just need to:
 - rebased on the latest master
 - address @felixcheung feedback
 - merge the guy


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-1116) JDBC Interpreter does not return SQL error messages

[Boris Shminke (JIRA)]

Boris Shminke created ZEPPELIN-1116:
---

 Summary: JDBC Interpreter does not return SQL error messages
 Key: ZEPPELIN-1116
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1116
 Project: Zeppelin
  Issue Type: Improvement
Affects Versions: 0.6.0
Reporter: Boris Shminke


When one creates a JDBC cell like this:

{{
%jdbc (hive)

selec 1
}}

Zeppelin responds with "class org.apache.hive.service.cli.HiveSQLException" and 
a long Java stack trace which is absolutely useless for debugging SQL 
statements.

It would be better to respond with Hive error like this:

Error while compiling statement: FAILED: ParseException line 1:0 cannot 
recognize input near 'selec' '1' ''

as it was the case in old Hive Interpreter in Zeppelin 0.5.6



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] zeppelin issue #1044: Add force layout visualization in paragraphs for SQL q...

[davidtzoor]

Github user davidtzoor commented on the issue:

https://github.com/apache/zeppelin/pull/1044
  
@AhyoungRyu I just did a pull from the zeppelin repo to my fork, rebase and 
resolved the conflicts.
What did I do wrong?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1088: [ZEPPELIN-1062] Get original InterpreterSetting when t...

[prabhjyotsingh]

Github user prabhjyotsingh commented on the issue:

https://github.com/apache/zeppelin/pull/1088
  
Thank you for taking care of it. LGTM.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1088: [ZEPPELIN-1062] Get original InterpreterSetting when t...

[AhyoungRyu]

Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1088
  
@prabhjyotsingh Sorry for my late response. You're right. After  just 
clicking `cancel`, it should focus on textbox again as you said. And regarding 
your second comment, I blocked ESC back drop & `x` closing. Could you check 
this again?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-1115) Python: add SQL for DataFrame support with Table Display system

[Alexander Bezzubov (JIRA)]

Alexander Bezzubov created ZEPPELIN-1115:


 Summary: Python: add SQL for DataFrame support with Table Display 
system
 Key: ZEPPELIN-1115
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1115
 Project: Zeppelin
  Issue Type: Improvement
  Components: python-interpreter
Reporter: Alexander Bezzubov
Assignee: Alexander Bezzubov
 Fix For: 0.7.0


In spark interpreter group we have {{%sql}} interpreter which supports Table 
Display system, we use it in the tutorial notebook and it's very convenient for 
data explorations.

The idea is to have the same kind of support for Python interpreter group i.e
`%python.sql` but only for Pandas [DataFrame](https://github.com/yhat/pandasql).



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] zeppelin pull request #1124: ZEPPELIN-1105: Python - add paragraph ERROR sta...

[asfgit]

Github user asfgit closed the pull request at:

https://github.com/apache/zeppelin/pull/1124


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1134: ZEPPELIN-1063: fix PythonInterpreter flaky test

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1134
  
Should fix build on master and #1100



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1134: ZEPPELIN-1063: fix PythonInterpreter flaky test

[bzz]

GitHub user bzz opened a pull request:

https://github.com/apache/zeppelin/pull/1134

ZEPPELIN-1063: fix PythonInterpreter flaky test

### What is this PR for?
 fix flaky `PythonInterpreter.testClose()` test

### What type of PR is it?
Hot Fix

### What is the Jira issue?
[ZEPPELIN-1063](https://issues.apache.org/jira/browse/ZEPPELIN-1063)

### How should this be tested?
CI should pass

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bzz/incubator-zeppelin 
ZEPPELIN-1063/python/add-retrys

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1134.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1134


commit b0b3f32674b82a52658721e59aea357bb07697e1
Author: Alexander Bezzubov 
Date:   2016-07-05T08:50:49Z

fix PythonInterpreterTest.testClose() test




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1100: [ZEPPELIN-1054] Improve "Credentials" UI

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1100
  
CI failure is not related and is fixed under 
[ZEPPELIN-1063](https://issues.apache.org/jira/browse/ZEPPELIN-1063)


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1131: [gh-pages] Update Zeppelin screenshot images in...

[AhyoungRyu]

GitHub user AhyoungRyu opened a pull request:

https://github.com/apache/zeppelin/pull/1131

[gh-pages] Update Zeppelin screenshot images in gh-pages index.md

### What is this PR for?
This PR is for updating screenshot images in `index.md`(gh-pages branch)  
as #1089 merged.  

### What type of PR is it?
Documentation

### Questions:
* Does the licenses files need update? no
* Is there breaking changes for older versions? no
* Does this needs documentation? no


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/AhyoungRyu/zeppelin gh-page/ZEPPELIN-1002

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1131.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1131


commit 2390d9857166b932b7a54dd045f29d6baebfa32b
Author: AhyoungRyu 
Date:   2016-07-05T07:39:13Z

Update Zeppelin screenshot images in gh-pages index.md




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1122: [MINOR] Removed InterpreterInfoSerializer and r...

[jongyoul]

GitHub user jongyoul reopened a pull request:

https://github.com/apache/zeppelin/pull/1122

[MINOR] Removed InterpreterInfoSerializer and related codes

### What is this PR for?
Simplifying InterpreterFactory and reduce classes


### What type of PR is it?
[Refactoring]

### Todos
* [x] - Remove InterpreterInfoSerializer
* [x] - Add annotation for InterpreterInfo

### What is the Jira issue?
N/A

### How should this be tested?

### Screenshots (if appropriate)

### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No

You can merge this pull request into a Git repository by running:

$ git pull https://github.com/jongyoul/zeppelin 
minor-refactoring-gson-interpreterinfo

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1122.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1122


commit 4603953d6b8ac1f528238e15728c41fa0a389563
Author: Jongyoul Lee 
Date:   2016-07-04T11:14:33Z

Removed InterpreterInfoSerializer and related codes
Added annotation for InterpreterInfo

commit 526d6c52707f959a410bf472d168d3b53fbac833
Author: Jongyoul Lee 
Date:   2016-07-04T11:31:17Z

Cleaned codes

commit 0ad28b4262814fddfd3f95750994644b3fcba101
Author: Jongyoul Lee 
Date:   2016-07-05T02:38:35Z

Cleaned codes




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1122: [MINOR] Removed InterpreterInfoSerializer and r...

[jongyoul]

Github user jongyoul closed the pull request at:

https://github.com/apache/zeppelin/pull/1122


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1100: [ZEPPELIN-1054] Improve "Credentials" UI

[AhyoungRyu]

Github user AhyoungRyu commented on the issue:

https://github.com/apache/zeppelin/pull/1100
  
Ready for review.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1123: [Zeppelin - 1104] ZeppelinHub storage max note size to...

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1123
  
@khalidhuseynov what about latest CI failure on this PR? Licence check is 
failing the build

```
[ERROR] Failed to execute goal org.apache.rat:apache-rat-plugin:0.11:check 
(verify.rat) on project zeppelin: Too many files with unapproved license: 1 See 
RAT report in: /home/travis/build/apache/zeppelin/target/rat.txt -> [Help 1]
[ERROR] 

$ cat target/rat.txt

*
Summary
---
Generated at: 2016-07-05T00:01:36+00:00
Notes: 2
Binaries: 148
Archives: 0
Standards: 91

Apache Licensed: 90
Generated Documents: 0

JavaDocs are generated and so license header is optional
Generated files do not required license headers

1 Unknown Licenses

***

Unapproved licenses:

  
zeppelin-examples/zeppelin-example-horizontalbar/src/main/resources/example/app/horizontalbar/horizontalbar_mockdata.txt

***

Archives:
```

?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1123: [Zeppelin - 1104] ZeppelinHub storage max note size to...

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1123
  
This looks very similar to 
[ZEPPELIN-1063](https://issues.apache.org/jira/browse/ZEPPELIN-1063) with title 
"Flaky Test - PythonInterpreterTest.testClose" wich I can not reproduce 
locally. 

Will re-open it and link this PR.

As CI failure is un-related, will merge if there is no more discussion. 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

Re: [GSoC - 2016][Zeppelin Notebooks] Issues with Common Crawl Datasets

[Alexander Bezzubov]

That sounds great, Anish!
Congratulations on getting a new machine.

No worries, please take your time and keep us posted on your exploration!
Quality is more important than quantity here.

--
Alex

On Mon, Jul 4, 2016 at 10:40 PM, anish singh  wrote:

> Hello,
>
> Thanks Alex, I'm so glad that you helped. Here's update : I've ordered new
> machine with more RAM and processor that should come by tomorrow. I will
> attempt to use it for the common crawl data and the AWS solution that you
> provided in the previous mail. I'm presently reading papers and
> publications regarding analysis of common crawl data. Warcbase tool will
> definitely be used. I understand that common crawl datasets are important
> and I will do everything it takes to make notebooks on them, the only
> tension is that it may take more time than the previous notebooks.
>
> Anish.
>
> On Mon, Jul 4, 2016 at 6:30 PM, Alexander Bezzubov  wrote:
>
> > Hi Anish,
> >
> > thanks for keeping us posted about a progress!
> >
> > CommonCrawl is important dataset and it would be awesome if we could
> > find a way for you to build some notebooks for it though this this
> > years GSoC program.
> >
> > How about running Zeppelin on a single big enough node in AWS for the
> > sake of this notebook?
> > If you use spot instance you could get even big instances for really
> > affordable price of 2-4$ a day, just need to make sure your persist
> > notebooks on S3 [1] to avoid loosing the data and shut down it for the
> > night.
> >
> > AFAIK We do not have free any AWS credits for now, even for a GSoC
> > students. If somebody knows a way to provide\get some - please feel
> > free to chime in, I know there are some Amazonian people on the list
> > :)
> >
> > But so far AWS spot instances is the most cost-effective solution I
> > could imagine of. Bonus: if you host your instance in region us-east-1
> > - transfer from\to S3 will be free, as that's where CommonCrawl
> > dataset is living.
> >
> > One more thing - please check out awesome WarcBase library [2] build
> > by internet preservation community. I find it really helpful, working
> > with web archives.
> >
> > On the notebook design:
> >  - to understand the context of this dataset better - please do some
> > research how other people use it. What for, etc.
> >Would be a great material for the blog post
> >  - try provide examples of all available formats: WARC, WET, WAT (in
> > may be in same or different notebooks, it's up to you)
> >  - while using warcbase - mind that RDD persistence will not work
> > until [3] is resolved, so avoid using if for now
> >
> > I understand that this can be a big task, so do not worry if that
> > takes time (learning AWS, etc) - just keep us posted on your progress
> > weekly and I'll be glad to help!
> >
> >
> >  1.
> >
> http://zeppelin.apache.org/docs/0.6.0-SNAPSHOT/storage/storage.html#notebook-storage-in-s3
> >  2. https://github.com/lintool/warcbase
> >  3. https://github.com/lintool/warcbase/issues/227
> >
> > On Mon, Jul 4, 2016 at 7:00 PM, anish singh 
> wrote:
> > > Hello,
> > >
> > > (everything outside Zeppelin)
> > > I had started work on the common crawl datasets, and tried to first
> have
> > a
> > > look at only the data for May 2016. Out of the three formats
> available, I
> > > chose the WET(plain text format). The data only for May is divided into
> > > segments and there are 24492 such segments. I downloaded only the first
> > > segment for May and got 432MB of data. Now the problem is that my
> laptop
> > is
> > > a very modest machine with core 2 duo processor and 3GB of RAM such
> that
> > > even opening the downloaded data file in LibreWriter filled the RAM
> > > completely and hung the machine and bringing the data directly into
> > > zeppelin or analyzing it inside zeppelin seems impossible. As good as I
> > > know, there are two ways in which I can proceed :
> > >
> > > 1) Buying a new laptop with more RAM and processor.   OR
> > > 2) Choosing another dataset
> > >
> > > I have no problem with either of the above ways or anything that you
> > might
> > > suggest but please let me know which way to proceed so that I may be
> able
> > > to work in speed. Meanwhile, I will read more papers and publications
> on
> > > possibilities of analyzing common crawl data.
> > >
> > > Thanks,
> > > Anish.
> >
>

[GitHub] zeppelin issue #1130: [ZEPPELIN-1113] Don't save Paragraph ColWidth if not n...

[felixcheung]

Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/1130
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1115: [ZEPPELIN-1099] Build and run Spark without spark-depe...

[felixcheung]

Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/1115
  
looks good, I'm not exactly follow though - does one switch from building 
with spark-dependencies to without, with a build profile commandline, or this 
is permanently removing spark-dependencies from build?



---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1124: ZEPPELIN-1105: Python - add paragraph ERROR status

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1124
  
CI is green now


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1124: ZEPPELIN-1105: Python - add paragraph ERROR status

[felixcheung]

Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/1124
  
I think this is a good improvement - left a comment.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1129: [ZEPPELIN-1110] Catch Exception in ZeppelinIT. testSpa...

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1129
  
CI is green now! :shipit: 


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1044: Add force layout visualization in paragraphs for SQL q...

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1044
  
RIght, in you fork you need to pull the master from apache git and then 
rebase this branch on top of it, resolving the conflicts.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1119: [DOC] Zeppelin 0.6.0 release note

[felixcheung]

Github user felixcheung commented on the issue:

https://github.com/apache/zeppelin/pull/1119
  
LGTM


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1130: [ZEPPELIN-1113] Don't save Paragraph ColWidth i...

[corneadoug]

GitHub user corneadoug opened a pull request:

https://github.com/apache/zeppelin/pull/1130

[ZEPPELIN-1113] Don't save Paragraph ColWidth if not necessary

### What is this PR for?
We currently are saving the ColWidth changes all the time, while it is not 
necessary if the value is the same.


### What type of PR is it?
Improvement

### What is the Jira issue?
https://issues.apache.org/jira/browse/ZEPPELIN-1113

### How should this be tested?
* Select a Col-12 Paragraph and use the shortcut Ctr+Shift+ = to make it 
bigger
* You shouldn't see any `Send >> "COMMIT_PARAGRAPH"` in your browser console


### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No



You can merge this pull request into a Git repository by running:

$ git pull https://github.com/corneadoug/incubator-zeppelin 
fix/dontSendSimilarColWidth

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1130.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1130


commit 7d471c00dfed5af2b41a5481611788269f3998b0
Author: Damien CORNEAU 
Date:   2016-07-05T06:11:44Z

Add parameter to changeColWidth and check value




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1044: Add force layout visualization in paragraphs for SQL q...

[davidtzoor]

Github user davidtzoor commented on the issue:

https://github.com/apache/zeppelin/pull/1044
  
@corneadoug do you want me to rebase to the master on my fork?


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin issue #1129: [ZEPPELIN-1110] Catch Exception in ZeppelinIT. testSpa...

[minahlee]

Github user minahlee commented on the issue:

https://github.com/apache/zeppelin/pull/1129
  
Let me merge this into master as hotfix once the selenium test of last 
commit becomes green.


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1124: ZEPPELIN-1105: Python - add paragraph ERROR sta...

[bzz]

Github user bzz closed the pull request at:

https://github.com/apache/zeppelin/pull/1124


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[GitHub] zeppelin pull request #1124: ZEPPELIN-1105: Python - add paragraph ERROR sta...

[bzz]

GitHub user bzz reopened a pull request:

https://github.com/apache/zeppelin/pull/1124

ZEPPELIN-1105: Python - add paragraph ERROR status

### What is this PR for?
Implement paragraph ERROR status for Python interpreter in case of Error or 
Exception in the output.

### What type of PR is it?
Improvement

### What is the Jira issue?
[ZEPPELIN-1105](https://issues.apache.org/jira/browse/ZEPPELIN-1105)

### How should this be tested?
CI should pass, or

```
mvn 
"-Dtest=org.apache.zeppelin.python.PythonInterpreterWithPythonInstalledTest" 
test -pl python
```

should pass, or paragraph status should be ERROR for something like

```
import some-thing
```

### Screenshots (if appropriate)
![screen shot 2016-07-04 at 21 30 
23](https://cloud.githubusercontent.com/assets/5582506/16560453/8fd0dddc-422e-11e6-9977-c3aea052db39.png)


### Questions:
* Does the licenses files need update? No
* Is there breaking changes for older versions? No
* Does this needs documentation? No


You can merge this pull request into a Git repository by running:

$ git pull https://github.com/bzz/incubator-zeppelin 
ZEPPELIN-1105/python/add-paragraph-error-statu

Alternatively you can review and apply these changes as the patch at:

https://github.com/apache/zeppelin/pull/1124.patch

To close this pull request, make a commit to your master/trunk branch
with (at least) the following in the commit message:

This closes #1124


commit 4c1107b7611b91b381e7c23e7e1b8a467325bcb5
Author: Alexander Bezzubov 
Date:   2016-07-04T09:21:43Z

Refactoring: rename and extract var assignment

commit e7d537174816c7fc7cb698d482f394842820446e
Author: Alexander Bezzubov 
Date:   2016-07-04T12:21:12Z

Python: add ERROR paragraph status on Error and Exception in output

commit b58598200a57c249b68d5872f79ddacc7c50229a
Author: Alexander Bezzubov 
Date:   2016-07-04T12:16:01Z

Python: include Python-dependant tests to 1 CI profile

commit a7bf8f3516514c72e37975f4798fa7329750f378
Author: Alexander Bezzubov 
Date:   2016-07-04T13:35:46Z

Python: add missing license header




---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---

[jira] [Created] (ZEPPELIN-1112) %[group].[name] magic doesn't work

[Mina Lee (JIRA)]

Mina Lee created ZEPPELIN-1112:
--

 Summary: %[group].[name] magic doesn't work
 Key: ZEPPELIN-1112
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1112
 Project: Zeppelin
  Issue Type: Bug
Reporter: Mina Lee


Attaching log stack trace and screenshot
{code}
ERROR [2016-07-05 15:06:48,382] ({qtp981050382-16} 
NotebookServer.java[runParagraph]:1088) - Exception from run
org.apache.zeppelin.interpreter.InterpreterException: spark.spark interpreter 
not found
at 
org.apache.zeppelin.interpreter.InterpreterFactory.getInterpreter(InterpreterFactory.java:996)
at org.apache.zeppelin.notebook.Note.run(Note.java:452)
at 
org.apache.zeppelin.socket.NotebookServer.runParagraph(NotebookServer.java:1086)
at 
org.apache.zeppelin.socket.NotebookServer.onMessage(NotebookServer.java:181)
at 
org.apache.zeppelin.socket.NotebookSocket.onWebSocketText(NotebookSocket.java:56)
at 
org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextMessage(JettyListenerEventDriver.java:128)
at 
org.eclipse.jetty.websocket.common.message.SimpleTextMessage.messageComplete(SimpleTextMessage.java:69)
at 
org.eclipse.jetty.websocket.common.events.AbstractEventDriver.appendMessage(AbstractEventDriver.java:65)
at 
org.eclipse.jetty.websocket.common.events.JettyListenerEventDriver.onTextFrame(JettyListenerEventDriver.java:122)
at 
org.eclipse.jetty.websocket.common.events.AbstractEventDriver.incomingFrame(AbstractEventDriver.java:161)
at 
org.eclipse.jetty.websocket.common.WebSocketSession.incomingFrame(WebSocketSession.java:309)
at 
org.eclipse.jetty.websocket.common.extensions.ExtensionStack.incomingFrame(ExtensionStack.java:214)
at 
org.eclipse.jetty.websocket.common.Parser.notifyFrame(Parser.java:220)
at org.eclipse.jetty.websocket.common.Parser.parse(Parser.java:258)
at 
org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.readParse(AbstractWebSocketConnection.java:632)
at 
org.eclipse.jetty.websocket.common.io.AbstractWebSocketConnection.onFillable(AbstractWebSocketConnection.java:480)
at 
org.eclipse.jetty.io.AbstractConnection$2.run(AbstractConnection.java:544)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool.runJob(QueuedThreadPool.java:635)
at 
org.eclipse.jetty.util.thread.QueuedThreadPool$3.run(QueuedThreadPool.java:555)
at java.lang.Thread.run(Thread.java:745)
{code}



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[jira] [Created] (ZEPPELIN-1113) Paragraph is saving the colWidth when value didn't change

[CORNEAU Damien (JIRA)]

CORNEAU Damien created ZEPPELIN-1113:


 Summary: Paragraph is saving the colWidth when value didn't change
 Key: ZEPPELIN-1113
 URL: https://issues.apache.org/jira/browse/ZEPPELIN-1113
 Project: Zeppelin
  Issue Type: Improvement
Affects Versions: 0.5.6, 0.6.0
Reporter: CORNEAU Damien
Assignee: CORNEAU Damien
Priority: Minor
 Fix For: 0.6.1


If you use the shortcut or resize handle to make a paragraph colWidth bigger 
even though it's already at its maximum, we still send a WS event to save the 
config.



--
This message was sent by Atlassian JIRA
(v6.3.4#6332)

[GitHub] zeppelin issue #1124: ZEPPELIN-1105: Python - add paragraph ERROR status

[bzz]

Github user bzz commented on the issue:

https://github.com/apache/zeppelin/pull/1124
  
Thank you @minahlee for prompt review and notice on CI fix, I really 
appreciate!

Merging if there is no more discussion


---
If your project is set up for it, you can reply to this email and have your
reply appear on GitHub as well. If your project does not have this feature
enabled and wishes so, or if the feature is enabled but not working, please
contact infrastructure at infrastruct...@apache.org or file a JIRA ticket
with INFRA.
---