Re: [GSoC 2015][COMDEV-119] Zeppelin GSoC Project: add more D3 visualization

2015-03-22 Thread madhuka udantha
Hi, moon Yes, Since > "Moving computation is cheaper than moving data" We can do computation in computing framework. For simple pivot changing or filtering can be handle in local storage with indexing databases depending on the current user level. As you saw, computations will be handle in the

Re: [DISCUSS] Ability to create rich gui inside of Notebook

2015-03-22 Thread Corneau Damien
Right, Technically the only thing the user can break would be it's own web browser rendering, and it wouldn't affect the other users of the Zeppelin Instance. (Also since it's web browser, you can break anything you want using the Dev Tool :p) However if you can package and distribute your template

Docker Images for Zeppelin (as release artifacts)

2015-03-22 Thread Alex B.
Subj changed, was "Introduction" AFAIK by apache release policy nothing, except the source code, is considered to be an 'official release'. That been said, anything that project finds to be useful to provide to it's users (without license violations of course) could be done, no special vote neede

Re: Introduction

2015-03-22 Thread moon soo Lee
Some time ago i have created organization 'zeppelin' on docker hub. https://registry.hub.docker.com/repos/zeppelin/ What do you think, Is it good idea to provide docker image through this account? By the way, i'm little bit curious about whether publishing docker image is going be a problem with A

Re: Introduction

2015-03-22 Thread Anthony Corbacho
Hi, I did one long ago for centOS. I am willing to update it and provide images for different spark version as well :) On Mon, Mar 23, 2015 at 12:14 PM, Jongyoul Lee wrote: > RJ Nowling, > > I make a PR for Integrating Bigtop, I hope it will help Bigtop and > Zeppelin. > > Alex, Anthony Corbach

Re: Introduction

2015-03-22 Thread Jongyoul Lee
RJ Nowling, I make a PR for Integrating Bigtop, I hope it will help Bigtop and Zeppelin. Alex, Anthony Corbacho, I made a simple docker container for making debian package. If anyone thinks it's useful, I'm willing to take mroe effort to publish generally. Give me an opinion. Regards, Jongyoul

Re: [DISCUSS] Ability to create rich gui inside of Notebook

2015-03-22 Thread moon soo Lee
I think if there're some sort of sandbox technique we can use for html, it'll be really helpful on view side. As far as i know, the only safe sandbox in html is using iframe and it's not seamless and difficult to use. So for now, i think causing problem on view side (like overriding css) is up to u

Re: [GSoC 2015][COMDEV-119] Zeppelin GSoC Project: add more D3 visualization

2015-03-22 Thread moon soo Lee
Hi, madhuka udantha I think your idea about chart library and data transformation engine sounds cool. For the data transform modules, it's good idea to make this pluggable to data transform engine. But i'm not sure getting result locally and do transform for pivot or filtering to prevent run query

Re: Introduction

2015-03-22 Thread Anthony Corbacho
Hey, I am really interested in providing docker containers too. If you guys wants to team up let me know :) On Mon, Mar 23, 2015 at 10:04 AM Alex wrote: > Jongyoul Lee, RJ Nowling, > > It is so great to see you guys interested and contributing to Zeppelin, > thank you very much! > > BigTop int

Re: Introduction

2015-03-22 Thread Alex
Jongyoul Lee, RJ Nowling, It is so great to see you guys interested and contributing to Zeppelin, thank you very much! BigTop integration is definitely something we all are very interested in, and having a Docker container for demo purpose with different Spark/Hadoop versions is equally import

Re: [GSoC 2015][COMDEV-119] Zeppelin GSoC Project: add more D3 visualization

2015-03-22 Thread madhuka udantha
On Sun, Mar 22, 2015 at 7:05 PM, Corneau Damien wrote: > Hi, > > Being able to aggregate on the query side is a great idea and would allow > us to transfer less data as well as having a full query representation of > the visualization. > > However creating a SQL query dynamically is a pretty diff

Re: [GSoC 2015][COMDEV-119] Zeppelin GSoC Project: add more D3 visualization

2015-03-22 Thread madhuka udantha
Hi, Eran Yes I agree on your point. And it's a worthwhile idea you shared with us. I also thought that we could have different levels such as safe, medium, restricted and highly restricted so that the user can reach higher levels by acceptance of the lower levels after successful retrieval or vis

Re: Introduction

2015-03-22 Thread RJ Nowling
Hi Jongyoul, Ok great! I've added the BigTop dev list. We need to create a BigTop JIRA -- I don't currently see one. There is a thread about Zeppelin integration on the BigTop dev list but Youngwoo probably hasn't time to respond yet. I'd be happy to assist with review and testing the patches.

Re: Introduction

2015-03-22 Thread Jongyoul Lee
Hi, I'm Jongyoul Lee. Youngwoo Kim, who is also a committer on BigTop, already issued BigTop integration when I submitted a PR about DEB package, and he will help me when I try to integrate Zeppelin to BigTop. After repo moves to ASF, I'll do the task. Do you consider my opinion? I'm very interest

Introduction

2015-03-22 Thread RJ Nowling
Hi All, I'm a software engineer in Emerging Technologies (Big Data focus) at Red Hat and committer on BigTop. I'd like to get involved with developing Zeppelin and growing the community. I can help with BigTop packaging, for example, if no one is currently tackling that. (Once migration is com

Re: [DISCUSS] Ability to create rich gui inside of Notebook

2015-03-22 Thread Corneau Damien
I didn't see the original email... :'( There should not be any problem with user affecting the current notebook UI, at least on the scope level. Since we could create a particular scope variable in the app to take care of this kind of values. For things like event ($broadcast) and controllers, it

Re: [DISCUSS] Ability to create rich gui inside of Notebook

2015-03-22 Thread RJ Nowling
This sounds very useful. Would there be issues where users could easily cause problems with the notebook's own UI? > On Mar 22, 2015, at 7:57 AM, moon soo Lee wrote: > > Hi, > > Zeppelin currently has feature that creates form dynamically. ( > http://zeppelin.incubator.apache.org/docs/dynamic

Re: [GSoC 2015][COMDEV-119] Zeppelin GSoC Project: add more D3 visualization

2015-03-22 Thread Corneau Damien
Hi, Being able to aggregate on the query side is a great idea and would allow us to transfer less data as well as having a full query representation of the visualization. However creating a SQL query dynamically is a pretty difficult task, and might be too much for that scope. Also I see some po

Re: [GSoC 2015][COMDEV-119] Zeppelin GSoC Project: add more D3 visualization

2015-03-22 Thread IT CTO
Hi, The Chart library features sounds promising. As for the data engine - one thing that I think is missing is the ability to use the visualization to drive the aggregation in the SQL. today, you first write the SQL, you execute it, *limited by the number of results sent to the client*, and then

[DISCUSS] Ability to create rich gui inside of Notebook

2015-03-22 Thread moon soo Lee
Hi, Zeppelin currently has feature that creates form dynamically. ( http://zeppelin.incubator.apache.org/docs/dynamicform.html) It's only supporting simple input text and dropdown list. Recently Damien and Me discussed about ability to create rich GUI, and i'm bringing the discussion to the onlin