How to support multiple notebooks in Zeppelin

2015-12-30 Thread Dafeng Wang
Hi All, I had tried with Zeppelin today, it works perfectly in stand-alone mode, my questions now are: 1. Capacity limitation of Zeppelin-Server, in other words, how many notebook instance one server can support 2. If we want to scale out Zepplein-server, is that possible? If so, t

Re: How to support multiple notebooks in Zeppelin

2015-12-30 Thread moon soo Lee
Hi Dafeng, Zeppelin at the moment keeps every notebook in memory once it's been loaded. So number of notebooks supported by instance will be limited by the memory on the system. Scale out Zeppelin-Server you mean scale out the server that serves REST API, Websocket connection? Thanks, moon On W

2015: year in review

2015-12-30 Thread Alexander Bezzubov
Dear fellow Zeppelin developers and useres, the year 2015 is about to end so I wanted to say thank you to everybody here - its been a great year for the project indeed! Wish you a happy new year and want to share a small review of Zeppelin in 2015 I did https://medium.com/@bzz_/apache-zeppelin-in

Re: 2015: year in review

2015-12-30 Thread Hyung Sung Shim
Dear Alexander. Thank you for your Very good review and happy new year!! 2015년 12월 31일 목요일, Alexander Bezzubov님이 작성한 메시지: > Dear fellow Zeppelin developers and useres, > > the year 2015 is about to end so I wanted to say thank you to everybody > here - its been a great year for the project indee

RE: How to support multiple notebooks in Zeppelin

2015-12-30 Thread Dafeng Wang
Hi Moon, Thanks for your quick response. 1. For first question, got your answer. that means all meta info, paragraph, and result of one notebook will be cached in memory once loaded, right? 2. For #2, my real question will be how to serve millions of users for Zeppelin. Per my cur

Re: How to support multiple notebooks in Zeppelin

2015-12-30 Thread moon soo Lee
Hi Dafeng, Right, all informations are cached in memory once loaded. To serve large amount of notebooks, we'll need to modify Zeppelin a bit to not keep them in the memory. For #2, Multiple ZeppelinServer can be configured to use shared notebook storage. And loadbalancer in front of them can dist

Re: 2015: year in review

2015-12-30 Thread Henry Saputra
Happy New Year to Zeppelin community =) - Henry On Wed, Dec 30, 2015 at 3:00 PM, Alexander Bezzubov wrote: > Dear fellow Zeppelin developers and useres, > > the year 2015 is about to end so I wanted to say thank you to everybody > here - its been a great year for the project indeed! > > Wish you

Re: 2015: year in review

2015-12-30 Thread Jungtaek Lim
Alexander, thanks for the great article! Happy new year all! Jungtaek Lim (HeartSaVioR) On Thu, Dec 31, 2015 at 8:00 AM, Alexander Bezzubov wrote: > Dear fellow Zeppelin developers and useres, > > the year 2015 is about to end so I wanted to say thank you to everybody > here - its been a great

Re: 2015: year in review

2015-12-30 Thread moon soo Lee
Awesome! Happy New Year! On 2015년 12월 30일 (수) at 오후 6:42 Jungtaek Lim wrote: > Alexander, > thanks for the great article! > > Happy new year all! > > Jungtaek Lim (HeartSaVioR) > > On Thu, Dec 31, 2015 at 8:00 AM, Alexander Bezzubov > wrote: > >> Dear fellow Zeppelin developers and useres, >> >

Re: 2015: year in review

2015-12-30 Thread Kevin (Sangwoo) Kim
Great! Hope our community grows even more in New Year! 2015년 12월 31일 (목) 오전 11:42, Jungtaek Lim 님이 작성: > Alexander, > thanks for the great article! > > Happy new year all! > > Jungtaek Lim (HeartSaVioR) > > On Thu, Dec 31, 2015 at 8:00 AM, Alexander Bezzubov > wrote: > >> Dear fellow Zeppelin d

RE: How to support multiple notebooks in Zeppelin

2015-12-30 Thread Dafeng Wang
Hi Moon, Thanks again for the answer. Your idea looks great! The purpose of binding notebook with one specific instance is just to save the loading time, right? I’ll do a little bit try with this solution, then probably will bring more questions: such as how to map one ZeppelinServer to differen

Re: 2015: year in review

2015-12-30 Thread Renjith Kamath
Alexander, Thanks for the 2015 review. Happy New Year Thanks & Regards, RK On Thu, Dec 31, 2015 at 8:30 AM, Kevin (Sangwoo) Kim wrote: > Great! Hope our community grows even more in New Year! > > > 2015년 12월 31일 (목) 오전 11:42, Jungtaek Lim 님이 작성: > >> Alexander, >> thanks for the great article!

Re: 2015: year in review

2015-12-30 Thread madhuka udantha
Wish all best for Zeppelin and happy new year for Zeppelin community!! On Thu, Dec 31, 2015 at 9:18 AM, Renjith Kamath wrote: > Alexander, Thanks for the 2015 review. Happy New Year > > Thanks & Regards, > RK > > On Thu, Dec 31, 2015 at 8:30 AM, Kevin (Sangwoo) Kim > wrote: > >> Great! Hope our

Error while starting Zeppelin Service in HDP2.3.2

2015-12-30 Thread Divya Gehlot
Hi, I am getting following error while starting the Zeppelin service from ambari server . /var/lib/ambari-agent/data/errors-2408.txt Traceback (most recent call last): File "/var/lib/ambari-agent/cache/stacks/HDP/2.3/services/ZEPPELIN/package/scripts/master.py", line 295, in Master().exec

Notebook dependency based scheduling

2015-12-30 Thread Skanda
Hi All I would like to orchestrate the notebook dependencies as part of the Schedule. As an example, I would like to execute a note first and then if it completes successfully, I would like to trigger 2 other notes in parallel. This is something that a scheduler like Oozie offers (flow orchestrati