SqlContext registerTempTable issue

2015-06-13 Thread Nihal Bhagchandani
Hi Gurus, I am trying to access some json data using sqlContext.jsonFile in zeppelin, following code execute without any error: import sys.process._ val sqlCon = new org.apache.spark.sql.SQLContext(sc) val jfile = sqlCon.jsonFile(s"file:///usr/local/src/knoldus/projects/scaladay_data/scalaDays20

Re: SqlContext registerTempTable issue

2015-06-13 Thread moon soo Lee
Hi, I think if you remove following line val sqlCon = new org.apache.spark.sql.SQLContext(sc) and use sqlContext (which is automatically created by Zeppelin) then i think i'll work. Hope this helps. moon On Sat, Jun 13, 2015 at 6:00 AM Nihal Bhagchandani < nihal_bhagchand...@yahoo.com> wrote:

Re: Notebook Storage Options

2015-06-13 Thread moon soo Lee
Hi, Here's some related pullrequests you might interested. notebook storage options https://github.com/apache/incubator-zeppelin/pull/44 authentication https://github.com/apache/incubator-zeppelin/pull/53 Thanks, moon On Fri, Jun 12, 2015 at 11:08 PM Corneau Damien wrote: > So, except for th

Re: Notebook Storage Options

2015-06-13 Thread John Omernik
My thought on the ACL stuff would be I could spin up individual docker containers for each user. Each User would be granted it's own instance of Zeppelin that they would use and the executable would as that user. . But yes, the concept there is to make it like the traditional tree structures we kno

Re: Notebook Storage Options

2015-06-13 Thread John Omernik
Moon - Thank you, those seem like on the right track. I am not too worried about a notebook persistence option as much as a way that we can specify the root folder and then use a tree like navigation that knows the differences between notebooks folders and regular folders. I think as people use it

Re: PySpark Interpretor not working

2015-06-13 Thread moon soo Lee
Hi, Looks like your configuration okay, if you're not using yarn-client mode. Could you make sure your interpreter setting have spark.home property set to /home/biadmin/spark-1.3.0/spark-1.3.0-bin-hadoop2.4 ? Thanks, moon On Thu, Jun 11, 2015 at 12:14 PM Marcel Hofmann wrote: > Hey everybody,

Re: Getting Wisp to plot inline.

2015-06-13 Thread moon soo Lee
Hi, This link could help, to know what '%html' is http://zeppelin.incubator.apache.org/docs/display.html Thanks, moon On Thu, Jun 11, 2015 at 10:14 PM Corneau Damien wrote: > Actually it's not listed anywhere in the interpreters and you can't even > use it as simple %html query, > > It's like

Re: Possible memory leak

2015-06-13 Thread moon soo Lee
Hi, Thanks for reporting a problem. If you file an issue to our jira, it would help to track the status of the issue. Thanks for valuable feedback. moon On 2015년 6월 9일 (화) at 오후 11:35 Karim Hamed wrote: > Hello, > > I believe there maybe some sort of memory leak in zeppelin. Any memory > used b

Re: PySpark Interpretor not working

2015-06-13 Thread MrAsanjar .
hi I had a similar issue, try these: 1) add following settings to zeppelin-env.sh ( it must be added there at this time) export MASTER=yarn-client export HADOOP_CONF_DIR=/etc/hadoop/conf export PYTHONPATH=/usr/lib/spark/python:/usr/lib/spark/python/lib/py4j-0.8.2.1-src.zip export SPARK_YARN_USER_EN

Re: Notebook Storage Options

2015-06-13 Thread Corneau Damien
So far, I know a lot of people using multiple instance of zeppelin to restrain the notebooks access. (For teams or people) Its a great way to not mess with each other notebooks and ressources. For the filesystem file structure, I think it will be a natural evolution from the current flat structur

Publish (link this paragraph) with interactive form?

2015-06-13 Thread Peng Cheng
I'm trying to embed an interactive paragraph of a Zeppelin notebook into another webpage, as demonstrated in this figure: https://zeppelin.incubator.apache.org/assets/themes/zeppelin/img/screenshots/publish.png But the "link this paragraph generate" only generate an URL to the static part of the

Re: Publish (link this paragraph) with interactive form?

2015-06-13 Thread Peng Cheng
I browse the commit history and found that the form in Iframe mode was hidden in this commit: https://github.com/apache/incubator-zeppelin/commit/623901698e99841b99c80c62c207bc6bb218320d zeppelin-web/app/views/paragraph.html line 69 Is there a reason this field was hidden in asIframe mode? On 13