Re: Zeppelin Interpreter end

2015-06-29 Thread IT CTO
Actually reading some more about slider, I am not sure it s what I thought it is... to fast on sending this mail. Eran On Tue, Jun 30, 2015 at 9:46 AM IT CTO wrote: > If I am not mistaking Apache Slider is aim to handle dynamic growing and > shrinking of applications on YARN but it is still incu

Re: Zeppelin Interpreter end

2015-06-29 Thread IT CTO
If I am not mistaking Apache Slider is aim to handle dynamic growing and shrinking of applications on YARN but it is still incubating (as zeppelin) might be interesting writing a slider package for zeppeling. Eran On Tue, Jun 30, 2015 at 9:02 AM Alexander Bezzubov wrote: > Hi, > > right now, I'm

Re: Zeppelin Interpreter end

2015-06-29 Thread Alexander Bezzubov
Hi, right now, I'm not aware of such configuration in Zeppelin (please, feel free to open the issue\submit a patch). AFAIK dynamic YARN resource allocation is up to the user and is not configured by default right now, which looks like one possible solution to the problem you describe (at least cp

Re: achieved so far using Zeppelin

2015-06-29 Thread Su She
Thanks Nihal! This is how I tried it, but I am trying to pull my json file from a URL, so I can't do (s"http://ip.json";). If you know any easy fix to this (other than saving the file), please let me know, if not no worries, as I'm also going to have this data in hdfs/hive. the code i tried was:

Re: achieved so far using Zeppelin

2015-06-29 Thread Nihal Bhagchandani
Hi Su, following is the code which I have used to access JSON file in zeppelin //load tweets Json Data as DataFrame val jfile = sqlContext.jsonFile(s"file:///local/path/on/my/machine/data.json") //print the schema for jFile DataFrame jfile.printSchema //since jfile holds the data in DataFrames we

Re: Zeppelin in multi user environment

2015-06-29 Thread Alexander Bezzubov
Hi, thank you for asking, indeed, as Moon mentioned, we are working on making a standalone tool available that is a reverse proxy, capable of launching separate docker container per-user for the chosen spark\hadoop version, implementing the A. architecture from above. -- Alex On Mon, Jun 29, 2

Zeppelin Interpreter end

2015-06-29 Thread Litt, Shaun
Hi, I am new to zeppelin and just got it configured to run in my YARN cluster, but I was wondering if there is a configuration or even a hard setting that shuts down interpreters after in-activity. It seems like the interpreter (and it's yarn consumption) hang out indefinitely, ideally there w

Re: achieved so far using Zeppelin

2015-06-29 Thread Su She
Hello Nihal, Quick question, how were you able to read data from a Json file? I've been unable to import "play.api.libs.json". Thanks! Best, Su On Fri, Jun 26, 2015 at 9:00 AM, Nihal Bhagchandani < nihal_bhagchand...@yahoo.com> wrote: > Sure, I am just waiting for my zeppelinhub.com credentia

Re: Minor bug in dynamic form and question on limits of results

2015-06-29 Thread Su She
Hey Moon/All, sorry for the late reply. This is the problem I'm encountering when trying to register Hive as a temptable. It seems that it cannot find a table, I have bolded this in the error message that I've c/p below. Please let me know if this is the best way for doing this. My end goal is to

Re: How to enter math formula in markdown

2015-06-29 Thread moon soo Lee
Website can be updated from everyone by making pullrequest to gh-pages branch. I don't mind whether it is wiki or website, while it can be accessed from people. but still, everything is in the website at the moment. Groovy interpreter sounds great. why not? Best, moon On Mon, Jun 29, 2015 at 10:

Re: How to enter math formula in markdown

2015-06-29 Thread tog
Hi moon I was having wiki in mind because we need the page to be accessible by everyone. I don't believe this is the case for http://zeppelin.incubator.apache.org/docs/index.html. My email was also referring to new interpreter, let say I would write a Groovy interpreter (now an Apache incubator p

Re: How to enter math formula in markdown

2015-06-29 Thread moon soo Lee
Hi, Guillaume Thanks for the good idea about core / external interpreter. One alternative to wiki is interpreter section of Zeppelin's website http://zeppelin.incubator.apache.org/docs/index.html. Although there're no guideline to add external interpreter to the website, I don't see anything bloc

RE: Node_temp/ node.tar.gz error

2015-06-29 Thread Vadla, Karthik
Yes you need to have proxy settings for Maven, npm, git and bower individually. From: Ranjit Manuel [mailto:ranjit.f.man...@gmail.com] Sent: Monday, June 29, 2015 1:41 AM To: users@zeppelin.incubator.apache.org Subject: Re: Node_temp/ node.tar.gz error have added the proxy settings to maven and

RE: Not able to see hive metastore in Zeppelin

2015-06-29 Thread Vadla, Karthik
Hi Eran, Even I’m looking for a clarify in this regard. 1. In my one-node CDH 5.4 cluster, when I configured zeppelin. I’m able to access hive metastore with all hives commands using %sql (ex: show databases, show tables..etc) 2. In my multi-node CDH 5.4 cluster, when I configured

Re: Importing a csv file into zeppelin!

2015-06-29 Thread Robin Hillyard
Ooh, sorry, I didn’t see your response. I can just email you the code if you like. You can use it for yourself until I can find a way of contributing it. Robin > On Jun 23, 2015, at 11:18 PM, George Koshy wrote: > > Sure Robin, that would be great help! Where can I find the library fu

Re: UDFs in Zeppelin??

2015-06-29 Thread Ophir Cohen
BTW The same query, on the same cluster but on Spark shell return the expected results. On Mon, Jun 29, 2015 at 3:24 PM, Ophir Cohen wrote: > It looks that Zeppelin jar does not distributed to Spark nodes, though I > can't understand why it needed for the UDF. > > On Mon, Jun 29, 2015 at 3:23 PM

Re: UDFs in Zeppelin??

2015-06-29 Thread Ophir Cohen
It looks that Zeppelin jar does not distributed to Spark nodes, though I can't understand why it needed for the UDF. On Mon, Jun 29, 2015 at 3:23 PM, Ophir Cohen wrote: > Thanks for the response, > I'm not sure what do you mean, it exactly what I tried and failed. > As I wrote above, 'hc' is act

Re: UDFs in Zeppelin??

2015-06-29 Thread Ophir Cohen
Thanks for the response, I'm not sure what do you mean, it exactly what I tried and failed. As I wrote above, 'hc' is actually different name to sqlc (that is different name to z.sqlContext). I get the same results. On Mon, Jun 29, 2015 at 2:12 PM, Mina Lee wrote: > Hi Ophir, > > Can you try be

Re: UDFs in Zeppelin??

2015-06-29 Thread Mina Lee
Hi Ophir, Can you try below? def getNum(): Int = { 100 } sqlc.udf.register("getNum", getNum _) sqlc.sql("select getNum() from filteredNc limit 1").show FYI sqlContext(==sqlc) is internally created by Zeppelin and use hiveContext as sqlContext by default. (If you did not change useHiveContext

Re: UDFs in Zeppelin??

2015-06-29 Thread Ophir Cohen
Guys? Somebody? Can it be that Zeppelin does not support UDFs? On Sun, Jun 28, 2015 at 11:53 AM, Ophir Cohen wrote: > Hi Guys, > One more problem I have encountered using Zeppelin. > Using Spark 1.3.1 on Yarn Hadoop 2.4 > > I'm trying to create and use UDF (hc == z.sqlContext == HiveContext): >

Re: shortcuts

2015-06-29 Thread Corneau Damien
Hi, If you want to open an issue, you can do it on Apache Zeppelin's JIRA here: https://issues.apache.org/jira/browse/zeppelin On Mon, Jun 29, 2015 at 5:48 PM, pablo leon wrote: > Thanks! Where can I open an Issue (can't find it in the github repo)? I > will make a list with shortcut suggestion

Re: Neat Zeppelin Use Cases

2015-06-29 Thread tog
As far as the wordcloud is concerned you will find an example in the mailing list. I can help you if you have any issue with it but you need the narrative of your demo to be set ;-) On 29 June 2015 at 10:25, Daniel Haviv wrote: > I'm displaying the basic SQL and charting capabilites but I'd als

Re: Neat Zeppelin Use Cases

2015-06-29 Thread Daniel Haviv
I'm displaying the basic SQL and charting capabilites but I'd also like to demo some more advanced capabilites (like the WordCloud example). I need it by the end of the week. Thanks, Daniel On Mon, Jun 29, 2015 at 12:19 PM, tog wrote: > Hi > > Any idea what you would like to showcase ? Any dead

Re: Neat Zeppelin Use Cases

2015-06-29 Thread tog
Hi Any idea what you would like to showcase ? Any deadline ? Cheers Guillaume On 29 June 2015 at 07:52, IT CTO wrote: > Can I get an invite? which meetup you are presenting in? > > > On Mon, Jun 29, 2015 at 9:30 AM Daniel Haviv < > daniel.ha...@veracity-group.com> wrote: > >> Hi everybody, >>

Re: shortcuts

2015-06-29 Thread pablo leon
Thanks! Where can I open an Issue (can't find it in the github repo)? I will make a list with shortcut suggestions. Best, Pablo On 29.06.2015 03:19, Corneau Damien wrote: Hi, You should be able to have a list of available shortcuts by pressing the help button in the notebook. Like Moon said,

Re: Node_temp/ node.tar.gz error

2015-06-29 Thread Ranjit Manuel
have added the proxy settings to maven and npm, but still I get the same error. If you see the log below, it shows that it was able to download the tar.gz file. I believe this step cannot be skipped. Is proxy setup required for git also at this point? Any help is appreciated to resolve this Dow