Re: Zeppelin Tutorial Notebook -java.lang.reflect.InvocationTargetException on Spark 1.2 - removed toDF

2015-06-16 Thread Su She
Thanks Nihal for the suggestion, I kinda realized what the problem is.I realized that zeppelin will use the hivecontext unless it is set to false. So I set it to false in env.sh and the 3 charts at the bottom of the tutorial work as then SQLContext becomes the default instead of HiveContext. Howev

Re: Zeppelin Tutorial Notebook -java.lang.reflect.InvocationTargetException on Spark 1.2 - removed toDF

2015-06-16 Thread Nihal Bhagchandani
Hi Su, it seems like your table is not getting registered. can you try the following:if you have used the following line "val sqlContext = new org.apache.spark.sql.SQLContext(sc)" I would suggest to comment it, as zeppelin creates sqlContext byDefault. if you didnt have the above line do write f

Zeppelin Tutorial Notebook -java.lang.reflect.InvocationTargetException on Spark 1.2 - removed toDF

2015-06-16 Thread Su She
Hello, excited to get Zeppelin up and running! 1) I was not able to go through the Zeppelin tutorial notebook. I did remove toDF which made that paragraph work, but the 3 graphs at the bottom all returned the InvocationTargetException 2) From a couple other threads on the archive it seems like t

Re: HTTP Keep Alives on GUI and Websockets

2015-06-16 Thread moon soo Lee
Hi, Thanks for the feedback. I think it really make sense to have some kind of heartbeat to keep connection alive in such environment. Could you create an issue for it? Thanks, moon On Tue, Jun 16, 2015 at 10:16 AM John Omernik wrote: > Hello - > > I am playing around with Zeppelin in a mesos

Re: Disconnected from Web App

2015-06-16 Thread Anthony Corbacho
your are welcome On Jun 16, 2015 5:16 PM, "Su She" wrote: > Ahh got it, so once I tunneled into 8086 and 8087, I was able to > connect to the web app on 8086. Thank you! > > > On Tue, Jun 16, 2015 at 2:54 PM, Anthony Corbacho > wrote: > > okay I see, Zeppelin use 2 ports, one for the web and the

Re: Disconnected from Web App

2015-06-16 Thread Su She
Ahh got it, so once I tunneled into 8086 and 8087, I was able to connect to the web app on 8086. Thank you! On Tue, Jun 16, 2015 at 2:54 PM, Anthony Corbacho wrote: > okay I see, Zeppelin use 2 ports, one for the web and the other one for > websocket. > > the websocket is bind to zeppelinweb + 1

Re: Plotting images

2015-06-16 Thread Corneau Damien
Hi, There is work being made towards extending the visualization, you can learn about it more here and follow the status on the confluence: https://issues.apache.org/jira/browse/ZEPPELIN-107 There was an example of matplotlib working in the mailing list not long time ago, you can look at this thr

Re: Disconnected from Web App

2015-06-16 Thread Anthony Corbacho
okay I see, Zeppelin use 2 ports, one for the web and the other one for websocket. the websocket is bind to zeppelinweb + 1. in your case, since you changed Zeppelin port from 8080 to 8086 the websocket port will be 8087. you might add this one in your firewall rule. On Jun 16, 2015 2:10 PM, "Su

Re: Disconnected from Web App

2015-06-16 Thread Su She
So, 8080 and 8081 are open, but they are used by Spark. So I changed the port to 8086 in the zeppelin-site.xml file. I am tunneling into 8086 and am able to see the web app at localhost:8086. However, when I get to the web app, on the top right corner it says "Disconnected", and when I try to creat

Re: Disconnected from Web App

2015-06-16 Thread Anthony Corbacho
hi, can you make sure that the port 8080 and 8081 are open? you may have to open it from your firewall. On Jun 16, 2015 11:29 AM, "Su She" wrote: > Hello! > > Beginner user here... > > I'm running on CDH 5.3/Spark 1.2. I was able to access the web app, > but is says I am disconnected in the top

Re: D3 plotting in the notebook.

2015-06-16 Thread Wood, Dean Jr (GE Oil & Gas)
That is perfect thank you. The tip on reading files in is hugely useful too. Thanks again for all your help. Dean > On 16 Jun 2015, at 17:43, moon soo Lee wrote: > >

Disconnected from Web App

2015-06-16 Thread Su She
Hello! Beginner user here... I'm running on CDH 5.3/Spark 1.2. I was able to access the web app, but is says I am disconnected in the top right corner and I am unable to create a note. Details: 1) Didn't change env.sh as I am okay with running locally, do I still need to set env variables? 2)

Plotting images

2015-06-16 Thread Philipp
Hi all, I would like to know whether there exists the possibility to make use of a general plotting library, like for example matplotlib in python, in the notebooks. The current visualizations are very good but also a little limiting. What are your plans towards a more general plotting functional

HTTP Keep Alives on GUI and Websockets

2015-06-16 Thread John Omernik
Hello - I am playing around with Zeppelin in a mesos/docker setup and am using HAProxy/mesosDNS to connect to my instances. For those who want a cliff notes on this, HAProxy takes apps started in marathon and routes them to appropriate host on the mesos cluster, the mesos-DNS allows me to have ho

Re: Zeppelin In Docker on Mesos

2015-06-16 Thread John Omernik
So interesting, now for Hive Interpreter it's working. I figured there are a few "gotchas" in that when I created an individual conf directory for each user, and specified that, it was still looking in the $ZEPPELIN_HOME/conf I.e. my interpreters.json was read from there. When I renamed $ZEPPELI

D3 plotting in the notebook.

2015-06-16 Thread Wood, Dean Jr (GE Oil & Gas)
Hi all, I’m having some issues getting html to display properly. I have a standalone web page which presents a simple D3 graph. Pointing my browser to it works perfectly well but when I try and print it via the %html tag in zeppelin nothing happens. Finding the log that would tell me what is go

Re: Zeppelin In Docker on Mesos

2015-06-16 Thread John Omernik
Thanks Brian: Here's how I have it setup. The "install directory" is NFS mounted and mounted Readonly. I did this on purpose as I was hoping to share this. using the ZEPPELIN_HOME (RO) ZEPPELIN_CONF_DIR (NFS mounted, per user read/write) ZEPPELIN_LOG_DIR (Set to a local directory in the contain

Re: Zeppelin In Docker on Mesos

2015-06-16 Thread John Omernik
As a follow-up with the zeppelin installation read/write. I get the same error messages, I don't think that is what's causing my issue. On Tue, Jun 16, 2015 at 9:10 AM, John Omernik wrote: > Thanks Brian: > > Here's how I have it setup. The "install directory" is NFS mounted and > mounted Reado

Re: Zeppelin In Docker on Mesos

2015-06-16 Thread Brian McDevitt
I'd first check that the user that's running zeppelin has ownership of the zeppelin installation and has appropriate rights to read any additional files you might need. Hope that helps, Brian Thanks, Brian McDevitt Software Engineer The Nerdery On Tue, Jun 16, 2015 at 8:25 AM, John Omernik wrot

Zeppelin In Docker on Mesos

2015-06-16 Thread John Omernik
Hey all, I am running into an interesting problem and I think I am getting to the end of my ability to troubleshoot so I thought I'd list things out here and see if anyone has more ideas for next steps in troubleshooting. I am running a Docker Container I built in Mesos. I can get things up and r