Re: 0.6.0 Release

2016-04-14 Thread Randy Gelhausen
Hi Jordan, if you're not content to wait for a binary release, it's not too hard to build a snapshot yourself. Here's a script I use frequently to build Zeppelin from master and setup on HDP clusters: https://gist.github.com/randerzander/5c6ca7bdd06876c9b247 On Thu, Apr 14, 2016 at 6:50 PM,

z.angularbind from sql

2016-04-04 Thread Randy Gelhausen
https://gist.github.com/randerzander/fb4a4ff1fcb84f9304b9 In the example above, I'm using $spark to access z.angularbind -- is there a way to access it directly from %sql instead of needing to wrap my queries in Scala?

Re: Importaing Hbase data

2016-03-25 Thread Randy Gelhausen
You can put an Phoenix view on top of your existing HBase table, then use Phoenix's Spark module to read the table into a dataframe. On Fri, Mar 25, 2016 at 12:44 PM, Benjamin Kim wrote: >

Re: Unable to start Zeppelin + Spark

2015-10-01 Thread Randy Gelhausen
See https://issues.apache.org/jira/browse/ZEPPELIN-324 which was just merged. We switched the Karma JS unit tests to port 9002 since it is less commonly used than the previous default of 8080. If you're getting this error, can you check that you don't have another service already using port 9002?

Re: Build Zeppelin for Spark 1.5 on OSX

2015-09-26 Thread Randy Gelhausen
I'm running into the same problem. I'm also using -DskipTests, so I'm not sure why karma tests are even running. Is this something that can be fixed in some way? On Fri, Sep 18, 2015 at 2:36 AM, madhuka udantha wrote: > (grunt test) karma is able to pick next port

Re: Git Zeppelin on Spark 1.5.0

2015-09-26 Thread Randy Gelhausen
Here are the steps I use to build and run on HDP 2.3.0: https://gist.github.com/randerzander/5c6ca7bdd06876c9b247 Specifically, you need to set spark.driver.extraJavaOptions and spark.yarn.am.extraJavaOptions, else YARN will reject your application launch. On Thu, Sep 24, 2015 at 10:20 PM,

Re: Build Zeppelin for Spark 1.5 on OSX

2015-09-26 Thread Randy Gelhausen
8080. I'm creating an issue and PR to address this shortly. On Sat, Sep 26, 2015 at 2:36 PM, Randy Gelhausen <rgel...@gmail.com> wrote: > I'm running into the same problem. I'm also using -DskipTests, so I'm not > sure why karma tests are even running. > > Is this something

Re: %spark.dep only loading deps for driver?

2015-08-24 Thread Randy Gelhausen
Any ideas? Is z.load supposed to make dependencies available to all Spark JVMs (driver AND executors)? Thanks, -Randy On Sun, Aug 23, 2015 at 2:41 PM, Randy Gelhausen rgel...@gmail.com wrote: It seems Spark executors are not being provided with the requisite dependencies. With spark-shell I

Re: %spark.dep only loading deps for driver?

2015-08-24 Thread Randy Gelhausen
, moon soo Lee m...@apache.org wrote: Hi Randy, z.load() supposed to make dependencies available to all driver and executors. However, it might not work correctly in yarn-client mode. Are you using yarn-client mode? Best, moon On Mon, Aug 24, 2015 at 9:12 AM Randy Gelhausen rgel...@gmail.com

%spark.dep only loading deps for driver?

2015-08-23 Thread Randy Gelhausen
It seems Spark executors are not being provided with the requisite dependencies. With spark-shell I can pass --jars /path/to/dep.jar. How can we achieve this with Zeppelin, preferable inside a Note? %spark.dep z.addRepo(hortonworks).url(

Re: restarting zeppelin interpreter

2015-08-23 Thread Randy Gelhausen
Hi Marc, Try going to the interpreter menu and restarting the interpreter you're using. Thanks, -Randy On Sun, Aug 23, 2015 at 5:07 PM, Marc Warren marcswar...@gmail.com wrote: If I have a single notebook that is hung, is there a way to restart that single instance without having to restart

File name too long error in Spark paragraphs

2015-08-22 Thread Randy Gelhausen
Hi All, Anyone see something similar to this: %spark import org.apache.spark.sql._ import org.apache.phoenix.spark._ val input = /user/root/crimes/atlanta val df = sqlContext.read.format(com.databricks.spark.csv).option(header, true).option(DROPMALFORMED, true).load(input) val columns =

Re: Unable to run count(*)

2015-08-05 Thread Randy Gelhausen
You likely have a problem with your parsing logic. I can’t see the data to know for sure, but since Spark is lazily evaluated, it doesn’t try to run your map until you execute the SQL that applies it to the data. That’s why your first paragraph can run (it’s only defining metadata), but

Re: Additional graphs?

2015-08-04 Thread Randy Gelhausen
Today Zeppelin includes the graphs you described out of the box. More visualization support out of the box is in progresshttps://github.com/apache/incubator-zeppelin/pull/152. Today you can have your scripts emit HTML and JavaScripthttps://zeppelin.incubator.apache.org/docs/display.html for

Re: Yarn + Spark + Zepplin ?

2015-08-03 Thread Randy Gelhausen
Hi Deepak, Hortonworks has its own howto post here: http://hortonworks.com/blog/introduction-to-data-science-with-apache-spark/ Hope it helps. Thanks, -Randy From: ÐΞ€ρ@Ҝ (๏̯͡๏) Reply-To: users@zeppelin.incubator.apache.orgmailto:users@zeppelin.incubator.apache.org Date: Monday, August 3,