Re: Spark + Zeppelin on EC2

2016-03-25 Thread moon soo Lee
Hi, Spark workers will open connections to access Spark driver (SparkContext), which is running on Zeppelin instance. So make sure your network configuration (firewall, routing table, etc) allows workers connect to Zeppelin instance. Could you verify spark shell command, not on the master node,

Re: Importaing Hbase data

2016-03-25 Thread Randy Gelhausen
You can put an Phoenix view on top of your existing HBase table, then use Phoenix's Spark module to read the table into a dataframe. On Fri, Mar 25, 2016 at 12:44 PM, Benjamin Kim wrote: >

Re: Multi-User Zeppelin Deployment?

2016-03-25 Thread Chris Miller
Thank you for your detailed reply! -- Chris Miller On Thu, Mar 10, 2016 at 1:40 AM, moon soo Lee wrote: > Hi Chris Miller, > > >- If one user is running a job with an interpreter, can another user >simultaneously run a job (such as, in another notebook) with the same

Re: Spark + Zeppelin on EC2

2016-03-25 Thread Chris Miller
Curious about this too... I'll be moving Zeppelin off to its own box in the near future. If you figure this out, post your resolution here. -- Chris Miller On Sat, Mar 26, 2016 at 12:54 AM, Marcin Pilarczyk < marcin.pilarc...@interia.pl> wrote: > Guys, > > I'm trying to switch my zeppelin

Spark + Zeppelin on EC2

2016-03-25 Thread Marcin Pilarczyk
Guys, I'm trying to switch my zeppelin instance (0.6 snapshot) from the spark instance installed on very same machine onto ec2 created spark. Both versions of spark are 1.5.2. I've just created a test instance in EC2, I can submit jobs or use spark shell. I have revised logs each and every

Re: Importaing Hbase data

2016-03-25 Thread Benjamin Kim
The hbase-spark module is still a work in progress in terms of Spark SQL. All the RDD methods are complete and ready to use against the current version of HBase 1.0+, but the use of DataFrames will require the unreleased version of HBase 2.0. Fortunately, there is work in progress to back-port

Re: Importaing Hbase data

2016-03-25 Thread Silvio Fiorito
There’s also this, which seems more current: https://github.com/apache/hbase/tree/master/hbase-spark I haven’t used it, but I know Ted Malaska and others from Cloudera have worked heavily on it. From: Felix Cheung > Reply-To:

Re: Importaing Hbase data

2016-03-25 Thread Felix Cheung
You should be able to access that from Spark SQL through a package like http://spark-packages.org/package/Huawei-Spark/Spark-SQL-on-HBase This package seems like have not been updated for a while though. On Tue, Mar 22, 2016 at 11:06 AM -0700, "Kumiko Yada" wrote: