Re: Spark Streaming into HBase

2014-09-05 Thread Tathagata Das
, 2014 at 2:05 PM, kpeng1 [hidden email] http://user/SendEmail.jtp?type=nodenode=13406i=4 wrote: I have been trying to understand how spark streaming and hbase connect, but have not been successful. What I am trying to do is given a spark stream, process that stream and store the results

Spark Streaming into HBase

2014-09-03 Thread kpeng1
I have been trying to understand how spark streaming and hbase connect, but have not been successful. What I am trying to do is given a spark stream, process that stream and store the results in an hbase table. So far this is what I have: import org.apache.spark.SparkConf import

Re: Spark Streaming into HBase

2014-09-03 Thread Ted Yu
, 2014 at 2:05 PM, kpeng1 kpe...@gmail.com wrote: I have been trying to understand how spark streaming and hbase connect, but have not been successful. What I am trying to do is given a spark stream, process that stream and store the results in an hbase table. So far this is what I have

Re: Spark Streaming into HBase

2014-09-03 Thread Sean Owen
below or in region server log ? Which hbase release are you using ? On Wed, Sep 3, 2014 at 2:05 PM, kpeng1 kpe...@gmail.com wrote: I have been trying to understand how spark streaming and hbase connect, but have not been successful. What I am trying to do is given a spark stream, process

Re: Spark Streaming into HBase

2014-09-03 Thread kpeng1
. -- View this message in context: http://apache-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-into-HBase-tp13378.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail

Re: Spark Streaming into HBase

2014-09-03 Thread Kevin Peng
from the code below or in region server log ? Which hbase release are you using ? On Wed, Sep 3, 2014 at 2:05 PM, kpeng1 kpe...@gmail.com wrote: I have been trying to understand how spark streaming and hbase connect, but have not been successful. What I am trying to do is given a spark

Re: Spark Streaming into HBase

2014-09-03 Thread Tathagata Das
-spark-user-list.1001560.n3.nabble.com/Spark-Streaming-into-HBase-tp13378.html Sent from the Apache Spark User List mailing list archive at Nabble.com. - To unsubscribe, e-mail: user-unsubscr...@spark.apache.org For additional

Re: Spark Streaming with HBase

2014-06-30 Thread Akhil Das
Something like this??? import java.util.List; import org.apache.commons.configuration.Configuration; import org.apache.hadoop.hbase.HBaseConfiguration; import org.apache.hadoop.hbase.client.Get; import org.apache.hadoop.hbase.client.HTable; import org.apache.hadoop.hbase.client.Result; import

Spark Streaming with HBase

2014-06-29 Thread N . Venkata Naga Ravi
Hi, Is there any example provided for Spark Streaming with Input provided from HBase table content. Thanks, Ravi