[ https://issues.apache.org/jira/browse/SPARK-4926?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Patrick Wendell resolved SPARK-4926. ------------------------------------ Resolution: Invalid Resolving in agreement with [~sowen] > Spark manipulate Hbase > ---------------------- > > Key: SPARK-4926 > URL: https://issues.apache.org/jira/browse/SPARK-4926 > Project: Spark > Issue Type: Question > Reporter: Lily > > When I run the program below,I got an error “Job aborted due to stage > failure: Task 0.0 in stage 2.0 (TID 14) had a not serializable > result:org.apache.hadoop.hbase.io.ImmutableBytesWritable” > How can I manipulate the results? > How to realize get,put,scan of hbase by scala? > There are not any examples in the source code files. > import org.apache.hadoop.hbase.client.HBaseAdmin > import org.apache.hadoop.hbase.{ HBaseConfiguration, HTableDescriptor } > import org.apache.hadoop.hbase.mapreduce.TableInputFormat > import org.apache.spark._ > object HbaseTest extends Serializable{ > def main(args: Array[String]) { > val sparkConf = new SparkConf().setAppName("HBaseTest") > val sc = new SparkContext(sparkConf) > val conf = HBaseConfiguration.create() > conf.set("hbase.zookeeper.property.clientPort", "2181"); > conf.set("hbase.zookeeper.quorum", "192.168.179.146"); > conf.set(TableInputFormat.INPUT_TABLE, "sensteer_rawdata") > val admin = new HBaseAdmin(conf) > if (!admin.isTableAvailable("sensteer_rawdata")) { > val tableDesc = new HTableDescriptor("sensteer_rawdata") > admin.createTable(tableDesc) > } > val hBaseRDD = sc.newAPIHadoopRDD(conf, classOf[TableInputFormat], > classOf[org.apache.hadoop.hbase.io.ImmutableBytesWritable], > classOf[org.apache.hadoop.hbase.client.Result]) > val count = hBaseRDD.count() > println("--------------" + hBaseRDD.count() + "--------------") > val res = hBaseRDD.take(count.toInt) > sc.stop() > } > } -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org