I’m using Spark 1.6 and HBase 1.2. Have you got it to work using these versions?
> On Sep 3, 2016, at 12:49 PM, Mich Talebzadeh <mich.talebza...@gmail.com> > wrote: > > I am trying to find a solution for this > > ERROR log: error in initSerDe: java.lang.ClassNotFoundException Class > org.apache.hadoop.hive.hbase.HBaseSerDe not found > > I am using Spark 2 and Hive 2! > > HTH > > > > > Dr Mich Talebzadeh > > LinkedIn > https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw > > <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw> > > http://talebzadehmich.wordpress.com <http://talebzadehmich.wordpress.com/> > > Disclaimer: Use it at your own risk. Any and all responsibility for any loss, > damage or destruction of data or any other property which may arise from > relying on this email's technical content is explicitly disclaimed. The > author will in no case be liable for any monetary damages arising from such > loss, damage or destruction. > > > On 3 September 2016 at 20:31, Benjamin Kim <bbuil...@gmail.com > <mailto:bbuil...@gmail.com>> wrote: > Mich, > > I’m in the same boat. We can use Hive but not Spark. > > Cheers, > Ben > >> On Sep 2, 2016, at 3:37 PM, Mich Talebzadeh <mich.talebza...@gmail.com >> <mailto:mich.talebza...@gmail.com>> wrote: >> >> Hi, >> >> You can create Hive external tables on top of existing Hbase table using >> the property >> >> STORED BY 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' >> >> Example >> >> hive> show create table hbase_table; >> OK >> CREATE TABLE `hbase_table`( >> `key` int COMMENT '', >> `value1` string COMMENT '', >> `value2` int COMMENT '', >> `value3` int COMMENT '') >> ROW FORMAT SERDE >> 'org.apache.hadoop.hive.hbase.HBaseSerDe' >> STORED BY >> 'org.apache.hadoop.hive.hbase.HBaseStorageHandler' >> WITH SERDEPROPERTIES ( >> 'hbase.columns.mapping'=':key,a:b,a:c,d:e', >> 'serialization.format'='1') >> TBLPROPERTIES ( >> 'transient_lastDdlTime'='1472370939') >> >> Then try to access this Hive table from Spark which is giving me grief at >> the moment :( >> >> scala> HiveContext.sql("use test") >> res9: org.apache.spark.sql.DataFrame = [] >> scala> val hbase_table= spark.table("hbase_table") >> 16/09/02 23:31:07 ERROR log: error in initSerDe: >> java.lang.ClassNotFoundException Class >> org.apache.hadoop.hive.hbase.HBaseSerDe not found >> >> HTH >> >> >> Dr Mich Talebzadeh >> >> LinkedIn >> https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw >> >> <https://www.linkedin.com/profile/view?id=AAEAAAAWh2gBxianrbJd6zP6AcPCCdOABUrV8Pw> >> >> http://talebzadehmich.wordpress.com <http://talebzadehmich.wordpress.com/> >> >> Disclaimer: Use it at your own risk. Any and all responsibility for any >> loss, damage or destruction of data or any other property which may arise >> from relying on this email's technical content is explicitly disclaimed. The >> author will in no case be liable for any monetary damages arising from such >> loss, damage or destruction. >> >> >> On 2 September 2016 at 23:08, KhajaAsmath Mohammed <mdkhajaasm...@gmail.com >> <mailto:mdkhajaasm...@gmail.com>> wrote: >> Hi Kim, >> >> I am also looking for same information. Just got the same requirement today. >> >> Thanks, >> Asmath >> >> On Fri, Sep 2, 2016 at 4:46 PM, Benjamin Kim <bbuil...@gmail.com >> <mailto:bbuil...@gmail.com>> wrote: >> I was wondering if anyone has tried to create Spark SQL tables on top of >> HBase tables so that data in HBase can be accessed using Spark Thriftserver >> with SQL statements? This is similar what can be done using Hive. >> >> Thanks, >> Ben >> >> >> --------------------------------------------------------------------- >> To unsubscribe e-mail: user-unsubscr...@spark.apache.org >> <mailto:user-unsubscr...@spark.apache.org> >> >> >> > >
