skip.header.line.count is ignored in HiveContext

this problem will be fixed in spark 2.1? sunerhan1...@sina.com

Re: Re: appendix

you should make hbase a data source(seems we already have hbase connector?), create a dataframe from hbase, and do join in Spark SQL. > On 21 Jun 2017, at 10:17 AM, sunerhan1...@sina.com wrote: > > Hello, > My scenary is like this: > 1.val df=hivecontext/carbon