Re: Good connector libraries for Spark connecting to Hbase for Spark 1.3 Hbase 1.0

2016-04-22 Thread Sean Busbey
The example in the HBase-Downstreamer project handles its own Kerberos authentication for talking to HBase; it should not be impacted by implementation issues in Spark (unless they are severely messing with the Classloader, which I don't think they are). That said, I have not tested it with Spark

Re: Good connector libraries for Spark connecting to Hbase for Spark 1.3 Hbase 1.0

2016-04-22 Thread sudhir patil
Connecting to kerborised hbase from spark is fixed in spark 1.4 , don't think 1.3 works because kerberos issues. https://issues.apache.org/jira/plugins/servlet/mobile#issue/SPARK-6918 On Apr 23, 2016 5:35 AM, "Sean Busbey" wrote: > The HBase-Downstreamer project has an example that uses the Java

Re: Good connector libraries for Spark connecting to Hbase for Spark 1.3 Hbase 1.0

2016-04-22 Thread Sean Busbey
The HBase-Downstreamer project has an example that uses the Java API for Spark Streaming on a secure cluster: https://github.com/saintstack/hbase-downstreamer#spark-streaming-test-application https://s.apache.org/apvQ We'd greatly like a Scala version. On Fri, Apr 22, 2016 at 4:16 PM, Nkechi Ac

Re: Good connector libraries for Spark connecting to Hbase for Spark 1.3 Hbase 1.0

2016-04-22 Thread Nkechi Achara
scala API, although Java should be easy to alter Also, the cluster is kerberized 😣 On 22 April 2016 at 22:34, Sean Busbey wrote: > Are you attempting to use Spark's Java API or its Scala API? (or python, > etc?) > > On Fri, Apr 22, 2016 at 2:24 PM, Nkechi Achara > wrote: > > Hi, > > > > I a

Re: Good connector libraries for Spark connecting to Hbase for Spark 1.3 Hbase 1.0

2016-04-22 Thread Sean Busbey
Are you attempting to use Spark's Java API or its Scala API? (or python, etc?) On Fri, Apr 22, 2016 at 2:24 PM, Nkechi Achara wrote: > Hi, > > I am attempting to use both SpakOnHbase and Hbase-Spark, but I keep > receiving dependency isues, and I am not sure if any of these connectors > are avail

Good connector libraries for Spark connecting to Hbase for Spark 1.3 Hbase 1.0

2016-04-22 Thread Nkechi Achara
Hi, I am attempting to use both SpakOnHbase and Hbase-Spark, but I keep receiving dependency isues, and I am not sure if any of these connectors are available for Spark 1.3 / Hadoop 2.6 / Hbase 1.0. Has anyone got a new library I can use, or a concrete example to use? Thanks, Keech