Connection refused to NameNode Port (8020) When using HBaseTestingUtility

Hi All, I receive the following error when using HBaseTestingUtility and start up the startMiniHBaseCluster. As you can see I am attempting to localise my test HBase test framework, so I cannot understand what could be going wrong in regards to networking. An exception or error caused a run to

Re: Reading specific column family and columns in Hbase table through spark

Hey Mich, Are you setting the column family / qualifier values in the config? e.g. config.set(TableInputFormat.SCAN_COLUMN_FAMILY, "cf") // column family config.set(TableInputFormat.SCAN_COLUMNS, "cf1:cq1 cf1:cq2") // column qualifier As you already have the results when you use

Re: hbase/spark - Delegation Token can be issued only with kerberos or web authentication

; "owl.properties,conf-hbase/log4j.properties,conf-hbase/ > hbase-site.xml,conf-hbase/core-site.xml,$2" > \ > --class $1 \ > cards-batch-$3-jar-with-dependencies.jar $2 > > > > On Fri, 18 Nov 2016 at 16:37 Abel Fernández <mevsmys...@gmail.com> wrote:

Re: hbase/spark - Delegation Token can be issued only with kerberos or web authentication

ández" <mevsmys...@gmail.com> wrote: > Yep, the keytab is also in the driver into the same location. > > -rw-r--r-- 1 hbase root 370 Nov 16 17:13 hbase.keytab > > Do you know what are the permissions that the keytab should have? > > > > On Fri, 18 Nov 2016 at 1

Re: hbase/spark - Delegation Token can be issued only with kerberos or web authentication

ab /opt/company/conf/hbase.keytab \ > --files > "owl.properties,conf-hbase/log4j.properties,conf-hbase/ > hbase-site.xml,conf-hbase/core-site.xml,$2" > \ > --class $1 \ > cards-batch-$3-jar-with-dependencies.jar $2 > > On Fri, 18 Nov 2016 at 14:01 Nkechi Achara &

Re: hbase/spark - Delegation Token can be issued only with kerberos or web authentication

Can you use the principal and keytab options in Spark submit? These should circumvent this issue. On 18 Nov 2016 1:01 p.m., "Abel Fernández" wrote: > Hello, > > We are having problems with the delegation of the token in a secure > cluster: Delegation Token can be issued

Re: Modifying the existing column family and value in a Put

Thanks! I'll extract and make another object On 13 Oct 2016 4:54 p.m., "Ted Yu" <yuzhih...@gmail.com> wrote: > Looking at prePut / postPut methods, I think the answer is no. > > On Thu, Oct 13, 2016 at 7:46 AM, Nkechi Achara <nkach...@googlemail.com> > wrote:

Modifying the existing column family and value in a Put

Hi All, I am writing a transformation observer co-processor, and I would like to know if there is a way to modify the family, and the value without having to reconstruct the Put object again? Thanks, K

Is setting the start and endrow inclusive of the keys provided

Hi, If i set a start and stop row in a Scan will this retrieve the inclusive records for the start row and the end row or will it be exclusive in some way. I ask as I am attempting to perform a scan in the following fashion: new Scan(Bytes.toBytes(startRow),Bytes.toBytes(endrow) ) and when |I

Re: submitting spark job with kerberized HBase issue

can / put / gets etc methods. Thanks, Nkechi On 9 August 2016 at 15:20, Aneela Saleem <ane...@platalytics.com> wrote: > Thanks Nkechi, > > Can you please direct me to some code snippet with hbase on spark module? > I've been trying that for last few days but did not found a w

Re: submitting spark job with kerberized HBase issue

Hey, Have you tried hbase on spark module, or the spark-hbase module to connect? The principal and keytab options should work out of the box for kerberized access. I can attempt your code if you don't have the ability to use those modules. Thanks K On 9 Aug 2016 2:25 p.m., "Aneela Saleem"

Re: Good connector libraries for Spark connecting to Hbase for Spark 1.3 Hbase 1.0

scala API, although Java should be easy to alter Also, the cluster is kerberized  On 22 April 2016 at 22:34, Sean Busbey <bus...@cloudera.com> wrote: > Are you attempting to use Spark's Java API or its Scala API? (or python, > etc?) > > On Fri, Apr 22, 2016 at 2:24 PM, Nk

Good connector libraries for Spark connecting to Hbase for Spark 1.3 Hbase 1.0

Hi, I am attempting to use both SpakOnHbase and Hbase-Spark, but I keep receiving dependency isues, and I am not sure if any of these connectors are available for Spark 1.3 / Hadoop 2.6 / Hbase 1.0. Has anyone got a new library I can use, or a concrete example to use? Thanks, Keech

Re: choosing between hbase-spark / spark-hbase

So Hbase-spark is a continuation of the spark on hbase project, but within the Hbase project. They are not any significant differences apart from the fact that Spark on hbase is not updated. Dependent on the version you are using it would be more beneficial to use Hbase-Spark Kay On 5 Apr 2016

Re: Example of spinning up a Hbase mock style test for integration testing in scala

h, >> >> Please post your sample test, its run log, version of Hbase , hadoop, … >> And make sure that hadoop-core-1.2.1.jar is not your classpath (causes >> many errors!). >> >> Best, >> Mahmoud >> From: Nkechi Achara <nkach...@googlemail.com> nka

How to change the base data directory with HBaseTestingUtility

Hi, I am having issues running the HbaseTestingUtility within IntelliJ IDE, and I can see the following error is probably a result of the file name being too long: 16/03/14 22:45:13 WARN datanode.DataNode: IOException in BlockReceiver.run(): java.io.IOException: Failed to move meta file for

Re: Example of spinning up a Hbase mock style test for integration testing in scala

y well. But I am using Java > only. > > Best regards, > Mahmoud Parsian > > > On 3/13/16, 11:52 PM, "Nkechi Achara" <nkach...@googlemail.com> wrote: > > >Hi, > > > >I am trying to find an example of how to spin up a Hbase server in a mock

Re: Example of spinning up a Hbase mock style test for integration testing in scala

<gaurav130...@gmail.com> wrote: > I am not aware of a scala heating am only aware of java testing with hbase. > > You can hbasetestingutility.java that is present in hbase testing java. > Call there startminicluster or dfs cluster. > > Thanks > On Mar 14, 2016 12:22

Example of spinning up a Hbase mock style test for integration testing in scala

Hi, I am trying to find an example of how to spin up a Hbase server in a mock or integration style, so I can test my code locally in my IDE. I have tried fake-hbase and hbase testing utility and receive errors especially when trying to start the cluster. Has anyone got any examples in scala to do