RE: CompleteBulkLoad Error

2018-01-11 Thread ashish singhi 
As per my understanding the online HBase book refers to master version.

For the version specific document we can refer to book which is part of release 
tar,  hbase-1.2.6-bin.tar.gz\hbase-1.2.6\docs\book.pdf

Regards,
Ashish

-Original Message-
From: Yung-An He [mailto:mathst...@gmail.com] 
Sent: Thursday, January 11, 2018 2:21 PM
To: user@hbase.apache.org
Subject: Re: CompleteBulkLoad Error

Ankit and Ashish, thanks for reply,

I saw the ImportTsv command
`org.apache.hadoop.hbase.tool.LoadIncrementalHFiles`
from the HBase book <http://hbase.apache.org/book.html#completebulkload> on the 
website, and according to official documents to run the command. But the 
command is for HBase-2.0.

Perhaps someone has the same situation with me.
If there are official reference guides for Individual version, and the 
information would be more clear.


Regards,
Yung-An

2018-01-11 15:06 GMT+08:00 ashish singhi <ashish.sin...@huawei.com>:

> Hi,
>
> The path of tool you are passing is wrong, it is org.apache.hadoop.hbase.
> mapreduce.LoadIncrementalHFiles.
> So the command will be, hbase 
> org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles
> hdfs://hbase-master:9000/tmp/bktableoutput bktable
>
> Regards,
> Ashish
>
> -Original Message-
> From: Yung-An He [mailto:mathst...@gmail.com]
> Sent: Thursday, January 11, 2018 12:19 PM
> To: user@hbase.apache.org
> Subject: CompleteBulkLoad Error
>
> Hi,
>
> I import data from files to HBase table via the ImportTsv command as below:
>
> hbase org.apache.hadoop.hbase.mapreduce.ImportTsv
> -Dimporttsv.columns=HBASE_ROW_KEY,cf:c1,cf:c2-Dimporttsv.
> skip.bad.lines=false
> '-Dimporttsv.separator=,'
> -Dimporttsv.bulk.output=hdfs://hbase-master:9000/tmp/bktableoutput
> bktable hdfs://hbase-master:9000/tmp/importsv
>
> and the MR job runs successfully. When I execute the completebulkload 
> command as below:
>
> hbase org.apache.hadoop.hbase.tool.LoadIncrementalHFiles
> hdfs://hbase-master:9000/tmp/bktableoutput bktable
>
> and it throws the exception:
> Error: Could not find or load main class org.apache.hadoop.hbase.tool.
> LoadIncrementalHFiles
>
> I try the other command:
> HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase classpath` 
> ${HADOOP_HOME}/bin/hadoop jar ${HBASE_HOME}/lib/hbase-server-1.2.6.jar
> completebulkload hdfs://hbase-master:9000/tmp/bktableoutput bktable
>
> and it succeeds.
>
> Does anyone have the idea?
>
>
> Here is the information of HBase cluster :
>
> * HBase version 1.2.6
> * Hadoop version 2.7.5
> * With 5 work nodes.
>

Re: CompleteBulkLoad Error

2018-01-11 Thread Yung-An He 
Ankit and Ashish, thanks for reply,

I saw the ImportTsv command
`org.apache.hadoop.hbase.tool.LoadIncrementalHFiles`
from the HBase book <http://hbase.apache.org/book.html#completebulkload> on
the website,
and according to official documents to run the command. But the command is
for HBase-2.0.

Perhaps someone has the same situation with me.
If there are official reference guides for Individual version, and the
information would be more clear.


Regards,
Yung-An

2018-01-11 15:06 GMT+08:00 ashish singhi <ashish.sin...@huawei.com>:

> Hi,
>
> The path of tool you are passing is wrong, it is org.apache.hadoop.hbase.
> mapreduce.LoadIncrementalHFiles.
> So the command will be, hbase 
> org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles
> hdfs://hbase-master:9000/tmp/bktableoutput bktable
>
> Regards,
> Ashish
>
> -Original Message-
> From: Yung-An He [mailto:mathst...@gmail.com]
> Sent: Thursday, January 11, 2018 12:19 PM
> To: user@hbase.apache.org
> Subject: CompleteBulkLoad Error
>
> Hi,
>
> I import data from files to HBase table via the ImportTsv command as below:
>
> hbase org.apache.hadoop.hbase.mapreduce.ImportTsv
> -Dimporttsv.columns=HBASE_ROW_KEY,cf:c1,cf:c2-Dimporttsv.
> skip.bad.lines=false
> '-Dimporttsv.separator=,'
> -Dimporttsv.bulk.output=hdfs://hbase-master:9000/tmp/bktableoutput
> bktable hdfs://hbase-master:9000/tmp/importsv
>
> and the MR job runs successfully. When I execute the completebulkload
> command as below:
>
> hbase org.apache.hadoop.hbase.tool.LoadIncrementalHFiles
> hdfs://hbase-master:9000/tmp/bktableoutput bktable
>
> and it throws the exception:
> Error: Could not find or load main class org.apache.hadoop.hbase.tool.
> LoadIncrementalHFiles
>
> I try the other command:
> HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase classpath`
> ${HADOOP_HOME}/bin/hadoop jar ${HBASE_HOME}/lib/hbase-server-1.2.6.jar
> completebulkload hdfs://hbase-master:9000/tmp/bktableoutput bktable
>
> and it succeeds.
>
> Does anyone have the idea?
>
>
> Here is the information of HBase cluster :
>
> * HBase version 1.2.6
> * Hadoop version 2.7.5
> * With 5 work nodes.
>

RE: CompleteBulkLoad Error

2018-01-10 Thread ashish singhi 
Hi, 

The path of tool you are passing is wrong, it is 
org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles.
So the command will be, hbase 
org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles 
hdfs://hbase-master:9000/tmp/bktableoutput bktable

Regards,
Ashish

-Original Message-
From: Yung-An He [mailto:mathst...@gmail.com] 
Sent: Thursday, January 11, 2018 12:19 PM
To: user@hbase.apache.org
Subject: CompleteBulkLoad Error

Hi,

I import data from files to HBase table via the ImportTsv command as below:

hbase org.apache.hadoop.hbase.mapreduce.ImportTsv
-Dimporttsv.columns=HBASE_ROW_KEY,cf:c1,cf:c2-Dimporttsv.skip.bad.lines=false
'-Dimporttsv.separator=,'
-Dimporttsv.bulk.output=hdfs://hbase-master:9000/tmp/bktableoutput bktable 
hdfs://hbase-master:9000/tmp/importsv

and the MR job runs successfully. When I execute the completebulkload command 
as below:

hbase org.apache.hadoop.hbase.tool.LoadIncrementalHFiles
hdfs://hbase-master:9000/tmp/bktableoutput bktable

and it throws the exception:
Error: Could not find or load main class 
org.apache.hadoop.hbase.tool.LoadIncrementalHFiles

I try the other command:
HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase classpath` ${HADOOP_HOME}/bin/hadoop 
jar ${HBASE_HOME}/lib/hbase-server-1.2.6.jar
completebulkload hdfs://hbase-master:9000/tmp/bktableoutput bktable

and it succeeds.

Does anyone have the idea?


Here is the information of HBase cluster :

* HBase version 1.2.6
* Hadoop version 2.7.5
* With 5 work nodes.

Re: CompleteBulkLoad Error

2018-01-10 Thread Ankit Singhal 
In HBase 1.2.6 , package of LoadIncrementalHFiles
was org.apache.hadoop.hbase.mapreduce. so try,

$ hbase org.apache.hadoop.hbase.mapreduce.LoadIncrementalHFiles

it is changed to org.apache.hadoop.hbase.tool in HBase-2.0

On Thu, Jan 11, 2018 at 12:19 PM, Yung-An He  wrote:

> Hi,
>
> I import data from files to HBase table via the ImportTsv command as below:
>
> hbase org.apache.hadoop.hbase.mapreduce.ImportTsv
> -Dimporttsv.columns=HBASE_ROW_KEY,cf:c1,cf:c2-Dimporttsv.
> skip.bad.lines=false
> '-Dimporttsv.separator=,'
> -Dimporttsv.bulk.output=hdfs://hbase-master:9000/tmp/bktableoutput bktable
> hdfs://hbase-master:9000/tmp/importsv
>
> and the MR job runs successfully. When I execute the completebulkload
> command as below:
>
> hbase org.apache.hadoop.hbase.tool.LoadIncrementalHFiles
> hdfs://hbase-master:9000/tmp/bktableoutput bktable
>
> and it throws the exception:
> Error: Could not find or load main class
> org.apache.hadoop.hbase.tool.LoadIncrementalHFiles
>
> I try the other command:
> HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase classpath`
> ${HADOOP_HOME}/bin/hadoop jar ${HBASE_HOME}/lib/hbase-server-1.2.6.jar
> completebulkload hdfs://hbase-master:9000/tmp/bktableoutput bktable
>
> and it succeeds.
>
> Does anyone have the idea?
>
>
> Here is the information of HBase cluster :
>
> * HBase version 1.2.6
> * Hadoop version 2.7.5
> * With 5 work nodes.
>

CompleteBulkLoad Error

2018-01-10 Thread Yung-An He 
Hi,

I import data from files to HBase table via the ImportTsv command as below:

hbase org.apache.hadoop.hbase.mapreduce.ImportTsv
-Dimporttsv.columns=HBASE_ROW_KEY,cf:c1,cf:c2-Dimporttsv.skip.bad.lines=false
'-Dimporttsv.separator=,'
-Dimporttsv.bulk.output=hdfs://hbase-master:9000/tmp/bktableoutput bktable
hdfs://hbase-master:9000/tmp/importsv

and the MR job runs successfully. When I execute the completebulkload
command as below:

hbase org.apache.hadoop.hbase.tool.LoadIncrementalHFiles
hdfs://hbase-master:9000/tmp/bktableoutput bktable

and it throws the exception:
Error: Could not find or load main class
org.apache.hadoop.hbase.tool.LoadIncrementalHFiles

I try the other command:
HADOOP_CLASSPATH=`${HBASE_HOME}/bin/hbase classpath`
${HADOOP_HOME}/bin/hadoop jar ${HBASE_HOME}/lib/hbase-server-1.2.6.jar
completebulkload hdfs://hbase-master:9000/tmp/bktableoutput bktable

and it succeeds.

Does anyone have the idea?


Here is the information of HBase cluster :

* HBase version 1.2.6
* Hadoop version 2.7.5
* With 5 work nodes.