Have you tried setting the following property through the command line?

-D mapreduce.job.mappers


Regards,

Shahab


On Mon, Oct 20, 2014 at 2:24 AM, [email protected] <[email protected]>
wrote:

>  Hello,
> I used hbase Rowcounter on yarn , but the num of mappers was  1, and the
> progress was 0%.
> The input data was quit large, about  587GB.
> So how can I set the num of mappers when I use hbase RowCounter on yarn to
> make it faster?
> The commands I used were below:
>
> hadoop jar  hbase-server-0.99.0-hadoop2-hadoop.jar importtsv 
> -Dimporttsv.columns=HBASE_ROW_KEY,cf:c1,cf:c2,cf:c3,cf:c4,cf:c5,cf:c6,cf:c7 
> -Dimporttsv.separator="," -Dimporttsv.bulk.output=/inspur/output1 test 
> /inspur/input/data/test.txt
>
> hadoop jar hbase-server-0.99.0-hadoop2-hadoop.jar completebulkload
> /inspur/output1 test
>
>  hbase org.apache.hadoop.hbase.mapreduce.RowCounter test
>
> ------------------------------
>         -----------------
> 刘璧怡
> 系统软件部研发三处
>  浪潮(北京)电子信息产业有限公司
> TEL:010-61643876/18500682190
>

Reply via email to