Matouck,
Thank you very much, I had success!
Have a great day ...
Sincerely,
Sean
From: Matouk IFTISSEN [mailto:[email protected]]
Sent: Friday, February 14, 2014 6:52 PM
To: [email protected]
Subject: Re: hbase importtsv
hello,
You can use bulkload in to pahses, in MapR distribution we use this:
1. first phase : map metadata to table hbase
hadoop jar /opt/mapr/hbase/hbase-0.94.5/hbase-0.94.5-mapr.jar importtsv
-Dimporttsv.separator=';' -Dimporttsv.bulk.output=folder_bulk_local
-Dimporttsv.columns=HBASE_ROW_KEY,cf1:column, cfx:columnxx, TableNameHBase
folder_bulk_hdfs_input
2. seconde phase : complete bulkload
hadoop jar /opt/mapr/hbase/hbase-0.94.5/hbase-0.94.5-mapr.jar completebulkload
folder_bulk_local TableNameHBase
Regards ;)
2014-02-14 16:59 GMT+01:00 Kennedy, Sean C.
<[email protected]<mailto:[email protected]>>:
I am trying to load 1.4M records in a 7 column CSV file into hbase.
Question 1: Is this feasible?
Question 2: What type of tuning on hbase and or hdfs would be needed?
I am using apache hbase 0.94.15 and apache hadoop 1.2.1
Here is my command string:
/hd/hadoop/bin/hadoop jar /hbase/hbase-0.94.15/hbase-0.94.15.jar importtsv
'-Dimporttsv.separator=,'
-Dimporttsv.columns=HBASE_ROW_KEY,BATCH_ID,B_ITEM_NO,B_ITEM_DESCRIPTION,CONS_BATCH_ID,C_ITEM_NO,C_ITEM_DESC,QTY_ISSUED
MIIBIG /md/test_hdfs_input/large.csv
Any help apprecieated..
Sincerely,
Sean
Notice: This e-mail message, together with any attachments, contains
information of Merck & Co., Inc. (One Merck Drive, Whitehouse Station,
New Jersey, USA 08889), and/or its affiliates Direct contact information
for affiliates is available at
http://www.merck.com/contact/contacts.html) that may be confidential,
proprietary copyrighted and/or legally privileged. It is intended solely
for the use of the individual or entity named on this message. If you are
not the intended recipient, and have received this message in error,
please notify us immediately by reply e-mail and then delete it from
your system.
--
Matouk IFTISSEN | Consultant BI & Big Data
[http://events.ysance.com/signature/media/LogoYsance.png]
24 rue du sentier - 75002 Paris - www.ysance.com<http://www.ysance.com/>
Mob : +33 6 78 51 18 69 || Fax : +33 1 73 72 97 26
Ysance sur :Twitter<http://twitter.com/ysance> |
Facebook<https://www.facebook.com/pages/Ysance/131036788697> |
Google+<https://plus.google.com/u/0/b/115710923959357341736/115710923959357341736/posts>
| LinkedIn<http://www.linkedin.com/company/ysance> |
Newsletter<http://www.ysance.com/nous-contacter.html>
Nos autres sites : ys4you<http://wwww.ys4you.com/> |
labdecisionnel<http://www.labdecisionnel.com/> |
decrypt<http://decrypt.ysance.com/>
Notice: This e-mail message, together with any attachments, contains
information of Merck & Co., Inc. (One Merck Drive, Whitehouse Station,
New Jersey, USA 08889), and/or its affiliates Direct contact information
for affiliates is available at
http://www.merck.com/contact/contacts.html) that may be confidential,
proprietary copyrighted and/or legally privileged. It is intended solely
for the use of the individual or entity named on this message. If you are
not the intended recipient, and have received this message in error,
please notify us immediately by reply e-mail and then delete it from
your system.
