We are testing the CSV bulk loader tool (using MR) and trying to understand what are the parameter that can be used to enhanced its performance. we have 8 nodes with 4 disks each (1 core per disk) we created 32 regions and pre-split our table using salt, the table has 55 columns
So far we managed to load ~40,000 rows per second (from csv file of ~ 8G), when we compare this loading to impala loading on the same cluster, same table structure we see rates of about 300,000 rows per seconds. Any idea which parameters of Hbase /Phoenix can we use to enhance the performance Regards, Noam Information in this e-mail and its attachments is confidential and privileged under the TEOCO confidentiality terms that can be reviewed here<http://www.teoco.com/email-disclaimer>.
