Re: Hbase: Bulk Loading with Compression and DBE

2014-12-14 Thread Ted Yu
Can you give the complete stack trace ? You can try specifying hbase.mapreduce.hfileoutputformat.datablock.encoding as PREFIX_TREE Thanks On Dec 14, 2014, at 10:04 PM, Shashwat Mishra wrote: > Hi all, > > I am trying to bulk load some network-data into an Hbase table. My mapper > emits Immu

Hbase: Bulk Loading with Compression and DBE

2014-12-14 Thread Shashwat Mishra
Hi all, I am trying to bulk load some network-data into an Hbase table. My mapper emits ImmutableBytesWritable, KeyValue pairs. I declare a pre-splitted table where the column families have compression set to SNAPPY and Data Block Encoding set to PREFIX_TREE (hcd.setCompressionType(Algorithm.SN