Re: Hbase MR Job with 2 OutputForm classes possible?

2014-07-30 Thread Shahab Yunus
There is a trick. You can use MultipleOutputs with TableMapReduceUtil. In the Reducer you can write to desired outputs on HDFS using MultipleOutputs and the HBase Util will do its work as is. Only caveat is that, you will have to commit the files that you have written using MultipleOutputs yoursel

Hbase MR Job with 2 OutputForm classes possible?

2014-07-30 Thread Thomas Kwan
Hi there, I have a Hbase MR job that reads data from HDFS, do a Hbase Get, and then do some data transformation. Then I need to put the data back to Hbase as well as write data to a HDFS file directory (so I can import it back into Hive). The current job creation logic is similar to the followin