Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-03 Thread Serega Sheypak
Ok, I got it. Thank you! 2014-11-03 2:20 GMT+03:00 Sean Busbey bus...@cloudera.com: On Sun, Nov 2, 2014 at 5:09 PM, Ted Yu yuzhih...@gmail.com wrote: bq. context.write(hbaseKey, put); //Exception here I am not mrunit expert. But as long as you call the following method prior to the

No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Serega Sheypak
Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put at com.google.common.base.Preconditions.checkState(Preconditions.java:149) at org.apache.hadoop.mrunit.internal.io.Serialization.copy(Serialization.java:75) at org.apache.hadoop.mrunit.internal.io.Serialization.copy

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Ted Yu
. I've bumped maven deps from cdh4 to cdh5 0.98.6-cdh5.2.0 Now I've started to get exception java.lang.IllegalStateException: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put at com.google.common.base.Preconditions.checkState

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Serega Sheypak
-cdh5.2.0) I had a unit test for mapper used to create HFile and bulk load later. I've bumped maven deps from cdh4 to cdh5 0.98.6-cdh5.2.0 Now I've started to get exception java.lang.IllegalStateException: No applicable class implementing Serialization in conf at io.serializations: class

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put at com.google.common.base.Preconditions.checkState(Preconditions.java:149) at org.apache.hadoop.mrunit.internal.io.Serialization.copy(Serialization.java:75

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Ted Yu
to create HFile and bulk load later. I've bumped maven deps from cdh4 to cdh5 0.98.6-cdh5.2.0 Now I've started to get exception java.lang.IllegalStateException: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Serega Sheypak
started to get exception java.lang.IllegalStateException: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put at com.google.common.base.Preconditions.checkState(Preconditions.java:149

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
cdh4 to cdh5 0.98.6-cdh5.2.0 Now I've started to get exception java.lang.IllegalStateException: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put at com.google.common.base.Preconditions.checkState

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
On Sun, Nov 2, 2014 at 3:53 PM, Serega Sheypak serega.shey...@gmail.com wrote: P.S. HFileOutputFormat is also deprecated... so many changes... ((( Incidentally, you should consider switching to HFileOutputFormat2, since you rely on the version that has a Mapper outputting Put values instead

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Serega Sheypak
to create HFile and bulk load later. I've bumped maven deps from cdh4 to cdh5 0.98.6-cdh5.2.0 Now I've started to get exception java.lang.IllegalStateException: No applicable class implementing Serialization in conf at io.serializations: class

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Serega Sheypak
Cool, is it this stuff? http://hbase.apache.org/book/hfilev2.html 2014-11-03 1:10 GMT+03:00 Sean Busbey bus...@cloudera.com: On Sun, Nov 2, 2014 at 3:53 PM, Serega Sheypak serega.shey...@gmail.com wrote: P.S. HFileOutputFormat is also deprecated... so many changes... (((

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
On Sun, Nov 2, 2014 at 4:11 PM, Serega Sheypak serega.shey...@gmail.com wrote: Sean, I've started to catch that serialization problem on unit-test level while using mrunit. I don't see any possibility to call HFileOutputFormat.configureIncrementalLoad before mrunit mocking stuff. I was

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
On Sun, Nov 2, 2014 at 4:14 PM, Serega Sheypak serega.shey...@gmail.com wrote: Cool, is it this stuff? http://hbase.apache.org/book/hfilev2.html No, that's all details on the update to the backing HFile format that started in HBase 0.92. The change in output format is detailed here:

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Ted Yu
bq. context.write(hbaseKey, put); //Exception here I am not mrunit expert. But as long as you call the following method prior to the above method invocation, you should be able to proceed: conf.setStrings(io.serializations, conf.get(io.serializations),

Re: No applicable class implementing Serialization in conf at io.serializations: class org.apache.hadoop.hbase.client.Put

2014-11-02 Thread Sean Busbey
On Sun, Nov 2, 2014 at 5:09 PM, Ted Yu yuzhih...@gmail.com wrote: bq. context.write(hbaseKey, put); //Exception here I am not mrunit expert. But as long as you call the following method prior to the above method invocation, you should be able to proceed: