That happened to me when using GZ compression without the native compression libraries installed properly. You must add them to hbase .90 manually. Without them it uses the pure-java gzip successfully, but I think hadoop has a logging bug and prints out the message too often.
Matt On Sat, Jan 22, 2011 at 9:24 PM, Ted Yu <[email protected]> wrote: > In 0.90 region server log, I got: > > grep 'Got brand-new compressor' > hbase-hadoop-regionserver-sjc1-hadoop2.sjc1.carrieriq.com.log | wc > 435933 3051531 41413635 > > I wonder if the above led to degraded performance. > > On the same regionserver: > > libgplcompression.so libhadoop.a libhadoop.la libhadoop.so > libhadoop.so.1 libhadoop.so.1.0.0 liblzo2.so.2 > [sjc1-hadoop2.sjc1:hadoop 1231]pwd > /usr/local/hadoop/hadoop/lib/native/Linux-amd64-64 > > Comment is welcome. >
