Hi, Harsh,
I appreciate so much for your reply!
My current Linux is RedHat 9. I worry that it must be a little bit old.
That's the reason for the warning?
Best regards,
Bing
On Wed, Feb 8, 2012 at 1:56 PM, Harsh J ha...@cloudera.com wrote:
Hey Bing,
What platform are you using to submit
Hey, Harsh,
When I installed Hadoop, I just extracted the package, hadoop-1.0.0.tar.gz.
Then, set up some required configurations. What is tarball?
The RedHat is version 9. The CPU is AMD. It must be X86 compatible.
Thanks!
Bing
On Wed, Feb 8, 2012 at 6:08 PM, Harsh J ha...@cloudera.com
Looks you are not using any compression in your code. Hadoop has some native
libraries to load mainly for compression codecs.
When you want to use that compression tequniques, you need to compile with this
compile.native option enable. Also need to set in java library path. If you are
not using
Dear Uma,
Thanks so much for your reply!
Is the compression technique critical to Hadoop? I am not familiar with
native libraries.
Best regards,
Bing
On Tue, Feb 7, 2012 at 6:04 PM, Uma Maheswara Rao G mahesw...@huawei.comwrote:
Looks you are not using any compression in your code. Hadoop
Hi Bing,
If your data is highly compressible (e.g.-text) you should expect to see
higher throughput consuming the compressed stream. Of course you should
mmend doing a benchmark run against some sample data.
Keep in mind that not all compressed streams can be arbitrarily split, so
you must
Dear Adam,
Since I am not familiar with the native configuration, I have not solved
the warning.
You mean I can find a proper compression solution and do that in my own
code instead of using the ones in Hadoop? What I need to do is just to
guarantee the compressed data should be splittable.
Hey Bing,
What platform are you using to submit jobs from? Linux has native libs
pre-built and available already, and you can just use them OOB. Native
libraries also help performance beyond just compression today, so its
a must-have at the server end today.
Adam's second point was more about
