How to enable compression of blockfiles?

2008-08-08 Thread Michael K. Tung
Hello, I have a simple question. How do I configure DFS to store compressed block files? I've noticed by looking at the blk_ files that the text documents I am storing are uncompressed. Currently our hadoop deployment is taking up 10x the diskspace as compared to our system before moving to

Re: How to enable compression of blockfiles?

2008-08-08 Thread lohit
not splittable, meaning each map will consume whole of .gz Thanks, Lohit - Original Message From: Michael K. Tung [EMAIL PROTECTED] To: core-user@hadoop.apache.org Sent: Friday, August 8, 2008 1:09:01 PM Subject: How to enable compression of blockfiles? Hello, I have a simple question