Hello, I have a simple question. How do I configure DFS to store compressed block files? I've noticed by looking at the "blk_" files that the text documents I am storing are uncompressed. Currently our hadoop deployment is taking up 10x the diskspace as compared to our system before moving to hadoop. I've tried modifying the io.seqfile.compress.blocksize option without success and haven't been able to find anything online regarding this. Is there any way to do this or do I need to manually compress my data before storing to HDFS?
Thanks, Michael Tung
