Re: v0.20.203: How to compress files in Reducer

2012-04-14 Thread Piyush Kansal
Thanks, it worked :) On Sat, Apr 14, 2012 at 5:53 PM, vasanth kumar wrote: > Hi, > Check this code works > > GzipCodec gzipcodec = new GzipCodec(); > > conf.setBoolean("hadoop.native.lib", true); > gzipcodec.setConf(conf); > > out = fs.create(new Pa

Re: Hadoop's dependency on Linux

2012-04-14 Thread Lance Norskog
But none of these explain the problem. You need a program called 'chmod' in your execution path. It doesn't actually need to be chmod. On Fri, Apr 13, 2012 at 2:44 AM, Thanos Papaoikonomou wrote: > > Thank you > > Στις 12/4/2012 8:25 μμ, ο/η Harsh J έγραψε: > >> Hey Thanos, >> >> A higher degre

Re: v0.20.203: How to compress files in Reducer

2012-04-14 Thread vasanth kumar
Hi, Check this code works GzipCodec gzipcodec = new GzipCodec(); conf.setBoolean("hadoop.native.lib", true); gzipcodec.setConf(conf); out = fs.create(new Path("/home/user/test")); CompressionOutputStream stream =gzipcodec.createOutputSt

Re: v0.20.203: How to compress files in Reducer

2012-04-14 Thread Piyush Kansal
Hi, Can you please suggest for the below query. On Thu, Apr 12, 2012 at 11:01 PM, Piyush Kansal wrote: > Thanks for your quick response Harsh. > > I tried using following: > 1 OutputStream out = ipFs.create( new Path( opDir + "/" + fileName ) ); > 2 CompressionCodec codec = new GzipCodec(); > 3