Re: How do I create per-reducer temporary files?

2011-04-09 Thread Harsh J
Hello, On Tue, Apr 5, 2011 at 2:53 AM, W.P. McNeill bill...@gmail.com wrote: If I try:      storePath = FileOutputFormat.getPathForWorkFile(context, my-file, .seq);      writer = SequenceFile.createWriter(FileSystem.getLocal(configuration),            configuration, storePath,

Re: cannot compile the source code

2011-04-09 Thread Harsh J
Hello, 2011/4/6 لسٹ शिराज़ shiraz.li...@googlemail.com: Hi folks, I have checked out the hadoop-common source code from the tag 0.21. I have executed the command on root project folder with ant eclipse, I can successfully view the project in eclipse, but there are some compilation errors

Re: Reg HDFS checksum

2011-04-09 Thread Harsh J
Hello Thamizh, Perhaps the discussion in the following link can shed some light on this: http://getsatisfaction.com/cloudera/topics/hadoop_fs_crc On Fri, Apr 8, 2011 at 5:47 PM, Thamizh tceg...@yahoo.co.in wrote: Hi All, This is question regarding HDFS checksum computation. -- Harsh J

Re: Writing to Mapper Context from RecordReader

2011-04-09 Thread Harsh J
Hello Adi, On Thu, Apr 7, 2011 at 8:12 PM, Adi adi.pan...@gmail.com wrote: using 0.21.0. I have implemented a custom InputFormat. The RecordReader extends org.apache.hadoop.mapreduce.RecordReaderKEYIN, VALUEIN The sample I looked at threw an IOException when there was incompatible input

Can we use System.exit() inside custom job class main function?

2011-04-09 Thread Xiaobo Gu
Hi, Will it terminate the whole Hadoop JVM ? Regards, Xiaobo Gu

job.

2011-04-09 Thread real great..
Hi, Although this is absolutely out of context, is there a similar mailing list for Hadoop jobs?? especially freshers from engineering who want to work in this field have some small experience working in this context? -- Regards, R.V.

Re: Can we use System.exit() inside custom job class main function?

2011-04-09 Thread Harsh J
Hello, On Sun, Apr 10, 2011 at 9:37 AM, Xiaobo Gu guxiaobo1...@gmail.com wrote: Hi, Will it terminate the whole Hadoop JVM ? It would be alright to use System.exit() in the job driver (frontend). It would only terminate the launcher program JVM, not the submitted jobs. -- Harsh J