Re: Map output compression leads to JVM crash (0.20.0)

2009-10-25 Thread Ed Mazur
I'm not sure if this is what you're asking for the count of, but only 83 task attempts were made in my last execution. This error happens with every task, so the job fails quickly. Ed On Mon, Oct 26, 2009 at 12:00 AM, Amogh Vasekar wrote: > Hi, > Can you let us know if the count of attempt_ s i

Re: Map output compression leads to JVM crash (0.20.0)

2009-10-25 Thread Amogh Vasekar
Hi, Can you let us know if the count of attempt_ s is 32k - 1? I remember reading about similar error sometime back. Amogh On 10/26/09 9:06 AM, "Ed Mazur" wrote: I'm having problems on 0.20.0 when map output compression is enabled. Map tasks complete (TaskRunner: Task 'attempt_*' done), but

Map output compression leads to JVM crash (0.20.0)

2009-10-25 Thread Ed Mazur
I'm having problems on 0.20.0 when map output compression is enabled. Map tasks complete (TaskRunner: Task 'attempt_*' done), but it looks like the JVM running the task crashes immediately after. Here's the TaskTracker log: java.io.IOException: Task process exit with nonzero status of 134. at

Re: Question regarding wordCount example

2009-10-25 Thread Jeff Zhang
Hi gao, You did not provider the type of key and value explicitly in your code, so you have to write your map method as public void map(Object key, Object value, OutputCollector output, Reporter reporter) throws IOException { // TODO Auto-generated method stub } But I suggest you wr

Question regarding wordCount example

2009-10-25 Thread felix gao
Hi all, I have some question regarding how to compile a simple hadoop program. setup Java 1.6 Ubuntu 9.02 Hadoop 0.19.2 //below is the mapper class import java.io.IOException; import java.util.StringTokenizer; import org.apache.hadoop.io.IntWritable; import org.apache.hadoop.io.LongWritable; im