I get this error when running Reduce tasks on a machine:

java.lang.OutOfMemoryError: unable to create new native thread
        at java.lang.Thread.start0(Native Method)
        at java.lang.Thread.start(Thread.java:597)
        at 
org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.(DFSClient.java:2591)
        at org.apache.hadoop.hdfs.DFSClient.create(DFSClient.java:454)
        at 
org.apache.hadoop.hdfs.DistributedFileSystem.create(DistributedFileSystem.java:190)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:487)
        at org.apache.hadoop.fs.FileSystem.create(FileSystem.java:387)
        at 
org.apache.hadoop.mapred.TextOutputFormat.getRecordWriter(TextOutputFormat.java:117)
        at 
org.apache.hadoop.mapred.lib.MultipleTextOutputFormat.getBaseRecordWriter(MultipleTextOutputFormat.java:44)
        at 
org.apache.hadoop.mapred.lib.MultipleOutputFormat$1.write(MultipleOutputFormat.java:99)
        at org.apache.hadoop.mapred.ReduceTask$3.collect(ReduceTask.java:410)

is it possible to move a reduce task to other machine in the cluster on the fly?

--
./david

Reply via email to