Hi Ben This error happens when the mapreduce job triggers more number of process than allowed by the underlying OS. You need to increase the nproc value if it is the default one.
You can get the current values from linux using ulimit -u The default is 1024 I guess. Check that for the user that runs mapreduce jobs, for a non security enabled cluster it is mapred. You need to increase this to a laarge value using mapred soft nproc 10000 mapred hard nproc 10000 If you are running on a security enabled cluster, this value should be raised for the user who submits the job. Regards Bejoy KS