Hi Ben

This error happens when the mapreduce job triggers more number of
process than allowed by the underlying OS. You need to increase the
nproc value if it is the default one.

You  can get the current values from linux using
ulimit -u
The default is 1024 I guess. Check that for the user that runs
mapreduce jobs, for a non security enabled cluster it is mapred.

You need to increase this to a laarge value using
mapred soft nproc 10000
mapred hard nproc 10000

If you are running on a security enabled cluster, this value should be
raised for the user who submits the job.

Regards
Bejoy KS

Reply via email to