Hi there,For a very specific type of reduce task, we currently need to use a large number of threads.
To avoid running out of memory, I'd like to constrain the Linux stack size via a "ulimit -s xxx" shell script command before starting up the JVM. I could do this for the entire system at boot time, but it would be better to have it for just the Hadoop JVM(s).
Any suggestions for how best to handle this? Thanks, -- Ken -- Ken Krugler +1 530-210-6378