JVM reuse and log files

2011-03-30 Thread Shrinivas Joshi
It seems like when JVM reuse is enabled map task log data is not getting written to their corresponding log files; log data from certain map tasks gets appended to log files corresponding to some other map task. For example, I have a case here where 8 map JVMs are running simultaneously and all sy

Re: JVM reuse and log files

2011-03-30 Thread Todd Lipcon
Hi Shrinivas, Yes, this is the behavior of the task logs when using JVM Reuse. You should notice in the log directories for the other tasks a "log index" file which specifies the byte offsets into the log files where the task starts and stops. When viewing logs through the web UI, it will use thes