Re: LeaseExpiredException Exception

2009-12-11 Thread Mehul Sutariya
Hey Jason, I use Hadoop 0.20.1 and I had seen the lease expired exception RecordWriter was closed manually, which means I had my customized OutputFormat. So, after closing the writer, framework tries to close the writer as well and fails. My best guess here is that somewhere in your job, you are c

Re: LeaseExpiredException Exception

2009-12-08 Thread Ken Krugler
Hi Jason, Hi Jason, Thanks for the info - it's good to hear from somebody else who's run into this :) I tried again with a bigger box for the master, and wound up with the same results. I guess the framework could be killing it - but no idea why. This is during a very simple "write out

Re: LeaseExpiredException Exception

2009-12-08 Thread Jason Venner
Is it possible that this is occurring in a task that is being killed by the framework. Sometimes there is a little lag, between the time the tracker 'kills a task' and the task fully dies, you could be getting into a situation like that where the task is in the process of dying but the last write i

Re: LeaseExpiredException Exception

2009-12-08 Thread Ken Krugler
Hi all, In searching the mail/web archives, I see occasionally questions from people (like me) who run into the LeaseExpiredException (in my case, on 0.18.3 while running a 50 server cluster in EMR). Unfortunately I don't see any responses, other than Dennis Kubes saying that he thought s