Re: Failed to report status for x minutes

2013-11-29 Thread Edward Capriolo
Two things generally cause this. 1) The Java task does not have sufficient java heap. It pauses often and because the JVM is paused it does not report status 2) a process like streaming or potentially a UDTF is creating many tuples or taking a long time to produce a single tuple/row Hive has som

Failed to report status for x minutes

2013-11-29 Thread Krishna Rao
Hi all, We've been running into this problem a lot recently on a particular reduce task. I'm aware that I can work around it by uping the "mapred.task.timeout". However, I would like to know what the underlying problem is. How can I find this out? Alternatively, can I force a generated hive task