This is a warning with the correct message. This warning could potentially lead to out of memory and/or out of (temporary) disk space errors. If there are no such errors, it is safe to assume that the computations completed successfully.
Santhosh -----Original Message----- From: Chris Olston [mailto:[email protected]] Sent: Monday, March 30, 2009 2:40 PM To: [email protected] Cc: Peter Mika Subject: unable to spill content to disk warning Pig folks, Is this a cause of concern?: 09/03/30 22:15:51 WARN mapReduceLayer.PigHadoopLogger: org.apache.pig.data.SortedDataBag: Unable to spill contents to disk The "WARN" status implies that it's not a fatal problem, but the message content is pretty worrisome. Should a user be concerned if they see this? (If so, does it mean there's insufficient swap space? And if not, perhaps the message can be re-worded :) -Chris -- Christopher Olston, Ph.D. Sr. Research Scientist Yahoo! Research
