Sahil Takiar created HIVE-18869: ----------------------------------- Summary: Improve SparkTask OOM Error Parsing Logic Key: HIVE-18869 URL: https://issues.apache.org/jira/browse/HIVE-18869 Project: Hive Issue Type: Sub-task Components: Spark Reporter: Sahil Takiar
The method {{SparkTask#isOOMError}} parses a stack-trace to check if it is due to an OOM error. A few improvements could be made: * Differentiate between driver OOM and task OOM * The string {{Container killed by YARN for exceeding memory limits}} is printed if a container exceeds its memory limits, but Spark tasks can OOM for other reasons, such as {{GC overhead limit exceeded}} -- This message was sent by Atlassian JIRA (v7.6.3#76005)