Shuai Lin created SPARK-17802: --------------------------------- Summary: Lots of "java.lang.ClassNotFoundException: org.apache.hadoop.ipc.CallerContext" In spark logs Key: SPARK-17802 URL: https://issues.apache.org/jira/browse/SPARK-17802 Project: Spark Issue Type: Improvement Components: Spark Core Reporter: Shuai Lin Priority: Minor
SPARK-16757 sets the hadoop {{CallerContext}} when calling hadoop/hdfs apis to make spark applications more diagnosable in hadoop/hdfs logs. However, the {{CallerContext}} is only added since hadoop 2.8. So each time {{utils.CallerContext.setCurrentContext()}} is called (e.g when a task is created), a "java.lang.ClassNotFoundException: org.apache.hadoop.ipc.CallerContext" error is logged. We should improve this so it's only logged once. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org