Re: Add Caller Context in Spark

2016-06-09 Thread Weiqing Yang
Yes, it is a string. Jira SPARK-15857 is created. Thanks, WQ On Thu, Jun 9, 2016 at 4:40 PM, Reynold Xin wrote: > Is this just to set some string? That makes sense. One thing you would > need to make sure is that Spark

Add Caller Context in Spark

2016-06-09 Thread Weiqing Yang
Hi, Hadoop has implemented a feature of log tracing – caller context (Jira: HDFS-9184 and YARN-4349 ). The motivation is to better diagnose and understand how specific applications impacting parts