Florian Kaspar created SPARK-24494: -------------------------------------- Summary: Give users possibility to skip own classes in SparkContext.getCallSite() Key: SPARK-24494 URL: https://issues.apache.org/jira/browse/SPARK-24494 Project: Spark Issue Type: Wish Components: Spark Core Affects Versions: 2.2.0 Environment: any (currently using Spark 2.2.0 in both local mode and with YARN) Reporter: Florian Kaspar
org.apache.spark.SparkContext.getCallSite() uses org.apache.spark.util.Utils.getCallSite() which by default skips Spark and Scala classes. It would be nice to be able to add user-defined classes/patterns to skip here as well. We have one central class that acts as some kind of proxy for RDD transformations and is used by many other classes. In the SparkUI we would like to see the real origin of a transformation being not the proxy but its caller. This would make the UI even more useful to us. -- This message was sent by Atlassian JIRA (v7.6.3#76005) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org