[ https://issues.apache.org/jira/browse/SPARK-15259?page=com.atlassian.jira.plugin.system.issuetabpanels:all-tabpanel ]
Eric Liang updated SPARK-15259: ------------------------------- Summary: Sort time metric should not include spill and record insertion time (was: Sort time metric) > Sort time metric should not include spill and record insertion time > ------------------------------------------------------------------- > > Key: SPARK-15259 > URL: https://issues.apache.org/jira/browse/SPARK-15259 > Project: Spark > Issue Type: Bug > Components: SQL > Reporter: Eric Liang > Priority: Minor > > After SPARK-14669 it seems the sort time metric includes both spill and > record insertion time. This makes it not very useful since the metric becomes > close to the total execution time of the node. > We should track just the time spent for in-memory sort, as before. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org