Davies Liu created SPARK-13523: ---------------------------------- Summary: Reuse the exchanges in a query Key: SPARK-13523 URL: https://issues.apache.org/jira/browse/SPARK-13523 Project: Spark Issue Type: New Feature Components: SQL Reporter: Davies Liu
In exchange, the RDD will be materialized (shuffled or collected), it's a good point to eliminate common part of a query. In some TPCDS queries (for example, Q64), the same exchange (ShuffleExchange or BroadcastExchange) could be used multiple times, we should re-use them to avoid the duplicated work and reduce the memory for broadcast. -- This message was sent by Atlassian JIRA (v6.3.4#6332) --------------------------------------------------------------------- To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org For additional commands, e-mail: issues-h...@spark.apache.org