[
https://issues.apache.org/jira/browse/SPARK-26639?page=com.atlassian.jira.plugin.system.issuetabpanels:comment-tabpanel&focusedCommentId=16744620#comment-16744620
]
Ke Jia commented on SPARK-26639:
--------------------------------
[~hyukjin.kwon] Thanks for your interesting.
As discussion in [https://github.com/apache/spark/pull/14548] When I run Q23b
of TPC-DS, I found the visualized plan do show the subquery is executed once as
following.
!https://user-images.githubusercontent.com/11972570/51232955-813af880-19a3-11e9-9d1c-96bb9de0c130.png!
But the stage of same subquery execute maybe not once as following:
!https://user-images.githubusercontent.com/11972570/51233118-fb6b7d00-19a3-11e9-9b48-9cebfb74ebd1.png!
So I guess the reuse subquery does not work in fact. Maybe I miss some
knowledge. Thanks.
> The reuse subquery function maybe does not work in SPARK SQL
> ------------------------------------------------------------
>
> Key: SPARK-26639
> URL: https://issues.apache.org/jira/browse/SPARK-26639
> Project: Spark
> Issue Type: Improvement
> Components: SQL, Web UI
> Affects Versions: 2.3.2, 2.4.0
> Reporter: Ke Jia
> Priority: Major
>
> The subquery reuse feature has done in
> [https://github.com/apache/spark/pull/14548]
> In my test, I found the visualized plan do show the subquery is executed
> once. But the stage of same subquery execute maybe not once.
>
--
This message was sent by Atlassian JIRA
(v7.6.3#76005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
