L. C. Hsieh created SPARK-36735:
-----------------------------------
Summary: Adjust overhead of cached relation for DPP
Key: SPARK-36735
URL: https://issues.apache.org/jira/browse/SPARK-36735
Project: Spark
Issue Type: Improvement
Components: SQL
Affects Versions: 3.3.0
Reporter: L. C. Hsieh
Currently we calculate if there is benefit of pruning with DPP by simply
summing up the size of all scan relations as the overhead. However, for cached
relations, the overhead should be different than a non-cached relation. This
proposes to use adjusted overhead for cached relation with DPP.
--
This message was sent by Atlassian Jira
(v8.3.4#803005)
---------------------------------------------------------------------
To unsubscribe, e-mail: issues-unsubscr...@spark.apache.org
For additional commands, e-mail: issues-h...@spark.apache.org
